Databricks Migration Engineer – Hybrid- Laurel, MD
Tasks
- Assess Informatica PowerCenter assets
- Build CI/CD pipelines with Azure DevOps
- Build Synapse pipelines and orchestration
- Configure Azure security components
- Configure monitoring dashboards and alerts
- Create architecture documentation and runbooks
- Design Azure Databricks and Synapse solutions
- Develop Databricks notebooks and jobs
- Develop migration roadmaps
- Execute unit integration regression and performance testing
- Implement ETL logging monitoring and error handling
- Integrate Azure with Oracle SQL Server APIs and GIS
- Migrate Informatica workflows and mappings
- Optimize ETL performance
- Provide training and knowledge transfer
- Support deployment cutover and rollback
- Validate data quality and reconciliation
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage | Data Quality | Data Reconciliation | ELT | ETL | Entra ID | Error Handling | Informatica PowerCenter | Key Vault | Logging | Managed Identities | Microsoft Entra | Microsoft Entra ID | Monitoring | Oracle | Orchestration | Parallel processing | Partitioning | Query Optimization | RBAC | SQL | SQL Server | Service principals | Source Control | Synapse Analytics | Testing
Education
N/A
Related jobs
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R11h ago
-
IT Data Engineer USD 60K-65KANSI X12 | AWS | Azure | Azure Data | Azure Data Factory401k retirement plan | Disability coverage | Employee assistance program | Flexible spending account | Medical/Dental/Vision insuranceMid-level Full TimeUS - Remote R15h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic AI | Auditability | CI/CD | Cloud platform401k | Dental insurance | Expense reimbursement for internet costs | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R16h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAgent systems | Computer Vision | Data Quality | Data quality monitoring | Deep learningMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer, Global Operations USD 107K-143KArtificial Intelligence | ETL | Langchain | Machine Learning | PythonContinuous learning | Flexible work options | Health, wellness, and retirement plans | Professional growth opportunitiesMid-level Full TimeCalifornia - Remote, United States R1d ago
-
AWS | Access Control | Apache Spark | Azure | CI/CD401k retirement plan | Comprehensive benefits | Dental insurance | Employee assistance program | Medical insuranceSenior-level Full TimeUSA, TX, Work-at-Home, United States R1d ago
-
Associate Director, Data Science USD 160K-297KADME | Bioinformatics | Data Analysis | Data Governance | Data Mining401k match | Hybrid work | Paid time offMid-level Full TimeCambridge (USA), United States R1d ago
-
Mid-level Full TimeUnited States Remote, United States R1d ago
-
Senior-level Full TimeCanada R3d ago
-
Senior-level Full TimeUnited States R3d ago
-
Senior-level Full TimeUnited States R3d ago
-
Deep Learning Quality Specialist USD 72K-90KAnnotation Guidelines | Computer Vision | Confluence | Convolutional Neural Networks | Data Annotation401k plan | Commuter benefits | Employee assistance program | Flexible PTO | Fully paid medical/dental/visionMid-level Full TimeSeattle, WA R3d ago
-
Corporate AI Engineer USD 154K-200KAPI Integration | Access Control | Data Quality | Embeddings | Generative AIHybrid work schedule | Volunteer time offMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R3d ago
-
FDE Data Engineer- Space USD 123K-166KABAC | Apache Airflow | Apache Flink | Apache Hudi | Apache IcebergHealth benefits | Remote work | Travel for site workMid-level Full TimeUnited States - Remote R3d ago
-
Senior FDE Data Engineer USD 148K-201KABAC | Airflow | Apache Iceberg | Apache Kafka | Argo WorkflowsCompany paid premiums | Health savings account | Medical/Dental/Vision | Remote work | Travel to classified sitesSenior-level Full TimeUnited States - Remote R3d ago
-
Agile | Amazon RDS | Amazon S3 | Jira | MongoDBPST time zone requirement | Remote workMid-level Full Timeremote, CA R3d ago
-
AI Observability | AWS | Azure | CI/CD | Cost ControlCareer advancement | Fully remote work | Professional development opportunities | Work-life balanceSenior-level Full TimeCanada R3d ago
-
Senior Data Engineer 🇺🇸 USD 160K-200KAWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testingSenior-level Full TimeHybrid (New York, New York, US) R3d ago
-
AWS Data Engineer - Fully Remote - US Only USD 139K-210KAWS Glue | AWS Lambda | AWS Step Functions | Amazon DynamoDB | Amazon RedshiftAbility to work independently | Fully remote | US onlySenior-level Full TimePlano, Texas, United States - Remote R3d ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic Frameworks | Auditability | CI/CD | Cloud Native401-k match | Dental insurance | Expense Reimbursement for Home Office | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R4d ago
-
Senior Analytics Engineer USD 159K-200KAWS | Airflow | DBT | Dagster | Data ObservabilityAutonomy | Fully remote | High-impact work | Use of AI toolsSenior-level Full TimeRemote US R4d ago
-
Senior-level Full TimeSan Jose, United States R4d ago
-
AEP Debugger | AEP Web SDK | Adobe Experience | Adobe Experience Platform | Adobe TagsSenior-level Full TimeLehi, United States R4d ago
-
Lead Data Engineer USD 188K-230KAirflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataDomestic travel up to 5 percent | Relocation not authorized | Remote workSenior-level Full TimeRemote - Minnesota, United States R4d ago