Databricks Migration Engineer – Hybrid- Laurel, MD
Tasks
- Assess Informatica PowerCenter assets
- Build CI/CD pipelines with Azure DevOps
- Build Synapse pipelines and orchestration
- Configure Azure security components
- Configure monitoring dashboards and alerts
- Create architecture documentation and runbooks
- Design Azure Databricks and Synapse solutions
- Develop Databricks notebooks and jobs
- Develop migration roadmaps
- Execute unit integration regression and performance testing
- Implement ETL logging monitoring and error handling
- Integrate Azure with Oracle SQL Server APIs and GIS
- Migrate Informatica workflows and mappings
- Optimize ETL performance
- Provide training and knowledge transfer
- Support deployment cutover and rollback
- Validate data quality and reconciliation
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage | Data Quality | Data Reconciliation | ELT | ETL | Entra ID | Error Handling | Informatica PowerCenter | Key Vault | Logging | Managed Identities | Microsoft Entra | Microsoft Entra ID | Monitoring | Oracle | Orchestration | Parallel processing | Partitioning | Query Optimization | RBAC | SQL | SQL Server | Service principals | Source Control | Synapse Analytics | Testing
Education
N/A
Related jobs
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R6h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R11h ago
-
Associate AI Engineer USD 144K-180K.NET | APIs | ASPNet | AWS | Azure401k matching | Dental insurance | Hybrid work model | Medical insurance | Paid time offMid-level Full TimeIrving, TX R12h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R13h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Curation401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States; Remote U.S. R15h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Drift401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Remote U.S. R15h ago
-
IT Data Engineer USD 60K-65KANSI X12 | AWS | Azure | Azure Data | Azure Data Factory401k retirement plan | Disability coverage | Employee assistance program | Flexible spending account | Medical/Dental/Vision insuranceMid-level Full TimeUS - Remote R18h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic AI | Auditability | CI/CD | Cloud platform401k | Dental insurance | Expense reimbursement for internet costs | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R18h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAgent systems | Computer Vision | Data Quality | Data quality monitoring | Deep learningMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer, Global Operations USD 107K-143KArtificial Intelligence | ETL | Langchain | Machine Learning | PythonContinuous learning | Flexible work options | Health, wellness, and retirement plans | Professional growth opportunitiesMid-level Full TimeCalifornia - Remote, United States R1d ago
-
AWS | Access Control | Apache Spark | Azure | CI/CD401k retirement plan | Comprehensive benefits | Dental insurance | Employee assistance program | Medical insuranceSenior-level Full TimeUSA, TX, Work-at-Home, United States R1d ago
-
Associate Director, Data Science USD 160K-297KADME | Bioinformatics | Data Analysis | Data Governance | Data Mining401k match | Hybrid work | Paid time offMid-level Full TimeCambridge (USA), United States R1d ago
-
Mid-level Full TimeUnited States Remote, United States R1d ago
-
Comm Ops Data Engineer - Shockwave Medical USD 79K-147KData Governance | Data Modeling | Data Pipelines | Data Quality | Data SecurityFully remoteMid-level Full TimeUS358 CA Santa Clara - 5403 … R1d ago
-
Senior-level Full TimeCanada R3d ago
-
Senior-level Full TimeUnited States R3d ago
-
Senior-level Full TimeUnited States R3d ago
-
Deep Learning Quality Specialist USD 72K-90KAnnotation Guidelines | Computer Vision | Confluence | Convolutional Neural Networks | Data Annotation401k plan | Commuter benefits | Employee assistance program | Flexible PTO | Fully paid medical/dental/visionMid-level Full TimeSeattle, WA R3d ago
-
Corporate AI Engineer USD 154K-200KAPI Integration | Access Control | Data Quality | Embeddings | Generative AIHybrid work schedule | Volunteer time offMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R3d ago
-
FDE Data Engineer- Space USD 123K-166KABAC | Apache Airflow | Apache Flink | Apache Hudi | Apache IcebergHealth benefits | Remote work | Travel for site workMid-level Full TimeUnited States - Remote R3d ago
-
Senior FDE Data Engineer USD 148K-201KABAC | Airflow | Apache Iceberg | Apache Kafka | Argo WorkflowsCompany paid premiums | Health savings account | Medical/Dental/Vision | Remote work | Travel to classified sitesSenior-level Full TimeUnited States - Remote R3d ago
-
Agile | Amazon RDS | Amazon S3 | Jira | MongoDBPST time zone requirement | Remote workMid-level Full Timeremote, CA R3d ago
-
AI Observability | AWS | Azure | CI/CD | Cost ControlCareer advancement | Fully remote work | Professional development opportunities | Work-life balanceSenior-level Full TimeCanada R3d ago
-
Senior Data Engineer 🇺🇸 USD 160K-200KAWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testingSenior-level Full TimeHybrid (New York, New York, US) R3d ago