Senior Data Migration Engineer
Tasks
- Build dbt native tests and Python unit tests
- Contribute to GitLab CI CD pipeline for dbt and Airflow
- Convert Informatica workflows to Python EL scripts
- Create technical documentation runbooks and handover materials
- Develop Python extract load pipelines for high volume data
- Develop dbt transformation models from Informatica mapping logic
- Implement dbt macros model layering incremental strategies and snapshots
- Land data into target warehouse using SQLAlchemy
- Orchestrate pipelines with Airflow DAGs
- Perform peer code reviews
- Reconcile row counts between source and target systems
- Troubleshoot performance issues and data discrepancies
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT | Data Pump | Data Quality | ETL | GitLab CI | GitLab CI/CD | Informatica PowerCenter | Oracle Data | Oracle Data Pump | Pyodbc | Python | SQL | SQL Server | SQL Server BCP | SQLAlchemy | Unit Testing
Education
N/A
Related jobs
-
Data Engineering Specialist INR 2000K-3000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Continuous training | Knowledge transfer sessionsSenior-level Full TimeBengaluru, IN, 5601032h ago
-
Data Analytics Professional INR 2500K-4000KAI Algorithms | Automation | Business Intelligence | Data Analysis | Data IntegrityEntry-level Full TimeBengaluru, IN, 5601032h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN3h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India4h ago
-
Applied AI Engineer INR 1800K-2500KAPI Integration | Access Control | Agent Orchestration | Anthropic API | CrewAIMid-level Full TimeHybrid in Bangalore, India R4h ago
-
Sr. Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Services | CI/CD | Data IngestionSenior-level Full TimePune, Maharashtra, India5h ago
-
Data Engineer -Azure Modern Data Platform INR 3000K-3500KAnalysis Services | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseSenior-level Full TimePune, MH, India6h ago
-
Senior Expert INR 2829K-3380KAWS | Algorithms | Azure | Cloud Computing | Data CleansingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India6h ago
-
Software Engineer II INR 2000K-2500KAWS EC2 | AWS RDS | AWS S3 | CI/CD | Data StructuresCross-functional team projects | Learning campus coursesMid-level Full TimeMumbai, India7h ago
-
Staff Data Engineer INR 2755K-4000KAWS | Apache Kafka | Apache Spark | Azure | CI/CDCell phone reimbursement | Healthcare | Internet reimbursement | Learning and development stipend | Travel opportunitiesSenior-level Full TimeBengaluru, India8h ago
-
Senior Software Engineer, Machine Learning INR 2516K-3465KA/B | A/B Testing | AIOps | B testing | CPPFinancial wellness support | Healthcare | Mental health support | Remote work flexibility | Retirement plansSenior-level Full TimeBengaluru, India11h ago
-
Mid-level Full TimePune, IN11h ago
-
AWS/Airflow Engineer INR 1500K-2400KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsOn-call rotationEntry-level Full TimeBengaluru, KA, IN11h ago
-
Senior-level Full TimeBengaluru, KA, IN, 56001611h ago
-
CI/CD | Caching | Clustering | DBT | Data LakesFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India11h ago
-
IN-Senior Associate_AI Engineer_Data Analytics_Advisory_Mumbai INR 2000K-4500KA/B | A/B Testing | B testing | CI/CD | CloudFormationSenior-level Full TimeMumbai Goregaon, India11h ago
-
API | Agents | Apache Airflow | Apache Hadoop | Azure DataSenior-level Full TimeKolkata DN 57, India11h ago
-
Amazon Bedrock | Amazon SageMaker | Anthropic API | Azure Machine Learning | Azure OpenAIFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India11h ago
-
.NET | .Net Core | API Management | ARM | ASP.NET MVCMid-level Full TimeBengaluru Millenia, India11h ago
-
GenAI Contractor INR 360K-420KAPI Development | Data Pipelines | Evaluation | Language Models | Large Language ModelsEntry-level ContractBengaluru, India18h ago
-
Mid-level Full TimeGreater Noida, India19h ago
-
Engineer - Embedded Software (System Engineer) INR 1000K-1000KAgile | C# | C++ | IoT | LinuxOn-site work model | Work flexibilityMid-level Full TimeBangalore21h ago
-
Software Test Engineer (Python, Pyspark, SQL) INR 1000K-1500KAPI Testing | Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India22h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago
-
Senior Tech Lead INR 2000K-4800K.NET | AKS | ASP.Net Core | Application Insights | Asynchronous programmingSenior-level Full TimeIN-AP-Hyderabad22h ago