Senior Data Migration Engineer
Tasks
- Assess Informatica workflows
- Contribute to GitLab CI CD pipeline
- Create DBT snapshots
- Create technical documentation
- Develop Python EL pipelines for data landing
- Develop Python unit tests
- Develop dbt transformation models
- Develop dbt unit tests
- Implement dbt incremental materializations
- Implement dbt macros
- Orchestrate pipelines using Airflow DAGs
- Perform peer code reviews
- Reconcile row counts between source and target
- Translate Informatica workflows into Python EL scripts
- Troubleshoot performance issues
- Use SQLAlchemy for database connectivity
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Batch Processing | Bulk Export | CI/CD | Cx Oracle | DBT Core | Data Pump | Data Warehousing | GitLab CI | GitLab CI/CD | Informatica PowerCenter | Oracle | Oracle Data | Oracle Data Pump | Parallelism | Pyodbc | Python | SQL | SQL Server | SQL Server BCP | SQLAlchemy | Unit Testing
Education
N/A
Related jobs
-
Anthropic SDK | Embeddings | Fine Tuning | Git | GitHub ActionsCollaborative values led team | Exposure to global teams and customers | Generous holiday allowance | Hybrid work environment | Individual career developmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India6h ago
-
Mid-level Full TimeMumbai, Maharashtra, India7h ago
-
Senior-level Full TimeMumbai, Maharashtra, India7h ago
-
Generative AI Engineer INR 1800K-3300KAI Studio | AWS SageMaker | Amazon Bedrock | Anthropic API | Azure AIGlobal consulting projects | Leadership trainingMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Development Senior Associate INR 2000K-4500KAmazon Web Services | Artificial Intelligence | CI/CD | Data Analysis | DockerCareer growth opportunities | Certification support | Collaborative work environment | MentorshipSenior-level Full TimeChennai, TN, IN7h ago
-
Lead Data Engineer (OIC+Python) INR 2817K-4064KAPI Management | Apache Airflow | Cloud Composer | Cloud infrastructure | Cloud platformSenior-level Full TimeHyderabad, India8h ago
-
Sr. Software Engineer L4 INR 2500K-4000KAutomation | C plus plus | Cause analysis | Distributed Systems | File systemsSenior-level Full TimePune, MH, India10h ago
-
Lead Data Engineer INR 2000K-3000KApache Kafka | Apache Spark | Automated testing | CI/CD | ConcurrencySenior-level Full TimeBengaluru, KA, India11h ago
-
GenAI Engineer INR 1200K-4500KAI Studio | AKS | App Service | Autogen | AzureCareer growth programs | Flexible work arrangements | Flexible work hours | Generative AI Certifications Support | Remote work optionMid-level Full TimeGurgaon, IN12h ago
-
AI / ML Engineer INR 1200K-2500KAI Agents | Cloud Computing | Deep learning | Generative AI | Machine LearningMid-level Full TimeHyderabad, HDC3B, India14h ago
-
Senior Data Engineer - Python Job INR 2000K-3500KAmazon Web Services | CI/CD | Data Governance | Data Lineage | Data ModelingContinuous learning | Flexible work arrangements | Inclusive team environment | Stable employment | Team knowledge sharingSenior-level Full TimeBangalore, KA, IN14h ago
-
Principal Specialist- Data Science Customer Programs INR 3000K-4000KApache Spark | Data Engineering | Data Governance | Data Lineage | Data ModelingHybrid work environment | UK shift working hoursSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R14h ago
-
Lead Engineer 1 - Embedded Software INR 3000K-4500KAgile | Automated Regression | Automated regression testing | Automated unit testing | C#Relocation assistance providedSenior-level Full TimeHyderabad TS IN 26, India14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Mid-level Full TimeGurgaon, HR, IN, 12200214h ago
-
SEI - Data Migration Engineer (SWP) (Expanded Resources) INR 2400K-3380KApache Airflow | CI/CD | Cx Oracle | DBT Core | Data PumpSenior-level Full TimeBangalore, KA, IN14h ago
-
SEI - Data Migration Engineer (IMS) (Expanded Resources) INR 2520K-3880KApache Airflow | CI/CD | Cx Oracle | DBT | Data PumpSenior-level Full TimeBangalore, KA, IN14h ago
-
Specialist, Data Streaming Platform Engineer INR 2040K-2800KAirflow | Amazon Web Services | Apache Kafka | CI/CD | Confluent CloudDomestic relocation | Hybrid work arrangement | No travel requiredSenior-level Full TimeIND - Telangana - Hyderabad (Gachibowli …14h ago
-
SEI - Data Migration Engineer (IMS) (Expanded Resources) INR 2520K-3880KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT CoreSenior-level Full TimeBangalore, KA, IN14h ago
-
SEI - Data Migration Engineer (SWP) (Expanded Resources) INR 2400K-3380KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBTSenior-level Full TimeBangalore, KA, IN14h ago
-
SEI - Data Migration Engineer (SWP) (Expanded Resources) INR 2400K-3380KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT CoreSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior Specialist - Data Engineering INR 2800K-4000KAgile | Alteryx | Classification | Data Governance | Data MiningSenior-level Full TimeIND-CORP Gurugram-JBS- B2IT SEZ, India14h ago
-
Data Engineer II INR 1000K-2000KAmazon S3 | Apache Kafka | Apache Spark | CDC | CI/CDAutonomy | Inclusive and diverse environment | Learning stipend | Mentorship | Remote environmentMid-level Full TimeIndia - Remote R14h ago