Data Migration Engineer (SWP Workstream)
Tasks
- Build dbt and Python unit tests
- Contribute to GitLab CI CD for dbt and Airflow
- Create technical documentation and runbooks
- Design and implement Python extract load pipelines
- Develop dbt transformation models
- Orchestrate pipelines with Airflow DAGs
- Perform code reviews
- Translate Informatica workflows into Python EL and dbt models
- Troubleshoot data quality and performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT Core | DBT macros | Data Pump | Data Validation | Dbt snapshots | GitLab CI | GitLab CI/CD | Incremental models | Informatica PowerCenter | Oracle Data | Oracle Data Pump | Parallel processing | Pyodbc | Python | SQL | SQL Server | SQL Server BCP | SQL window functions | SQLAlchemy | Test Assertions | Unit Testing | Window Functions
Education
N/A
Related jobs
-
AI Development Strategy Lead INR 2500K-5000KAgent Orchestration | BI frameworks | Business Intelligence | C++ | Cloud DataSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Data and AI Engineer, Google Cloud INR 2000K-3300KAlgorithms | Architectural frameworks | Batch Processing | Cloud platform | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India3h ago
-
Mid-level Full TimeBengaluru, Karnataka, India3h ago
-
Principal Software Engineer INR 2475K-4800KAPI Design | Agent Orchestration | Agentic Systems | Automation | By DesignAgile environment | Feature flags | High autonomy | Inclusive culture | Mentorship and coachingSenior-level Full TimeIndia, Telangana, Hyderabad4h ago
-
Associate Engineer INR 1500K-2500KAnalysis Services | Analysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services TabularMid-level Full TimeHyderabad, IN4h ago
-
Software Engineer III - Data Engineer - Java, Spark, Databricks INR 2000K-3000KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Software Engineer III - Python, PySpark, Databricks, Big Data INR 2000K-2700KAPI Design | AWS Bedrock | Airflow | Amazon Web Services | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Senior Software Engineer - Data Platform INR 2516K-3380KApache Spark | C# | C++ | Data Pipelines | Distributed SystemsSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad5h ago
-
Principal Software Engineer - Data Platform INR 2516K-3380KApache Spark | C# | C++ | Distributed Systems | HadoopSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad5h ago
-
Senior Analyst, Analytics Engineer INR 2771K-4000KApplication Monitoring | DBT | Data Compliance | Data Governance | Data ModelingRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN6h ago
-
IT Solution database engineer INR 1500K-2700KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLSenior-level Full TimeBengaluru, KA, India7h ago
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R7h ago
-
AI Engineer INR 2500K-3700KArtificial Intelligence | Customer Relationship Management | Customer relationship | Data Science | Language ProcessingCareer developmentSenior-level Full TimeNew Delhi, India7h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4580KC++ | Classification | Data Pipelines | Deep learning | EmbeddingsHealth and wellness programs | Time away for employeesSenior-level Full TimeBengaluru, KA, India R8h ago
-
Senior-level Full TimeHyderabad, TS, India8h ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R9h ago
-
Python, Pyspark Developer INR 2800K-4000KAgile | AngularJS | Ansible | Big Data | BootstrapDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeChennai, IN9h ago
-
Mid-level Full TimeIN-Pune9h ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R10h ago
-
AI Agent Builder | AI platforms | Agent Builder | Agent Orchestration | ApexContinuous learning | Follow the sun collaboration | Healthcare mission impact | Inclusive culture | Professional developmentSenior-level Full TimeIndia11h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R13h ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R13h ago
-
Senior computer Scientist INR 1900K-3500KAlgorithms | C++ | CPU Optimization | Continuous integration | Data StructuresSenior-level Full TimeNoida, India R14h ago
-
Mid-level Full TimeKochi, India14h ago
-
SW Engineer (1 - 2 years of exp in .Net / Python, Full-stack development, Angular / React, GenAI) INR 1500K-2500K.NET | API Management | Agile | Angular | Azure DevOpsHybrid work schedule | Limited direction working environmentMid-level Full TimeBengaluru, India R14h ago