Senior Data Migration Engineer
Tasks
- Assess Informatica workflows
- Contribute to GitLab CI CD pipeline
- Create DBT snapshots
- Create technical documentation
- Develop Python EL pipelines for data landing
- Develop Python unit tests
- Develop dbt transformation models
- Develop dbt unit tests
- Implement dbt incremental materializations
- Implement dbt macros
- Orchestrate pipelines using Airflow DAGs
- Perform peer code reviews
- Reconcile row counts between source and target
- Translate Informatica workflows into Python EL scripts
- Troubleshoot performance issues
- Use SQLAlchemy for database connectivity
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Batch Processing | Bulk Export | CI/CD | Cx Oracle | DBT Core | Data Pump | Data Warehousing | GitLab CI | GitLab CI/CD | Informatica PowerCenter | Oracle | Oracle Data | Oracle Data Pump | Parallelism | Pyodbc | Python | SQL | SQL Server | SQL Server BCP | SQLAlchemy | Unit Testing
Education
N/A
Related jobs
-
GCP Data & Analytics Engineer/Senior Consultant Specialist INR 2000K-3000KAI machine learning | Access Management | Batch Processing | BigQuery | Clickstream analyticsContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R7h ago
-
Mid-level Full TimeIN-AP-Hyderabad7h ago
-
Senior Data Management Professional - Data Rates INR 2800K-4000KAgile | Alerting | Anomaly Detection | CSV | Cause analysisSenior-level Full TimePune7h ago
-
Software Engineer - Data Engineer INR 2617K-3465KAWS | Azure | Data Engineering | Data Governance | Data LakesCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
Associate - Embedded AI & Data Analytics Engineer INR 980K-1141KC++ | Classification | Data Modeling | Data Preprocessing | Data ValidationMid-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
Associate - Agentic AI - Embedded System INR 2000K-2500KCI/CD | Distributed Systems | Edge AI | GPU Utilization | LangchainAccess to cutting edge technologies and tools | Collaborative work environment | In-office 5 days a week | Professional growth and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
Associate - Agentic AI - Data analytics engineer INR 1000K-1820KC++ | Classification | Data Modeling | Data Pipelines | Data PreprocessingAccess to cutting-edge technologies | Collaborative work environment | Professional growth opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
BI Developer (Power BI + Sigma Computing) INR 1500K-2209KAccess Control | CI/CD | Data Governance | Data Model | Data ModelingSenior-level Full TimeGurugram, Haryana, India8h ago
-
Software Engineering INR 1500K-2000KApache Spark | Azure | Azure AKS | Azure Compute | Azure DataOn-call rotationMid-level Full TimeBengaluru, KA, IN9h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4500KAPI Integration | Agent systems | Cloud platform | CrewAI | Generative AISenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Software Engineer III, Full Stack, Cloud AI INR 2000K-3500KAgentic AI | Cloud Computing | Connectivity systems | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
API Testing | Apache JMeter | Automation Framework | Azure | BitbucketEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India9h ago
-
Azure Data Engineer Consultant INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCorporate social responsibility programs | Discounts on products and services | Maternity and paternity leave | Networking opportunities | VIRTUAL interviewMid-level Full TimeBangalore, Karnataka, India9h ago
-
AI/ML | Agentic AI | Apache Airflow | Apache Kafka | CI/CDMid-level Full TimeHyderabad, Telangana, India R9h ago
-
AI Engineer(Python, SQL, and GenAI frameworks ,LLM architecture, RAGs, embeddings, prompt tuning,agentic AI INR 2000K-4000KAWS | Agentic AI | Azure | Containerization | DockerSenior-level Full TimeGurugram, HR, India10h ago
-
Senior ETL Developer, Data Management INR 1500K-2209KAgile | Autosys | Control-M | Data Quality | ETLRotational on-callSenior-level Full TimeBangalore, India11h ago
-
Data Engineering Specialist INR 2000K-3000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Continuous training | Knowledge transfer sessionsSenior-level Full TimeBengaluru, IN, 56010311h ago
-
Software Engineer II INR 1500K-2000KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeBengaluru, KA, IN11h ago
-
Senior AI Engineer INR 2500K-4500KAI Search | API Development | AWS Bedrock | AWS SageMaker | Apache AirflowSenior-level Full TimeHyderabad, TS, India12h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India12h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN12h ago
-
Applied AI ML Associate INR 1000K-1500KAmazon Web Services | Apache Spark | Batch Processing | Caffe | Computer VisionMid-level Full TimeHyderabad, Telangana, India12h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India12h ago
-
Python, Pyspark, GCP Data Engineer INR 2800K-4000KApache Airflow | Apache Spark | Apache Spark SQL | BigQuery | CCPASenior-level Full TimeBangalore, Karnataka, India13h ago
-
Applied AI Engineer INR 1800K-2500KAPI Integration | Access Control | Agent Orchestration | Anthropic API | CrewAIMid-level Full TimeHybrid in Bangalore, India R13h ago