Data Engineer Senior Consultant
Bangalore, KA, IN
R
INR 2400K-3380K (estimate) Senior-level Full Time
Tasks
- Assess Informatica workflows and translate to Python EL and dbt models
- Build dbt tests and Python unit tests
- Contribute to GitLab CI CD for dbt and Airflow
- Create technical documentation and runbooks
- Design dbt transformation models from Informatica mapping logic
- Develop Airflow DAGs to orchestrate EL and dbt
- Develop Python EL pipelines for high volume data loads
- Perform peer code reviews
- Reconcile row counts between source and target systems
- Troubleshoot performance issues and data discrepancies in SIT and UAT
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT Core | Data Pump | GitLab CI | GitLab CI/CD | Informatica PowerCenter | Oracle Data | Oracle Data Pump | Pyodbc | Python | SQL | SQL Server | SQL Server BCP | SQLAlchemy
Education
N/A
Related jobs
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R7h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4580KC++ | Classification | Data Pipelines | Deep learning | EmbeddingsHealth and wellness programs | Time away for employeesSenior-level Full TimeBengaluru, KA, India R8h ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R8h ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R10h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R13h ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R13h ago
-
SW Engineer (1 - 2 years of exp in .Net / Python, Full-stack development, Angular / React, GenAI) INR 1500K-2500K.NET | API Management | Agile | Angular | Azure DevOpsHybrid work schedule | Limited direction working environmentMid-level Full TimeBengaluru, India R14h ago
-
Senior Data Engineer INR 3600K-5000KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFinancial wellness support | Flexible remote work on Fridays | Hybrid work schedule | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R18h ago
-
Senior Software Engineer, MLOps/SRE INR 2475K-3500KAerospike | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD401k pension | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeBengaluru, India R18h ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPI Integration | AWS | Agent Orchestration | Azure | Backend architectureMid-level Full TimeRemote, India R21h ago
-
Principal Engineer, AI Architect INR 2000K-5000KAWS | Agent Orchestration | Azure | Backend architecture | Cloud ComputingSenior-level Full TimeRemote, India R22h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ComplianceSenior-level Full TimeRemote, India R22h ago
-
Senior Staff Engineer ( AI ) INR 2500K-5000KAI orchestration | AWS | Access Control | Agent systems | AuditabilityEnhanced medical benefits | Family wellbeing benefits | Paid time offSenior-level Full TimeHyderabad, India R1d ago
-
Senior Software Engineer - (Backend,AI) INR 3242K-5000KAPI Gateway | AWS | AWS Lambda | Agent Orchestration | Amazon APIFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Wellbeing supportSenior-level Full TimeHyderabad, India R1d ago
-
GCP Data Engineer / Associate Director, Data and Analytics INR 1000K-2000KAgile | Artificial Intelligence | As-a-Service | Automated testing | CI/CDFlexible working | Inclusive work environment | Professional developmentMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Software Engineer, Machine Learning INR 3242K-4580KClassification Models | Data Mining | Deep learning | Distributed Training | Embedding ModelsFlexible work hybrid work arrangementSenior-level Full TimeBengaluru, KA, India R1d ago
-
Databricks SME INR 1500K-2700KAWS | Airflow | Apache Spark | CI/CD | DBTBike to work | Career progression and mentorship | Educational assistance | Employee assistance programme | Fitness classesSenior-level Full TimeMumbai, MH, India R1d ago
-
Software Engineer III, Big Data INR 2040K-3465KApache Flink | Apache Hive | Apache Spark | Cloud Composer | Cloud StorageHybrid workSenior-level Full TimeHyderabad, Telangana 500081, India R1d ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAuthentication | Authorization | CI/CD | Caching | ChunkingFlexible working | Inclusive work culture | Professional developmentSenior-level Full TimePune, Maharashtra, India R1d ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAsync Programming | Authentication | Authorization | CI/CD | CachingFlexible working | Professional development opportunitiesSenior-level Full TimePune, Maharashtra, India R1d ago
-
Senior Data Engineer (with AI/ML experience) India INR 2500K-4500KAWS | Agile | Amazon Redshift | Apache Spark | Azure Machine LearningCompany-supported English classes | Continuous learning | Professional training | Really good hardware | Referral programSenior-level Full TimePune R1d ago
-
AI/ML Engineer INR 1500K-2500KAPIs | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringMid-level Contract Full TimeIndia - Remote R1d ago
-
Backend Software Engineer, AI Platform INR 2000K-3000KAPIs | AWS | Agentic AI | Authentication | Auto ScalingMid-level Full TimeBengaluru R1d ago
-
Address Parsing | Data Modeling | Data Normalization | Data Quality | Data StandardizationCareer growth | Continuous learning | Flexible internship schedule | Mentorship | Professional developmentMid-level Full TimeIndia R1d ago
-
Senior Machine Learning Engineer - Recommendations INR 3242K-5000KA/B | A/B Testing | Airflow | Amazon EMR | Amazon S3Senior-level Full TimeBengaluru, India R1d ago