Director, Data Pipeline Engineering
M11 - Commers III, 43, 44 & 45 Fl, Internat'l Business Park, Oberoi Garden City, India
INR 1500K-6000K (estimate) Executive-level Full Time
Tasks
- Architect data pipeline solutions
- Collaborate on engineering backlog prioritization
- Define testing frameworks for pipelines
- Establish code quality standards
- Evaluate data engineering technologies
- Implement CI/CD pipelines
- Improve data pipeline reliability
- Improve data pipeline scalability
- Manage data pipeline engineering team
- Manage outsourcing providers
- Mentor engineers
- Migrate legacy processes to enterprise data platform
- Optimize data pipeline performance
- Provide level 3 production support
- Triage legacy code issues
- Troubleshoot pipeline latency issues
Perks/Benefits
- Flexible time off
- Healthcare benefits
- Hybrid work model
- Retirement plan
- Support for working parents
- Tuition reimbursement
Skills/Tech-stack
AWS | Agile | Airflow | Apache Kafka | Apache Spark | Azure | CI/CD | DBT | Data Engineering | Data Modeling | DataOps | ELT | ETL | Elasticsearch | GCP | Hadoop | Perl | Python | Relational databases | SQL | Snowflake | Sybase
Related jobs
-
Data Engineer Manager INR 1500K-2000KAPI Development | API Integration | API Publishing | AWS | Apache SparkHybrid workMid-level Full TimeBengaluru, INDIA, India6h ago
-
Manager INR 500K-1200KData Management | Data Mapping | Data Migration | Data Privacy | Data QualityMid-level Full TimeGurugram, Haryana, India8h ago
-
Sr Agentic Data Management Advisor INR 1200K-2000KAWS Glue | Advanced SQL | Agentic development | Agentic development tools | AngularSenior-level Full TimeIndia16h ago
-
Mid-level Full TimeIndia - Bangalore18h ago
-
Power Bi Developer - Director- Software Engineering INR 1500K-6000KAI | Automated testing | Copilot | DAX | Data ModelingExecutive-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India18h ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Cost Optimization | AWS Security | AWS complianceFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India18h ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Security | AWS Well Architected | AWS Well-Architected FrameworkSenior-level Full TimeBengaluru Millenia, India18h ago
-
Director, Analytics and Insights INR 1500K-6000KAI-powered BI | Access Control | Analytics | Augmented analytics | BigQueryExecutive-level Full TimeHyderabad, Office Level 3 & 4, …18h ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeIndia - Bangalore18h ago
-
Director, Finance Analytics, AI & Automation USD 166K-265KAccess Controls | Analytics | Artificial Intelligence | Auditability | AutomationDental insurance | Disability insurance | Employee assistance program | Flexible spending account | Flexible vacation and sick leaveExecutive-level Full TimeBEP01 - Embassy Prime, BEP01 (BEP01), …18h ago
-
Data Engineering Lead INR 2500K-3380KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOpsHybrid workSenior-level Full TimeIN025 Embassy Manyata Business Park, India18h ago
-
AI-Ready Data Engineering Team Lead INR 1800K-2647KAI Data | AI data preparation | Amazon Web Services | Cloud Computing | Cloud platformHealth and wellbeing benefits | International work environment | Parental leave | Professional development opportunitiesSenior-level Full TimeHyderabad, India18h ago
-
Data Engineering Manager - Azure INR 1431K-2000KAgile | Automation | Azure | Azure Data | Azure Data FactoryFlexible work environment | Internal mobility | Volunteering support | Work-life balanceSenior-level Full TimeKA Bangalore, India18h ago
-
Power Bi Developer - Director- Software Engineering INR 1500K-6000KAI Copilot | Airflow | Automated testing | DAX | Data QualityExecutive-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India18h ago
-
Adaptive Insights | Automation Anywhere | Financial Modeling | Financial Planning and Analysis | Financial planningClient-facing role | Collaborative team environment | Fast-paced environment | Relocation supportExecutive-level Full TimeGurgaon1d ago
-
Deputy Manager-Data Engineering INR 1500K-2500KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksMid-level Full TimeNoida, UP, India1d ago
-
Senior-level Full TimeBangalore, India1d ago
-
Manager — Fanatic Customer Support Engineering INR 2000K-3500KAPIs | Application Programming | Application Programming Interfaces | Automation | Cloud infrastructureSenior-level Full TimeHyderabad, India1d ago
-
AI Cloud Solution Engineer_Director_Software Engineering INR 1500K-6000KAI Foundry | AWS Bedrock | Amazon SageMaker | Azure AI | Azure AI FoundryExecutive-level Full TimeRMZ Ecoworld Business Park, India2d ago
-
AWS Lambda | Amazon Redshift | Amazon S3 | Apache Airflow | Apache HiveCareer Development Programs | Flexible work schedule | In-office collaborationMid-level Full TimeIndia - Bangalore2d ago
-
Mid-level Full TimeIndia - Bangalore2d ago
-
Senior-level Full TimeBengaluru, Karnataka, India3d ago
-
Consultant _ADF INR 2000K-2000KADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India3d ago
-
Associate Engineering Manager INR 27K-49K.Net Core | .Net Framework | API Development | AWS | AWS CloudFormationMid-level Full TimeBengaluru, KA, IN3d ago
-
Senior Engineering Manager - Datapath INR 2520K-3380KAsynchronous programming | Automated testing | C# | C++ | CI/CDSenior-level Full TimePune, MH, India3d ago