Manager - Data Engineering
Tasks
- Collaborate with Data Architects Analytics teams and IT stakeholders
- Define and implement data engineering best practices with version control and CI CD
- Design and implement data ingestion and transformation pipelines
- Ensure data governance, privacy, and security compliance
- Implement ETL ELT workflows across enterprise systems
- Lead data lake migration and modernization initiatives
- Monitor cloud resource usage and support cost optimization
- Oversee data quality frameworks validation rules and monitoring
- Own data lake architecture setup and maintenance
- Supervise Data Engineers and provide technical guidance
- Support AI and ML ready data architecture and roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS S3 | Amazon Bedrock | Amazon Redshift | Apache Hadoop | Apache Spark | Automation | Azure Data | Azure Data Factory | Azure Data Lake | Azure OpenAI | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Engineering | Data Factory | Data Governance | Data Lake | Data Privacy | Data Quality | Data Security | Data Validation | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Google Vertex | Google Vertex AI | Kafka | Metadata Management | Monitoring | Performance Tuning | Power BI | PySpark | Python | REST APIs | Relational modeling | SAP | SQL | Salesforce | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics | Version control | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Techno Functional Data & Analytics Lead INR 1500K-2600KAI | AWS | Business Intelligence | Cloud platform | Customer SegmentationHybrid work model | Open to relocationSenior-level Full TimePerungudi, India7h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work modelSenior-level ContractShaikpet, India8h ago
-
Platform & Controls Lead/Associate Director, Data and Analytics INR 1000K-2300KAIOps | APM | Agile | Big Data | CI/CDContinuous professional development | Flexible working | Inclusive work environmentMid-level Full TimePune, Maharashtra, India R9h ago
-
Software Engineer Manager, Dev AI, Core INR 2800K-4763KC++ | CSS | Code review | Full Stack | Full-Stack DevelopmentSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior-level Full TimePune15h ago
-
Manager - Data Governance & Management INR 860K-1300KAgile | Data Classification | Data Governance | Data Management | Data PrivacyMid-level Full TimeGurugram, HR, India17h ago
-
Solution Architect - Data Platform Modernization INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, KA, IN21h ago
-
Director - Data Governance Foundation INR 4000K-4000KChange Management | Data Catalog | Data Governance | Data Lineage | Data ManagementExecutive-level Full TimePLOT NO-1, S.NO. 77, India21h ago
-
Engineering Lead – AI & Developer Platform INR 3000K-5000KAPI Design | AWS | Anthropic | Authentication | CI/CDCertification sponsorship | Education sponsorship | Flexi-leaves | Health insurance | Work from home hybrid optionSenior-level Full TimeMumbai, India21h ago
-
Senior Analytics Manager - VP INR 2817K-5000KChange Management | Customer Segmentation | Data Quality | Data Science | Data WarehousingSenior-level Full TimeGurugram, DLF Downtown, India21h ago
-
Senior-level Full TimeIND Bengaluru, India21h ago
-
Data Engineering Lead Analyst - HOH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Amazon Athena | Amazon Redshift | Amazon S3Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R21h ago
-
Data Engineering Analyst - HIH - Evernorth INR 1000K-1500KAWS | Data Governance | Data Lake | Data Modeling | Data QualityFlex schedule N/A | Remote work flexibilityMid-level Full TimeHIH - Hyderabad, India R21h ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India21h ago
-
Business Analytics Manager INR 800K-1200KAlteryx | CRM Analytics | DBT | Data Engineering | Data GovernanceCareer development and growth | Employee incentive programs | Flexibility and work-life balance | Flexible vacation | Headspace app accessMid-level Full TimeIndia, Hyderabad, Telangana R21h ago
-
AVP, Digital Analytics (L10) INR 600K-2000KAdobe Analytics | Agile | Data Validation | Data Visualization | Data reportingCareer advancement | Flexible work schedule | Upskilling opportunities | Work from homeExecutive-level Full TimeHyderabad IN, India21h ago
-
IN_Associate_Data Analyst_Data and Analytics_Advisory_Hyderabad INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure DevOps PipelinesFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India21h ago
-
Manager, Software Engineering INR 1600K-2500K.NET | Apache Spark | C# | Data Architecture | Data ModelingMid-level Full TimePune, India21h ago
-
Software Engineering Manager INR 1400K-1800KAgile | Behavior-Driven Development | Cloud Cost Management | Cost Management | DebuggingGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India21h ago
-
Associate Manager Data Engineering INR 1019K-1593KApache NiFi | Data Governance | Data Pipelines | Data Warehousing | Distributed SystemsMid-level Full TimeIN319 - IND Bangalore Electronic City …21h ago
-
Director Of Engineering - Java, React, RAG & GenAI INR 1500K-6000KAI Governance | AI Observability | Agile | Azure | Azure OpenAIExecutive-level Full TimeHyderabad, India21h ago
-
Data Product Owner INR 1960K-3000KAgile | Aha! | BigQuery | Cloud | CollibraFlexible work hours | Guided career tracks | Healthcare benefits | Hybrid work | Online learning platformSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India21h ago
-
Manager - Data Scientist (AMVC) INR 1400K-2500KAnomaly Detection | CI/CD | Classification | Clustering | Data PreparationMid-level Full TimeMumbai Central Avenue, India21h ago
-
Entry-level Full Time InternshipPune, India21h ago
-
API Integration | BigQuery | Data Modeling | Data Pipelines | Data StudioMid-level Full TimeBengaluru Millenia, India21h ago