Manager - Data Engineering
Tasks
- Collaborate with Data Architects Analytics teams and IT stakeholders
- Define and implement data engineering best practices with version control and CI CD
- Design and implement data ingestion and transformation pipelines
- Ensure data governance, privacy, and security compliance
- Implement ETL ELT workflows across enterprise systems
- Lead data lake migration and modernization initiatives
- Monitor cloud resource usage and support cost optimization
- Oversee data quality frameworks validation rules and monitoring
- Own data lake architecture setup and maintenance
- Supervise Data Engineers and provide technical guidance
- Support AI and ML ready data architecture and roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS S3 | Amazon Bedrock | Amazon Redshift | Apache Hadoop | Apache Spark | Automation | Azure Data | Azure Data Factory | Azure Data Lake | Azure OpenAI | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Engineering | Data Factory | Data Governance | Data Lake | Data Privacy | Data Quality | Data Security | Data Validation | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Google Vertex | Google Vertex AI | Kafka | Metadata Management | Monitoring | Performance Tuning | Power BI | PySpark | Python | REST APIs | Relational modeling | SAP | SQL | Salesforce | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics | Version control | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Deputy Manager - Fraud Analytics & Monitoring INR 800K-1250KData Science | Data analytics | Excel | Machine Learning | PythonAnnual health checkup | Dental benefits | Group term life insurance | Inclusive health benefits | Learning and development programMid-level Full TimeGurugram, India13h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R14h ago
-
Manager - Data Engineering INR 700K-1500KAWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache KafkaCareer growth | Flexible benefits | Health and wellbeing support | Training opportunitiesMid-level Full TimeBengaluru, KA, India14h ago
-
Manager - Data and Analytics INR 700K-2000KCloud Computing | Data Analysis | Data Modeling | Data segmentation | ForecastingContinuous professional development | Flexible workingMid-level Full TimeBangalore, Karnataka, India R17h ago
-
Mid-level Full TimeBangalore, Karnataka, India17h ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN20h ago
-
Senior Manager - Data Governance & Management INR 2817K-4132KAgile | Automation | Backlog Management | Compliance | Data GovernanceSenior-level Full TimeGurugram, HR, India20h ago
-
Senior Software Engineer – Data Platform (Tech Lead) INR 3000K-4000KAPI Design | Application Programming | Application Programming Interfaces | Automated testing | AzureFlexible working models | Sabbaticals | Training opportunitiesSenior-level Full TimeBengaluru, KA, India21h ago
-
Manager Data Analytics INR 800K-1100KAI enablement | Artificial Intelligence | Automation | CAPA | Dashboard DevelopmentMid-level Full TimeBengaluru Luxor North Tower, India1d ago
-
Lead Data Engineer / Developer - Manager INR 2500K-4064KAWS | Airflow | Autosyss | Azure | CI/CDEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Senior Manager - Data Scientist (AMVC) INR 2500K-4400KAI Assistants | Actuarial valuation | Automation | Business Rules | Control OptimizationSenior-level Full TimeMumbai Central Avenue, India1d ago
-
Lead Engineer, Data & AI Engineering INR 1500K-2500KAmazon Redshift | Amazon S3 | Amazon Web Services | DBT | Data ModelingAgile team collaboration | Work from homeSenior-level Full TimeBangalore, India1d ago
-
Business Intelligence | Data Analysis | Data Integrity | Data Modeling | Data QualityFlexible work setting | Hybrid work model | Mentorship | Professional development | Work-life balanceSenior-level Full TimeGurugram 10 C, India1d ago
-
Agile | Automation | Backlog Management | Business Analysis | ConfluenceExecutive-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India1d ago
-
AI Automation & Analytics Program Manager INR 1200K-1680KAgile Scrum | Agile methodology | Artificial Intelligence | Automation | BudgetingMid-level Full TimeBengaluru, Karnātaka, India1d ago
-
Vice President - Data Architect INR 3000K-4000KData Architecture | Data Dictionary | Data Flow | Data Glossary | Data GovernanceSenior-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
Executive-level Full TimePune, India1d ago
-
Manager, Sofware Engineering, ITC INR 3520K-5500KAPI Development | AWS | Agentic coding | Amazon RDS | Apache AirflowSenior-level Full TimeINDIA TECHNOLOGY CENTER, India1d ago
-
Data Engineering Lead Analyst - HIH - Evernorth INR 1500K-2500KAWS IAM | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon RDSSenior-level Full TimeHIH - Hyderabad, India1d ago
-
Data Engineering Consultant INR 2520K-3500KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure SQLSenior-level Full TimePrimary location: Hyderabad, Telangana1d ago
-
Data Engineering Lead - MySQL DBA INR 1500K-2500KAWS RDS | Azure MySQL | Azure MySQL Flexible Server | Backup Management | Cloud SQLSenior-level Full TimePrimary location: Hyderabad, Telangana1d ago
-
Senior Data Engineering Lead - Oracle Exadata DMA, ZDLRA INR 1500K-2700KASM | AWS | Ansible | Azure | Capacity PlanningCareer development opportunities | Comprehensive benefits | Inclusion-focused culture | On-call support | Shift workSenior-level Full TimePrimary location: Bengaluru, Karnataka1d ago
-
Asst Manager Data Governance & Privacy INR 1000K-1800KBig Data | CRM | Cloud Storage | Consent Management | Consumer DataMid-level Full TimeMaharashtra, India1d ago
-
Senior Data Platform Support Engineer -GCP Certified INR 3000K-4000KArtifact Registry | Bash | BigQuery | Cloud Composer | Cloud MonitoringHybrid work | On-call rotaSenior-level Full TimePune, India R1d ago
-
Manager - Data Scientist INR 1400K-2000KBigQuery | Data Fusion | Data Governance | Data Quality | Data ValidationMid-level Full TimeHyderabad, Telangana, India R1d ago