Manager - Data Engineering
Tasks
- Build ETL/ELT workflows
- Collaborate with data architects and analytics teams
- Define data engineering best practices
- Design AI and ML ready data architecture
- Design data ingestion pipelines
- Develop data strategy and platform roadmap
- Ensure data governance, privacy, and security compliance
- Implement data transformation pipelines
- Implement validation rules and monitoring
- Implement version control CI CD performance tuning automation
- Integrate data from SAP and Salesforce
- Maintain and optimize Data Lake
- Maintain system performance and reliability
- Monitor data platform resource usage
- Oversee data lake migration and modernization
- Oversee data quality frameworks
- Own data lake architecture
- Provide technical guidance and mentorship
- Supervise data engineering team
- Support cloud cost optimization
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Automation | Azure | Azure Data | Azure Data Factory | BigQuery | CI/CD | Cloud Cost Optimization | Cost Optimization | Data Factory | Data Governance | Data Lakehouse | Data Modeling | Data Monitoring | Data Privacy | Data Quality | Data Security | Data Validation | Databricks | Dataflow | Dataproc | Dimensional Modeling | ELT | EMR | ETL | Event Hubs | GCP | Glue | Hadoop | Kafka | Metadata Management | Performance Tuning | Power BI | PySpark | Python | REST APIs | Redshift | Relational modeling | S3 | SQL | Snowflake Schema | Spark | Star Schema | Stream Analytics | Synapse | Version control
Education
Related jobs
-
Senior Manager - Data Governance INR 2500K-5000KAudit management | Critical Data Elements | Data Classification | Data Elements | Data GovernanceAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development frameworkSenior-level Full TimeChennai, India5h ago
-
Software Engineering Manager II, Google Cloud INR 3000K-6000KC# | C++ | Code review | Java | JavaScriptSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Assistant Vice President - Program Delivery INR 4000K-5199KCollibra | Databricks | ETL | Hadoop | Power BIAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development frameworkExecutive-level Full TimeGurugram, India8h ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India9h ago
-
Senior Manager - Data Infrastructure INR 2000K-4000KApache Hadoop | Apache Hive | Apache Kafka | Apache Pig | Apache SparkAnnual health checkup | Dental benefits | Group term life insurance | Inclusive health benefits | Learning and development programSenior-level Full TimeGurugram, India12h ago
-
Lead Data Scientist INR 2520K-3500KA/B | A/B Testing | AWS | Agentic AI | Applied AIEmployee assistance program | Medical insurance | Paid time off | Parental leave | Professional developmentSenior-level Full TimeGurgaon - Cyber Park, India17h ago
-
EY - GDS Consulting - AIA - Gen AI - Manager INR 1850K-3000KAWS | AWS Bedrock | Agentic AI | Agile | AzureContinuous learning | Diverse and inclusive culture | Transformative leadershipMid-level Full TimeChennai, TN, IN, 60003217h ago
-
EY - GDS Consulting - AIA - Gen AI - Senior Manager INR 2000K-3500KAWS Bedrock | AgentOps | Amazon Web Services | Azure | Azure DevOpsSenior-level Full TimeChennai, TN, IN, 60003217h ago
-
Artificial Intelligence Lead - Airbus India Innovation Centre INR 2500K-4800KAmazon SageMaker | Anomaly Detection | Computer Vision | Data Analysis | Language ModelsFlexible working arrangements | Inclusive work environmentSenior-level Full TimeBangalore (Airbus), India17h ago
-
IJP - Senior Manager - Data Science INR 2800K-4000KAPI | AWS | Apache Spark | Azure | Cloud DataHybrid work | Inclusive culture | Professional development | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R17h ago
-
Lead Software Engineer, ITC INR 3000K-4800KAPI Gateway | AWS Lambda | Agile | Amazon API | Amazon API GatewaySenior-level Full TimeINDIA TECHNOLOGY CENTER, India17h ago
-
Senior-level Full TimeINDIA TECHNOLOGY CENTER, India17h ago
-
Solutions Architect - Data Engineering INR 3000K-3880KAWS | AWS Data | AWS Data Migration | AWS Data Migration Services | AWS Managed AirflowFlexible distributed work | Ownership and accountability | Professional mentorship | Remote-first cultureSenior-level Full TimeIndia - Remote R1d ago
-
ETL Tester INR 1500K-2500KData Mapping | Data Quality | Data Reconciliation | Data Transformation | Data WarehouseSenior-level Full TimeChennai, India1d ago
-
Data Engineering Manager INR 1800K-2700KAWS | AWS Glue | AWS Step Functions | Access Control | AgileMid-level Full TimeMumbai, India1d ago
-
Manager IT - ED&A INR 3264K-5000KBig Data | Cloud infrastructure | Data Catalog | Data Governance | Data LineageSenior-level Full TimeHyderabad, India1d ago
-
Mid-level Full TimeMumbai, India1d ago
-
Data Bricks Infra Engineer INR 1500K-2500KAccess Control | Caching | Data Governance | Databricks | Databricks SQLWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Data Scientist INR 120K-180KClustering | Data Analysis | Data Pipelines | Deep learning | Event DrivenEntry-level Full TimeBengaluru, KA, India1d ago
-
SW Engineering Manager INR 700K-1000KAPI Gateway | AWS CloudFormation | AWS Glue | AWS Kinesis | AWS LambdaMid-level Full TimePune, Maharashtra, India1d ago
-
Lead Data Engineer – Python & GCP INR 1500K-2500KAirflow | Apache Airflow | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad1d ago
-
Software Development Lead INR 1500K-2700KAPIs | Agile | BigQuery | Continuous Delivery | Continuous integrationSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
AWS Glue | Amazon Kinesis | Anomaly Detection | CI/CD | DBTSenior-level Full TimePune, Maharashtra, India1d ago
-
AWS | Autogen | Azure | CI/CD | Cloud platformCareer growth | Leadership ownership | Remote-first | Work flexibilitySenior-level Full TimeIndia1d ago