Manager - Data Engineering
Tasks
- Collaborate with Data Architects analytics and IT stakeholders
- Define data engineering best practices
- Design AI and ML ready data architecture
- Design ETL ELT data ingestion pipelines
- Implement data governance privacy and security compliance
- Implement version control and CI/CD
- Integrate data from enterprise systems
- Lead data lake migration and modernization
- Maintain data lake architecture
- Monitor cloud resource usage and optimize costs
- Oversee data quality validation rules and monitoring
- Provide technical guidance and mentorship
- Supervise Data Engineers
- Support data strategy and platform roadmap
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Privacy | Data Quality | Data Security | Data Validation | Data quality monitoring | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Hadoop | Kafka | Metadata Management | Power BI | PySpark | Python | Quality monitoring | REST APIs | Relational Data | Relational Data Modeling | SQL | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics
Education
Related jobs
-
Data Visualization & Advanced Analytics - Associate INR 1000K-2000KAgile | Alteryx | Data Cleansing | Data Governance | Data QualityMid-level Full TimeMumbai, Maharashtra, India5h ago
-
Forward Deployed Engineering Manager, Gen AI, Manufacturing and Conglomerate, Google Cloud INR 2000K-5000KAgent systems | Artificial Intelligence | Artificial Intelligence Production Systems | Cloud Computing | Google CloudSenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Forward Deployed Engineering Manager, GenAI, FSI Google Cloud INR 2000K-5000KAgent systems | Artificial Intelligence | Cloud Computing | Data Sovereignty | Foundation ModelsSenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Product Manager INR 1800K-3300KAWS SageMaker | Agile | Azure Machine Learning | Confluence | Google CloudHybrid workMid-level Full TimeChennai, Tamil Nadu, India8h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India9h ago
-
Senior Manager, Sales Analytics INR 2771K-4500KData Analysis | Excel | Program Management | Project Management | SQLSenior-level Full TimeBengaluru10h ago
-
Data Analytics Manager INR 2500K-5000KBusiness Intelligence | Cloud | Dashboards | Data Governance | Data ModelingSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior Director, Panel Applications - Data Engineering INR 2520K-3380KAWS | Agile | Azure | Big Data | Cloud ComputingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India12h ago
-
Gen AI Lead Developer INR 2500K-5000KAI Governance | Access rules | Computer Vision | DAMA | Data CatalogingSenior-level Full TimeIndia12h ago
-
Mid-level Full TimeBangalore, KA, IN, 56010315h ago
-
Mid-level Full TimeKolkata, WB, IN, 70006415h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India17h ago
-
AWS | Cloud platform | Data Pipelines | Data Science | Distributed SystemsEqual opportunity employer | Fast track growth opportunitiesMid-level Full TimeHyderabad - Phoenix Equinox Tower 2, …17h ago
-
Associate Engagement Manager INR 1500K-2525KAI Governance | AWS | Agentic AI | Agile | Artificial IntelligenceMid-level Full TimeIN KA Bengaluru, India17h ago
-
Senior-level Full TimeHyderabad (Office), India17h ago
-
Senior Operations Manager INR 2500K-3500KActive Directory | Bash | Bios Updates | CUDA | CUDA StacksSenior-level Full TimeHyderabad (Office), India17h ago
-
Germany-DA-Assistant Manager-BLR INR 2000K-3000K.Net 8 | API Management | ARM Templates | ASP.NET Web | ASP.NET Web APISenior-level Full TimeBangalore, Karnataka, India1d ago
-
Program Manager - Inventory & Analytics INR 1000K-2500KBusiness Intelligence | Cross-Functional Collaboration | Cross-functional | Data Infrastructure | Data ModelingMid-level Full TimeBangalore South, India1d ago
-
Data Lake Product Owner INR 2000K-3000KACID transactions | AWS | Access Control | Agile | Amazon S3Senior-level Full TimePune - Maharashtra - India1d ago
-
Software Engineering Manager (AI-native development) INR 2500K-4580KAI | Accessibility | Architecture Design | Artificial Intelligence | Automated testingCoaching | Employee growth opportunities | Inclusive culture | Talent developmentSenior-level Full TimeIndia1d ago
-
Data Science- Manager USD 45KAmazon SageMaker | Apache Spark | Azure Machine Learning | CI/CD | Data PipelinesMid-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Manager,Regional Collections Analytics INR 850K-1250KArtificial Intelligence | Excel | Forecasting | Machine Learning | Predictive AnalyticsMid-level Full TimeBangalore, Karnataka, India R1d ago
-
AWS | Advanced Excel | Agile Development | Apache Hadoop | Apache SparkExecutive-level Full TimeKolkata, West Bengal, India R1d ago