Manager - Data Engineering
Tasks
- Collaborate with Data Architects analytics and IT stakeholders
- Define data engineering best practices
- Design AI and ML ready data architecture
- Design ETL ELT data ingestion pipelines
- Implement data governance privacy and security compliance
- Implement version control and CI/CD
- Integrate data from enterprise systems
- Lead data lake migration and modernization
- Maintain data lake architecture
- Monitor cloud resource usage and optimize costs
- Oversee data quality validation rules and monitoring
- Provide technical guidance and mentorship
- Supervise Data Engineers
- Support data strategy and platform roadmap
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Privacy | Data Quality | Data Security | Data Validation | Data quality monitoring | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Hadoop | Kafka | Metadata Management | Power BI | PySpark | Python | Quality monitoring | REST APIs | Relational Data | Relational Data Modeling | SQL | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics
Education
Related jobs
-
Forward Deployed Engineering Manager, Gen AI, Manufacturing and Conglomerate, Google Cloud INR 2000K-5000KAgent systems | Artificial Intelligence | Artificial Intelligence Production Systems | Cloud Computing | Google CloudSenior-level Full TimeMumbai, Maharashtra, India2h ago
-
Forward Deployed Engineering Manager, GenAI, FSI Google Cloud INR 2000K-5000KAgent systems | Artificial Intelligence | Cloud Computing | Data Sovereignty | Foundation ModelsSenior-level Full TimeMumbai, Maharashtra, India2h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India5h ago
-
Senior Manager, Sales Analytics INR 2771K-4500KData Analysis | Excel | Program Management | Project Management | SQLSenior-level Full TimeBengaluru7h ago
-
Data Analytics Manager INR 2500K-5000KBusiness Intelligence | Cloud | Dashboards | Data Governance | Data ModelingSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior Director, Panel Applications - Data Engineering INR 2520K-3380KAWS | Agile | Azure | Big Data | Cloud ComputingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India8h ago
-
Mid-level Full TimeBangalore, KA, IN, 56010311h ago
-
Mid-level Full TimeKolkata, WB, IN, 70006411h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India13h ago
-
AWS | Cloud platform | Data Pipelines | Data Science | Distributed SystemsEqual opportunity employer | Fast track growth opportunitiesMid-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
Program Manager - Inventory & Analytics INR 1000K-2500KBusiness Intelligence | Cross-Functional Collaboration | Cross-functional | Data Infrastructure | Data ModelingMid-level Full TimeBangalore South, India23h ago
-
Data Lake Product Owner INR 2000K-3000KACID transactions | AWS | Access Control | Agile | Amazon S3Senior-level Full TimePune - Maharashtra - India1d ago
-
Data Science- Manager USD 45KAmazon SageMaker | Apache Spark | Azure Machine Learning | CI/CD | Data PipelinesMid-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Manager,Regional Collections Analytics INR 850K-1250KArtificial Intelligence | Excel | Forecasting | Machine Learning | Predictive AnalyticsMid-level Full TimeBangalore, Karnataka, India R1d ago
-
AWS | Advanced Excel | Agile Development | Apache Hadoop | Apache SparkExecutive-level Full TimeKolkata, West Bengal, India R1d ago
-
Mid-level Full TimeKolkata, West Bengal, India R1d ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R1d ago
-
Assistant Manager INR 1500K-2500KAssociation | Classification | Data Modeling | Data Warehousing | DatabricksMid-level Full TimeIndia1d ago
-
Artificial Intelligence | Artificial Intelligence Governance | Audit management | By Design | Cross Border DataSenior-level Full TimeIndia - Bengaluru1d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
Business Analytics Manager - Dynamic Revenue Plus INR 1610K-2500KA/B | A/B Testing | B testing | Business Analytics | Commercial AnalyticsEmployee resource groups | Hybrid work model | Mental health and wellbeing initiatives | Paid birthday leave | Parental leaveMid-level Full TimePune R1d ago
-
Azure Databricks+ PySpark- Sr Technical Lead-Data Engg INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactorySenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …1d ago
-
Data Analytics Specialist INR 2771K-4200KAPI | Agentic AI | Alteryx | Azure Data | Azure Data FactorySenior-level Full TimeGurgaon, HR, IN, 1220101d ago