Manager - Data Engineering
Tasks
- Collaborate with Data Architects analytics and IT stakeholders
- Define data engineering best practices
- Design AI and ML ready data architecture
- Design ETL ELT data ingestion pipelines
- Implement data governance privacy and security compliance
- Implement version control and CI/CD
- Integrate data from enterprise systems
- Lead data lake migration and modernization
- Maintain data lake architecture
- Monitor cloud resource usage and optimize costs
- Oversee data quality validation rules and monitoring
- Provide technical guidance and mentorship
- Supervise Data Engineers
- Support data strategy and platform roadmap
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Privacy | Data Quality | Data Security | Data Validation | Data quality monitoring | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Hadoop | Kafka | Metadata Management | Power BI | PySpark | Python | Quality monitoring | REST APIs | Relational Data | Relational Data Modeling | SQL | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics
Education
Related jobs
-
Deputy Manager - Fraud Analytics & Monitoring INR 800K-1250KData Science | Data analytics | Excel | Machine Learning | PythonAnnual health checkup | Dental benefits | Group term life insurance | Inclusive health benefits | Learning and development programMid-level Full TimeGurugram, India10h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R11h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN16h ago
-
Senior Manager - Data Governance & Management INR 2817K-4132KAgile | Automation | Backlog Management | Compliance | Data GovernanceSenior-level Full TimeGurugram, HR, India17h ago
-
Senior Software Engineer – Data Platform (Tech Lead) INR 3000K-4000KAPI Design | Application Programming | Application Programming Interfaces | Automated testing | AzureFlexible working models | Sabbaticals | Training opportunitiesSenior-level Full TimeBengaluru, KA, India18h ago
-
Data Engineer INR 1200K-2500KAcceptance criteria | Business Process | Business Process Mapping | Business glossary | Data ModelingMid-level Full TimeChennai, Tamil Nadu, India18h ago
-
Manager Data Analytics INR 800K-1100KAI enablement | Artificial Intelligence | Automation | CAPA | Dashboard DevelopmentMid-level Full TimeBengaluru Luxor North Tower, India22h ago
-
Lead Data Engineer / Developer - Manager INR 2500K-4064KAWS | Airflow | Autosyss | Azure | CI/CDEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India22h ago
-
Senior Manager - Data Scientist (AMVC) INR 2500K-4400KAI Assistants | Actuarial valuation | Automation | Business Rules | Control OptimizationSenior-level Full TimeMumbai Central Avenue, India22h ago
-
Lead Engineer, Data & AI Engineering INR 1500K-2500KAmazon Redshift | Amazon S3 | Amazon Web Services | DBT | Data ModelingAgile team collaboration | Work from homeSenior-level Full TimeBangalore, India22h ago
-
Business Intelligence | Data Analysis | Data Integrity | Data Modeling | Data QualityFlexible work setting | Hybrid work model | Mentorship | Professional development | Work-life balanceSenior-level Full TimeGurugram 10 C, India22h ago
-
Agile | Automation | Backlog Management | Business Analysis | ConfluenceExecutive-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India22h ago
-
Vice President - Data Architect INR 3000K-4000KData Architecture | Data Dictionary | Data Flow | Data Glossary | Data GovernanceSenior-level Full TimePune, Gera Commerzone SEZ, India22h ago
-
Executive-level Full TimePune, India22h ago
-
Manager, Sofware Engineering, ITC INR 3520K-5500KAPI Development | AWS | Agentic coding | Amazon RDS | Apache AirflowSenior-level Full TimeINDIA TECHNOLOGY CENTER, India22h ago
-
Data Engineering Lead Analyst - HIH - Evernorth INR 1500K-2500KAWS IAM | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon RDSSenior-level Full TimeHIH - Hyderabad, India22h ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India3d ago
-
AI machine learning | Access Management | Analytics operations | Change Management | Cloud DataMid-level Full TimeHyderabad, Telangana, India3d ago
-
Mid-level Full TimeBangalore, India3d ago
-
Mid-level Full TimeIndia3d ago
-
Process Manager INR 500K-1500KDashboard governance | Data Modeling | Data Quality | Data Visualization | ETLMid-level Full TimePune, Maharashtra, India3d ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-3000KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformFlexible working | Inclusive and diverse environment | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R3d ago
-
Manager-GTS SF - Build INR 1500K-2500KAcceptance Testing | Agile | Artificial Intelligence | Automation platforms | ChatGPTMid-level Full TimeHyderabad, Telangana, India3d ago
-
Senior-level Full TimeGurgaon, Haryāna, India3d ago