Manager - Data Engineering
Tasks
- Collaborate with Data Architects analytics and IT stakeholders
- Define data engineering best practices
- Design AI and ML ready data architecture
- Design ETL ELT data ingestion pipelines
- Implement data governance privacy and security compliance
- Implement version control and CI/CD
- Integrate data from enterprise systems
- Lead data lake migration and modernization
- Maintain data lake architecture
- Monitor cloud resource usage and optimize costs
- Oversee data quality validation rules and monitoring
- Provide technical guidance and mentorship
- Supervise Data Engineers
- Support data strategy and platform roadmap
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Privacy | Data Quality | Data Security | Data Validation | Data quality monitoring | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Hadoop | Kafka | Metadata Management | Power BI | PySpark | Python | Quality monitoring | REST APIs | Relational Data | Relational Data Modeling | SQL | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics
Education
Related jobs
-
Deputy Manager - Fraud Analytics & Monitoring INR 800K-1250KData Science | Data analytics | Excel | Machine Learning | PythonAnnual health checkup | Dental benefits | Group term life insurance | Inclusive health benefits | Learning and development programMid-level Full TimeGurugram, India9h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN15h ago
-
Senior Manager - Data Governance & Management INR 2817K-4132KAgile | Automation | Backlog Management | Compliance | Data GovernanceSenior-level Full TimeGurugram, HR, India15h ago
-
Senior Software Engineer – Data Platform (Tech Lead) INR 3000K-4000KAPI Design | Application Programming | Application Programming Interfaces | Automated testing | AzureFlexible working models | Sabbaticals | Training opportunitiesSenior-level Full TimeBengaluru, KA, India16h ago
-
Data Engineer INR 1200K-2500KAcceptance criteria | Business Process | Business Process Mapping | Business glossary | Data ModelingMid-level Full TimeChennai, Tamil Nadu, India17h ago
-
Manager Data Analytics INR 800K-1100KAI enablement | Artificial Intelligence | Automation | CAPA | Dashboard DevelopmentMid-level Full TimeBengaluru Luxor North Tower, India21h ago
-
Lead Data Engineer / Developer - Manager INR 2500K-4064KAWS | Airflow | Autosyss | Azure | CI/CDEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India21h ago
-
Senior Manager - Data Scientist (AMVC) INR 2500K-4400KAI Assistants | Actuarial valuation | Automation | Business Rules | Control OptimizationSenior-level Full TimeMumbai Central Avenue, India21h ago
-
Lead Engineer, Data & AI Engineering INR 1500K-2500KAmazon Redshift | Amazon S3 | Amazon Web Services | DBT | Data ModelingAgile team collaboration | Work from homeSenior-level Full TimeBangalore, India21h ago
-
Business Intelligence | Data Analysis | Data Integrity | Data Modeling | Data QualityFlexible work setting | Hybrid work model | Mentorship | Professional development | Work-life balanceSenior-level Full TimeGurugram 10 C, India21h ago
-
Agile | Automation | Backlog Management | Business Analysis | ConfluenceExecutive-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India21h ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India3d ago
-
AI machine learning | Access Management | Analytics operations | Change Management | Cloud DataMid-level Full TimeHyderabad, Telangana, India3d ago
-
Mid-level Full TimeBangalore, India3d ago
-
Mid-level Full TimeIndia3d ago
-
Process Manager INR 500K-1500KDashboard governance | Data Modeling | Data Quality | Data Visualization | ETLMid-level Full TimePune, Maharashtra, India3d ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-3000KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformFlexible working | Inclusive and diverse environment | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R3d ago
-
Manager-GTS SF - Build INR 1500K-2500KAcceptance Testing | Agile | Artificial Intelligence | Automation platforms | ChatGPTMid-level Full TimeHyderabad, Telangana, India3d ago
-
Senior-level Full TimeGurgaon, Haryāna, India3d ago
-
Senior-level Full TimeBangalore, Karnātaka, India3d ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | High responsibilityMid-level Full TimeBangalore, Karnātaka, India3d ago
-
Tech S and T-AI Product Manager-NGTO-RT-GDSF02 INR 2000K-4000KAPI | Agile | Amazon Web Services | Analytics | AzureMid-level Full TimeNoida, UP, IN, 2013013d ago
-
Manager, Enterprise Data & Analytics Products INR 3000K-4000KAI machine learning | Agile | Analytics engineering | Azure | Cloud ComputingHybrid work | Learning and development opportunities | Onsite work | Paid Company Holidays | Paid vacationSenior-level Full TimeIN025 Embassy Manyata Business Park, India3d ago
-
Senior-level Full TimeIndia GCC-Puppalaguda Village3d ago