Manager - Data Engineering
Tasks
- Collaborate with Data Architects Analytics teams and IT stakeholders
- Define and implement data engineering best practices with version control and CI CD
- Design and implement data ingestion and transformation pipelines
- Ensure data governance, privacy, and security compliance
- Implement ETL ELT workflows across enterprise systems
- Lead data lake migration and modernization initiatives
- Monitor cloud resource usage and support cost optimization
- Oversee data quality frameworks validation rules and monitoring
- Own data lake architecture setup and maintenance
- Supervise Data Engineers and provide technical guidance
- Support AI and ML ready data architecture and roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS S3 | Amazon Bedrock | Amazon Redshift | Apache Hadoop | Apache Spark | Automation | Azure Data | Azure Data Factory | Azure Data Lake | Azure OpenAI | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Cost Optimization | Cloud Dataproc | Cost Optimization | Data Engineering | Data Factory | Data Governance | Data Lake | Data Privacy | Data Quality | Data Security | Data Validation | Databricks | Dimensional Modeling | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Dataflow | Google Vertex | Google Vertex AI | Kafka | Metadata Management | Monitoring | Performance Tuning | Power BI | PySpark | Python | REST APIs | Relational modeling | SAP | SQL | Salesforce | Snowflake Schema | Star Schema | Stream Analytics | Synapse Analytics | Version control | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Acceptance criteria | Agent patterns | Auditability | Bias and fairness | Context windowsMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Engineering Analyst II, Gemini and Labs INR 1000K-1500KAdversarial techniques | Automation | Classifier | Data Analysis | Fine TuningHoliday coverage | Rotating on call coverage | Weekend coverageMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Assistant Manager - Technology INR 1500K-3500KChange Management | Cloud Migration | Data Modeling | Erwin | HadoopSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Data Architect- Microsoft Fabrics INR 1500K-2800KAzure | Azure Data | Azure Data Factory | Batch Processing | CDCFast-paced growth environment | High ownership and impact | Work on cutting-edge data platformsSenior-level Full TimeBangalore North, India22h ago
-
Mid-level Full TimeNoida, IN, 20130522h ago
-
Manager, IT Data Engineer INR 1800K-2500KAWS | Agile | Data Modeling | Data Pipelines | Data ProcessingMid-level Full TimeIndia - Bangalore - 5th floor, …22h ago
-
Staff Data Platform Architect INR 1500K-2040KAmazon Web Services | Big Data | Data Lake | Data Warehouse | Data pipelineCareer growth opportunities | Collaborative work environment | Innovation-driven environmentSenior-level Full TimeIndia - Hyderabad - 12th FLOOR, …22h ago
-
AI & Intelligent Applications – Senior Manager INR 2000K-3500KABAC | AKS | AWS | Active Directory | Artificial IntelligenceSenior-level Full TimeIndia - Hyderabad - 12th FLOOR, …22h ago
-
Data Platform Operations Service Manager INR 1500K-2205KAI Platform | Agile | As-a-Service | Azure AI | Azure AI PlatformMid-level Full TimeBengaluru Campus 31, India22h ago
-
Payments Data Lead Engineer INR 3000K-4000KAgile | Automation | CI/CD | Cause analysis | Data EngineeringSenior-level Full TimePune, Gera Commerzone SEZ, India22h ago
-
Senior Manager, Commercial Analytics - CRMA - Life-sciences INR 2516K-3356KCRM Analytics | Conditional Formatting | Dashboard Development | Data Governance | Data ModelingFully remoteSenior-level Full TimeIND - Remote - Bangalore Based … R22h ago
-
Manager Advanced Analytics and Insights (L09) INR 900K-1910KData Governance | Data Mining | Data Visualization | Excel | ForecastingCareer advancement | Employee well-being programs | Flexible work schedule | Upskilling opportunities | Work from homeMid-level Full TimeHyderabad IN, India22h ago
-
Director, Data Engineering Centre of Excellence (CoE) INR 1500K-6000KAWS | Airflow | Azure | CI/CD | DBTComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeM11 - Commers III, 43, 44 … R22h ago
-
Data Product Owner INR 1500K-2146KAgile | Aha! | BigQuery | Cloud Computing | CollibraGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India22h ago
-
AVP, Analytics – Marketing Measurement Consulting (L11) INR 500K-700KAWS | Agile | Data Visualization | Linux | Microsoft ExcelCareer advancement | Flexible work hours | Health and wellness programs | Travel as needed | Upskilling opportunitiesExecutive-level Full TimeHyderabad IN, India22h ago
-
AVP, Analytics - Belk (L10) INR 240K-360KCustomer Segmentation | Data Analysis | Data Mining | Likelihood estimation | Machine LearningCareer advancement | Employee wellness programs | Flexible work hours | Upskilling opportunities | Work from homeExecutive-level Full TimeHyderabad IN, India22h ago
-
Associate Director – Cyber Threat Analytics INR 700K-939KAI Governance | Analytics | Artificial Intelligence | Automation | CybersecurityMid-level Full TimeIND:AP:Hyderabad / Argus Bldg 4f & …22h ago
-
Sr Analyst II Data Engineering INR 1019K-1593KData Analysis | Data Engineering | Data Pipelines | Data Processing | Data QualityFlexible work arrangements | In person collaboration model | Wellbeing supportMid-level Full TimeIN319 - IND Bangalore Electronic City …22h ago
-
Senior Manager, AI Engineering (API & AI Orchestration) INR 3000K-4500KAPI Design | Agentic Workflows | Backend Engineering | Cost Optimization | Distributed SystemsCasual leave | Childcare support | Employee assistance program | Insurance coverage | Life insuranceSenior-level Full TimeIndia22h ago
-
Biostatistical Programming Manager INR 2535K-4225KCDISC ADaM | CDISC SDTM | Clinical data | Clinical trials | DEFINECareer growth opportunities | Diversity and inclusion | Health benefits | Professional development | Work-life balanceSenior-level Full TimeIndia - Hyderabad22h ago
-
Engineering Manager INR 1500K-2500KAgile | Apache Spark | Data Engineering | ODBC | Open SourceFlexible paid time off | Remote team support | Stock grantsMid-level Full TimeIndia1d ago
-
Freelancer GOOGLE CLOUD DATAFLOW DATA PLATFORM ENGINEER INR 2000K-3000KAccess Management | Apache Airflow | Apache Beam | BigQuery | Cloud ComposerTechnical guidanceSenior-level FreelanceBengaluru, KA, India1d ago
-
Data Support Specialist INR 1500K-2000KAWS | AWS CloudWatch | AWS Glue | Azure | Azure Data24x7 production support rotation | DR BCP support | Daily load status reporting | On call incident triageSenior-level Full TimeBengaluru, KA, India1d ago
-
Azure DevOps + Data Lake INR 2125K-3200KAPI Management | Agile | Azure Batch | Azure Data | Azure Data FactorySenior-level Full TimeBengaluru, KA, India1d ago
-
Product Owner – Data & BI Solutions (India) (Remote) INR 1000K-2000KApache Airflow | Azure DevOps | Azure Synapse | CDC | ConfluenceRemote workMid-level Full TimeMaharashtra, Pune, India R1d ago