Manager - Data Engineering
Tasks
- Collaborate with DevOps and SRE on observability and resiliency
- Define AI data pipeline patterns for PII detection and classification
- Design enterprise data platform architecture
- Drive data quality monitoring and alerting
- Enable self service documentation standards and best practices
- Ensure data governance and schema contracts
- Ensure security privacy and governance for AI pipelines
- Guide CI CD automation and Infrastructure as Code
- Lead data platform vision and roadmap
- Manage object storage layouts lifecycle and retention
- Mentor and lead data engineering teams
- Modernize platform for hybrid or public cloud
- Optimize platform performance scalability and cost
- Oversee incident management and root cause analysis
- Own ingestion processing orchestration and storage
- Partner with AI ML teams on data platform AI enablement
- Provide Kubernetes integration oversight
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Kafka | Apache NiFi | Apache Spark | Azure | CI/CD | Ceph | Cloud Migration | Cloud platform | Data Engineering | Data Governance | Data Modeling | Data Monitoring | Data Quality | Data platform | Delta Lake | Distributed Systems | ELK | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | Grafana | Hudi | Iceberg | Infrastructure as Code | Kubernetes | Lakehouse | Minio | Object storage | Observability | Parquet | Prometheus | S3 | Schema evolution | “as-code”
Education
N/A
Related jobs
-
Vice President, Data Analytics INR 4000K-5199KAirflow | Azure | Business Intelligence | CI/CD | DBTExecutive-level Full TimeGurgaon10h ago
-
ESI Central BI 166816 INR 1500K-2500KAWS Redshift | Amazon Web Services | DBT | Data Lakes | Data ModelingSenior-level Full TimeHyderabad, IND-TG, India14h ago
-
Data Engineering Manager INR 1500K-2500KADLS | Access Management | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India19h ago
-
Manager of Software Engineering-Java, Flink,Kafka INR 1500K-2200KAWS | Agile | Amazon EKS | Apache Flink | Apache KafkaMid-level Full TimeHyderabad, Telangana, India20h ago
-
Technical Account Manager – Cloud Backup & Disaster Recovery INR 938K-1408KAPIs | AWS | Azure | Backup and Disaster Recovery | Cloud SecurityMid-level Full TimeBangalore, India22h ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Staff Product Manager - Enterprise Security, IAM & Data Platform INR 3000K-6000KAI/ML | Access Management | Agile | Customer Insight | Data platformSenior-level Full TimeBengaluru, India1d ago
-
Manager, Professional Services INR 700K-2000KAWS | Apache Spark | Azure | Cassandra | Cloud platformAccident Coverage | Annual personal development fund | Business travel insurance | Employee provident fund | Equity awardsMid-level Full TimeRemote - India R1d ago
-
IN_Manager_Product Manager_Data and Analytics_Advisory_Bangalore INR 1000K-2000KAI | APIs | Apache Airflow | Apache Hadoop | Azure DataFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
EY - GDS Consulting - AIA - Gen AI - Manager INR 2000K-3000KAPI Development | AWS | Agent systems | Azure | DistillationCareer development | Inclusive culture | MentorshipMid-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Tech Lead - Architecture Design Job INR 2400K-4000KAI Agents | AWS | Azure | Cloud Architecture | Data EngineeringEthical corporate culture | Flexible work arrangements | Great atmosphere | Inclusive team environment | Open collaborationSenior-level Full TimeHyderabad, IN1d ago
-
Vice President, Stress Testing Execution and Analytics INR 4000K-5199KAlteryx | Automation | CCAR | Data Governance | Data LineageAccident insurance | Best in class leave policy | Childcare assistance reimbursement | Complimentary health screening | Comprehensive hospitalization insuranceExecutive-level Full TimeMumbai Nirlon Know. Pk B7, India1d ago
-
Director - Data Engineering INR 4000K-6000KAWS CloudFormation | AWS Glue | AWS Lambda | AWS S3 | Amazon AthenaHybrid work | Professional development | Remote flexibilityExecutive-level Full TimeGurugram - DLF Building, India R1d ago
-
Assistant Manager - Transformation & Analytics INR 1200K-1800KDAX | Data Automation | Data Ingestion | Data Modeling | ExcelMid-level Full TimeBengaluru, Karnataka1d ago
-
Associate Director, Data Science INR 700K-980KAI workflows | Artificial Intelligence | Content Classification | Data Governance | Data ModelingMid-level Full TimeIND-Pune-Smartworks, India1d ago
-
Senior Manager AI or ML Engineering INR 3000K-5000KAgentic AI | CI/CD | Compliance | Deep learning | Deployment AutomationSenior-level Full TimeGurgaon, Haryana, INDIA; Bengaluru, Karnataka, INDIA; …1d ago
-
Senior Manager, Commercial Analytics - Obesity INR 2500K-5000KAnalytics | Artificial Intelligence | Automation | Compliance | Data EngineeringSenior-level Full TimeIndia - Hyderabad1d ago
-
Senior Manager, Data Enablement - Obesity INR 2500K-5000KAccess Control | Data Dictionary | Data Governance | Data Lineage | Data ModelingSenior-level Full TimeIndia - Hyderabad1d ago
-
Acceptance Testing | Amazon Web Services | Apache Airflow | Apache Hadoop | Automated testingFlexible work programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
IN_Manager_Product Manager_Data and Analytics_Advisory_Bangalore INR 1000K-2000KAI machine learning | APIs | Analytics platform | Apache Airflow | Apache HadoopMid-level Full TimeBengaluru Millenia, India1d ago
-
Lead Assistant Manager INR 2500K-4000KAdvanced Analytics | Artificial Intelligence | Automation | Business Intelligence | C#Senior-level Full TimeIndia1d ago
-
Manager , Fraud Ops Analytics INR 800K-1250KArtificial Intelligence | Data Governance | Data Management | Excel | ForecastingMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Manager - HR Analytics (MIS) INR 1000K-1800KAnalytics | Change Management | Data Governance | Data Visualization | ExcelMid-level Full TimeNoida, Uttar Pradesh1d ago
-
People Analytics Manager INR 945K-1800KAPIs | Cloud Data | Cloud Data Platforms | Dashboard Development | Data GovernanceHybrid workMid-level Full TimeBengaluru, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago