Data Engineering Associate Director
Tasks
- Architect scalable cost efficient pipelines
- Assess legacy ETL job lineage dependencies and data quality
- Coordinate QA validation and reconciliation
- Define migration patterns reusable frameworks and coding standards
- Drive Databricks PySpark Spark SQL and Delta Live Tables implementation
- Ensure data quality SLA and observability requirements
- Implement data governance lineage tracking Unity Catalog access control
- Lead pod of data engineers with mentorship code reviews and unblocking
- Manage sprint planning backlog refinement and milestone tracking
- Own ETL modernization migration to Databricks Lakehouse
- Produce and maintain architecture documentation runbooks and migration playbooks
- Provide primary technical point of contact for client workstream
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Redshift | Amazon CloudWatch | Amazon Kinesis | Amazon S3 | Apache Spark | CI/CD | Databricks | Delta Lake | Git | Informatica PowerCenter | Informatica PowerCenter transformations | PySpark | SQL | Spark SQL | Unit Testing | Unity Catalog
Education
N/A
Related jobs
-
Engineering Manager – Fullstack & AI Engineering INR 1800K-3000KAI Observability | API Design | AWS | Angular | AzureMid-level Full TimeMaharashtra, Pune, India9h ago
-
Data Architect INR 1500K-2500KBatch Processing | CI/CD | Cluster management | Cost Optimization | Data EngineeringSenior-level Full TimeCoimbatore, India9h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
Manager, YouTube Data Engineering INR 2520K-3880KAgile | Business Intelligence | Data Modeling | Data Pipelines | Dimensional ModelingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Product Data Scientist Manager, Play Monetization INR 2000K-3000KA/B | A/B Testing | B testing | Classification | Data InfrastructureSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Mgr, Data Science INR 1000K-2500KAI machine learning | Advanced Analytics | Agile | Apache Spark | AutomationSenior-level Full TimeIN-Bangalore (3811)11h ago
-
Gen AI Developer Specialist INR 1800K-3000KA2A protocol | AI Governance | AWS Bedrock | Agent patterns | AutogenMid-level Full TimeIndia11h ago
-
Consultant INR 1500K-2000KAlert automation | Dashboard automation | Data Dictionary | Data Mapping | Data QualityMid-level Full TimeIndia13h ago
-
Manager - Data Analyst INR 500K-1500KAWS | Azure | Data Analysis | Data Transformation | Data cleaningMid-level Full TimeBangalore, Karnataka, India15h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-4500KAI Foundry | Agent Builder | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India16h ago
-
Mid-level Full TimeTamil Nadu, India17h ago
-
Databricks Assistant Manager INR 1000K-2000KApache Spark | Data Modeling | Data Pipelines | Data Warehousing | DatabricksMid-level Full TimeBangalore, Karnataka, India18h ago
-
Sr Technical Lead-Data Engg INR 1500K-2040KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeINDIA - HYDERABAD - BIRLASOFT OFFICE, …22h ago
-
Associate Project Manager INR 1000K-2000KAgile | Asana | Business Intelligence | Data Engineering | Data WarehousingHybrid workMid-level Full TimeMumbai, India22h ago
-
Solution Architect - Data Engineer INR 1500K-2400KAWS | Apache Spark | CI/CD | Data Governance | Data LakehouseSenior-level Full TimePune, India22h ago
-
GenAI Apps Development Sr Manager-Vice President INR 2000K-3500KAIOps | API Development | Agile | CI/CD | Cloud ArchitectureSenior-level Full TimePLOT NO-1, S.NO. 77, India22h ago
-
Senior-level Full TimePune, India22h ago
-
Data Engineer INR 1500K-2400KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeEmbassy Manyata Tech Park (IN-ME), India22h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Functions | Azure OpenAIFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India22h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Functions | Branch ProtectionsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing support | Work-life balance programsSenior-level Full TimeBengaluru Millenia, India22h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Functions | CI/CDFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India22h ago
-
Data Information Management Senior Manager- SAS, SQL, Python INR 2000K-2800KAutomation Testing | Data Driven Testing | Data Modeling | Data analytics | Data-drivenSenior-level Full TimeDLF CYBERCITY 12B, India22h ago
-
Senior Manager, Advanced Data Analytics and Insights INR 1960K-2800KAnomaly Detection | Card Fraud | Dashboards | Data Visualization | Fraud DetectionSenior-level Full TimeBlock 1 DT, Chennai India22h ago
-
AI Platform Architect INR 2200K-4500KAI Foundry | AI ethics | API Integration | Agent Orchestration | Agentic AICollaborative culture | Hybrid working setup | Professional growth opportunitiesSenior-level Full TimeIND - Pune, India22h ago