Associate Director - Data Engineering
INR 1340K-2205K (estimate) Mid-level Full Time
Tasks
- Align data platforms with data governance canonical models and domain driven design
- Architect and implement data lake and lakehouse solutions on AWS
- Build feature engineering data pipelines for AI ML workflows
- Contribute to pipeline development performance tuning and troubleshooting
- Design build and optimize batch and real time data pipelines
- Ensure data platform reliability accuracy consistency and low latency
- Establish data engineering best practices coding standards and reusable frameworks
- Evaluate and adopt emerging big data cloud and streaming technologies
- Implement batch ingestion streaming ingestion with Kafka and CDC
- Implement data integration patterns for scalable ingestion
- Implement distributed processing with Spark or Flink
- Lead data engineering teams
- Monitor platform reliability using observability alerting and issue resolution
- Optimize data platform performance and cloud cost
- Orchestrate pipelines with Airflow Step Functions or workflow engines
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | AWS Lambda | AWS S3 | AWS Step Functions | Access Control | Agile | Airflow | Alerting | Amazon CloudWatch | Amazon EC2 | Amazon EMR | Amazon Redshift | Amazon VPC | Apache Flink | Apache Hadoop | Apache Spark | CI/CD | Canonical Data | Canonical Data Models | Change Data Capture | Containers | Data Capture | Data Governance | Data Lineage | Data Modeling | Data Warehousing | Data models | Databricks | DevOps | Dimensional Modeling | Docker | ELT | ETL | Infrastructure as Code | Java | Kafka | Kubernetes | Microservices | Normalized modeling | Observability | PII | Python | Route 53 | SQL | Scala | Step Functions | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
AM CPAM - Digital and Data Analytics INR 3000K-4000KAnomaly Detection | Azure | Change Management | DAX | Dashboard DesignSenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Azure Data | Azure Data Factory | Azure Databricks | Azure Purview | Azure SynapseSenior-level Full TimeBangalore, Karnataka, India16h ago
-
Data Quality Assurance Manager INR 500K-1050KAnalytics | Bash | Data Pipelines | Data Quality | Data ValidationWork-life balanceMid-level Full TimeKarnataka, Bengaluru, India20h ago
-
Credit Risk | Credit Risk Analysis | Data Analysis | Data Transformation | ForecastingSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Strategic Analytics - Vice President INR 3300K-4000KAI machine learning | Apache Spark | Data Governance | Data Product Management | Data QualityExecutive-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior Manager, T&S Analytics (8+ years) INR 1890K-2800KAnomaly Detection | Apache Spark | Behavioral segmentation | Cohort Analysis | Customer profilingAccidental insurance | Adoption assistance program | Car lease | Critical illness insurance | Day-care Support ProgramSenior-level Full TimeBengaluru20h ago
-
Senior Manager, Commercial, GBS Process & Analytics Services INR 2486K-3250KAgile | BPM | Decision Intelligence | Intelligent Automation | Machine LearningFlexible work arrangementSenior-level Full TimeIndia - Bangalore1d ago
-
Lead Specialist - Data Analytics & Insight INR 3000K-4000KAWS | Azure | Cloud Computing | Data Modeling | Data QualityHybrid work | Inclusive culture | Professional development | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R1d ago
-
IN_Manager_Full Stack Lead_Data and Analytics_Advisory_Bangalore INR 3000K-4000KAPI Integration | AWS | Ant Design | Azure | BootstrapSenior-level Full TimeBengaluru Millenia, India1d ago
-
Data Engineering Manager INR 700K-1000KApache Airflow | Apache Flink | Apache Hadoop | Apache Hive | Apache IcebergMid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
IN_Senior Associate_Agentic + Gen AI__AI-50_Advisory_ Mumbai INR 2000K-4000KAPI Management | Autonomous Agents | C# | C++ | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Goregaon, India1d ago
-
Director Of Engineering - Java, React, RAG & GenAI INR 1500K-6000KAI Observability | Agile | Azure OpenAI | CI/CD | Cloud NativeExecutive-level Full TimeHyderabad, India1d ago
-
Data engineering lead INR 3000K-4000KAWS DMS | AWS Lambda | AWS Step Functions | Amazon Aurora | Amazon Aurora RDSSenior-level Full TimeIND - Bengaluru, India1d ago
-
AWS | Amazon Web Services | Apache Spark | Azure | Azure DataFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Bangalore INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Bangalore INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Bangalore INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerFlexible work arrangements | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Bangalore INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Bangalore INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India1d ago
-
Senior Manager, Commercial, GBS Process & Analytics Services INR 2486K-3250KAI | Agentic AI | Agile | BPM | Change ManagementSenior-level Full TimeIndia - Bangalore1d ago
-
Delivery Lead INR 2000K-4800KAI Governance | AWS | Agentic Workflows | Application Security | AzureSenior-level Full TimeBengaluru, BDC9A, India1d ago
-
Business Analytics Manager-Assistant Vice President INR 1500K-2000KBusiness Strategy | Compliance Management | Customer Segmentation | Data Analysis | Data ModelingExecutive-level Full TimeAMRUTHAHALLI, NH 7,INTERNATION, India1d ago
-
Data Engineering Developer - Assistant Manager INR 1500K-3000KAccessibility | Agile | Automated testing | Azure | CI/CDFlexible work/life support | Inclusive development opportunities | Paid volunteer days | Vibrant employee networks | Work from office supportMid-level Full TimeHyderabad, India R1d ago
-
Data Engineering Developer - Assistant Manager INR 1500K-3000KAccessibility | Agile | Automated testing | Azure | CI/CDFlexible work/life support | Paid volunteer days | Work from OfficeMid-level Full TimeBangalore, India R1d ago
-
Manager - Procurement Automation & Analytics INR 945K-2205KAgentic AI | Copilot | DAX | Microsoft Power | Microsoft Power PlatformMid-level Full TimeIND-BLR-Divyasree Technopolis, India1d ago