Associate Director - Data Engineering
IN - HYDERABAD ORION, India
INR 875K-1300K (estimate) Mid-level Full Time
Tasks
- Architect data lake and lakehouse solutions
- Build ETL and ELT pipelines with data quality validation
- Collaborate with architecture governance and domain teams
- Contribute to pipeline development and code reviews
- Design, build, and optimize data pipelines
- Enforce data engineering best practices
- Ensure data platform reliability accuracy consistency and low latency
- Evaluate and adopt emerging big data and streaming technologies
- Implement data integration patterns including streaming batch and CDC
- Implement distributed processing with Spark or Flink
- Implement feature engineering pipelines for machine learning
- Improve platform observability and alerting
- Lead and manage data engineering teams
- Optimize performance and reduce cloud costs
- Orchestrate pipelines with workflow tools
Perks/Benefits
- Continuing education assistance
- Continuous learning
- Family-friendly perks
- Flexible time off
- Health and wellness
- Referral incentives
- Retail discounts
- Retirement planning
Skills/Tech-stack
AWS | AWS Lambda | AWS Step Functions | Access Control | Agile | Airflow | Amazon EC2 | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon VPC | Apache Flink | Apache Spark | CI/CD | Canonical Data Model | Change Data Capture | CloudWatch | Containers | Data Capture | Data Governance | Data Lineage | Data Model | Data Modeling | Data Observability | Data Warehousing | Databricks | DevOps | Dimensional Modeling | ELT | ETL | Event Driven | Event-driven architecture | Hadoop | Infrastructure as Code | Java | Kafka | Load Balancing | Microservices | Normalized modeling | PII | Python | Route 53 | SQL | Scala | Step Functions | Terraform | VPC | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
AWS | Agent systems | Agentic AI | Amazon SageMaker | Autonomous AgentsSenior-level Full TimeBengaluru Millenia, India9h ago
-
AWS SageMaker | Agent systems | Agentic AI | Autonomous Agents | Azure Machine LearningSenior-level Full TimeBengaluru Millenia, India9h ago
-
Agent systems | Amazon SageMaker | Autonomous Agents | Azure ML | Computer VisionFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
Agent systems | Agentic AI | Amazon SageMaker | Autonomous Agents | Azure Machine LearningFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India9h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India9h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
Module Lead - GCP Data Engineer Job INR 1650K-3200KBigQuery | Bigtable | CI/CD | Cloud Build | Cloud NetworkingContinuous learning | Flexible work arrangements | Stable employmentSenior-level Full TimeHyderabad, TG, IN9h ago
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R9h ago
-
Product Manager, AI Solutions INR 1200K-2000KAI Products | Airtable | Asana | Backlog Management | CanvaDirect Access To Founding Team | Fast Track To Leadership | Health insurance | High autonomy | Low bureaucracyMid-level Full TimeBengaluru R10h ago
-
Product Manager, AI Solutions INR 1200K-2000KAirtable | Asana | Canva | Customer Insights | Data AnalysisDirect Access To Founding Team | Health insurance | High autonomy | High visibility | Optional In Person Hack WeeksMid-level Full TimeMumbai R10h ago
-
Applied AI Engineer, Agentic Systems INR 2755K-5500K.NET | API Development | Agent Orchestration | Anthropic API | C SharpSenior-level Full TimeRemote - India R14h ago
-
Senior-level Full TimeGurugram, India15h ago
-
Data Engineer INR 1200K-1496KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India15h ago
-
Staff Software Engineer - Semantic Layer INR 3000K-4000KAPI Design | Amazon Redshift | Backwards Compatibility | BigQuery | CompilationSenior-level Full TimeIndia - Remote R17h ago
-
Lead Associate - Data Architect INR 1500K-2000KAmazon Web Services | Automated data pipelines | Azure | Business Intelligence | Data GovernanceMid-level Full TimePune17h ago
-
Data Governance Engineer INR 3000K-4200KAI Governance | Access Control | Data Classification | Data Governance | Data Lifecycle ManagementCompetitive leave | Equity | Growth opportunities | Health coverageSenior-level Full TimePune, India18h ago
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India19h ago
-
Staff Engineer - Java,Scala,AWS INR 3000K-4000KAWS S3 | Agile | Amazon ECS | Amazon EFS | Amazon EMRFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India20h ago
-
Senior Data Engineer INR 3000K-4000KApache Airflow | Apache Spark | Azure | Azure Databricks | CI/CDSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 2000K-6000KAgentic AI | Analytics | LLMOps | Language Models | Language ProcessingSenior-level Full TimeBengaluru, KA, India20h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai20h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai20h ago