Associate Director - Data Engineering
IN - HYDERABAD ORION, India
INR 875K-1300K (estimate) Mid-level Full Time
Tasks
- Architect data lake and lakehouse solutions
- Build ETL and ELT pipelines with data quality validation
- Collaborate with architecture governance and domain teams
- Contribute to pipeline development and code reviews
- Design, build, and optimize data pipelines
- Enforce data engineering best practices
- Ensure data platform reliability accuracy consistency and low latency
- Evaluate and adopt emerging big data and streaming technologies
- Implement data integration patterns including streaming batch and CDC
- Implement distributed processing with Spark or Flink
- Implement feature engineering pipelines for machine learning
- Improve platform observability and alerting
- Lead and manage data engineering teams
- Optimize performance and reduce cloud costs
- Orchestrate pipelines with workflow tools
Perks/Benefits
- Continuing education assistance
- Continuous learning
- Family-friendly perks
- Flexible time off
- Health and wellness
- Referral incentives
- Retail discounts
- Retirement planning
Skills/Tech-stack
AWS | AWS Lambda | AWS Step Functions | Access Control | Agile | Airflow | Amazon EC2 | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon VPC | Apache Flink | Apache Spark | CI/CD | Canonical Data Model | Change Data Capture | CloudWatch | Containers | Data Capture | Data Governance | Data Lineage | Data Model | Data Modeling | Data Observability | Data Warehousing | Databricks | DevOps | Dimensional Modeling | ELT | ETL | Event Driven | Event-driven architecture | Hadoop | Infrastructure as Code | Java | Kafka | Load Balancing | Microservices | Normalized modeling | PII | Python | Route 53 | SQL | Scala | Step Functions | Terraform | VPC | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Lead consultant - GenAI LLM Ops Engineer INR 3125K-5000KA/B | A/B Testing | AWS | Azure | Azure OpenAISenior-level Full TimeIndia-Pune8h ago
-
Senior Software Engineer-Java INR 2300K-3200KAWS | AWS Lambda | Amazon EC2 | Amazon RDS | Amazon S3Senior-level Full TimeIN-AP-Hyderabad8h ago
-
Mid-level Full TimeIN-TN-Chennai8h ago
-
DE&A - Core - Cloud Data Engineering - Informatica Cloud INR 1500K-2500KCloud Data Integration | Data Modeling | Data Transformation | Data Warehousing | Data integrationMid-level Full TimeIndia11h ago
-
Data Engineer Ii INR 1500K-2000KAWS Glue | AWS Lambda | Amazon EMR | Amazon Redshift | Amazon S3Community Outreach Programs Charity Events | Employee Resource Group | Employee stock purchase program | Health and wellness incentives | Remote workMid-level Full TimeBangalore, KA, IN, 56007615h ago
-
Data Science Engineer INR 1524K-2541KAlgorithms | Client-Server | Client-Server Architecture | Data Ingestion | Data PipelinesMid-level Full TimeHyderabad, India16h ago
-
Manager, Field Analytics INR 1500K-2800KBI Dashboards | DBT | Data Architecture | Data Documentation | Data GovernanceHybrid workMid-level Full TimeBengaluru, India21h ago
-
Senior-level Full TimeBangalore, India21h ago
-
Software Engineer II - Python,Microservices,Kafka,Nosql, INR 2000K-3000KAKS | Apache Kafka | Application Gateway | Azure | Azure ADMid-level Full TimeBangalore, India21h ago
-
AI Cloud Solution Engineer_Director_Software Engineering INR 1500K-6000KAI Foundry | AWS Bedrock | Amazon SageMaker | Azure AI | Azure AI FoundryExecutive-level Full TimeRMZ Ecoworld Business Park, India21h ago
-
Data Governance Manager INR 1500K-1500KAudit Remediation | Data Catalog | Data Classification | Data Governance | Data LineageEquity | Health insurance | Volunteering time off | Wellbeing and social eventsMid-level Full TimeBengaluru or Gurugram1d ago
-
Senior INR 500K-1500KAdvanced Analytics | Alteryx | Alteryx Advanced Analytics | Alteryx Data Blending | Data BlendingSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AI Automation Forward Deployment Engineer INR 2857K-4590KAI orchestration | Agentic AI | BigQuery | Cause analysis | Data ModelingDonation match | Flexible location | Flexible schedule | Health coverage | Paid vacationSenior-level Full TimeBangalore, India1d ago
-
Senior Analytics Engineer INR 2500K-2829KAirflow | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsContinuous learning and development | Hybrid work | International travel possibleSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Infrastructure Engineer III - Cloud Database Administrator (DBA) INR 1800K-2200KAWS | AWS DMS | AWS RDS | Amazon CloudWatch | Amazon RedshiftSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Lead Consultant - RAG Engineer INR 2535K-4225KAWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud NativeContinuous learning opportunities | Hands-on experience | MentorshipSenior-level Full TimeIndia-Gurugram1d ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestBudget for education | Budget for personal growth | Budget for wellness | Local team meetups | Remote workSenior-level Full TimeNoida, India1d ago
-
Python Developer INR 2500K-3000KAWS | Debugging | Django | Event Driven | Event-driven architectureMid-level Full TimeIN-KA-Bangalore1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Databrick Developer INR 2000K-2040KAgile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeIN-TN-Chennai1d ago
-
GEN AI developer INR 2500K-3000KAPI Integration | Anthropic Claude | Context Management | Crew AI | FastAPIMid-level Full TimeIN-KA-Bangalore1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Azure | Csharp | Data Ingestion | Data cleaning | Machine LearningCommunity forums | Laptop provided | Medical insurance | Mentorship | No weekend workSenior-level Full TimeIndia R1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Agent Framework | Agile | Amazon Web Services | Azure Data | Azure Data FactoryBig 4 consulting experienceSenior-level Full TimeMumbai, Maharashtra, India1d ago