Data Engineer - Associate Director
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Architect enterprise data platforms using Azure Databricks
- Build and optimize data ingestion and transformation pipelines
- Build data marts and analytics models
- Define KPIs and performance metrics for teams
- Define architecture standards patterns and best practices
- Deliver proofs of concept and solution demos
- Develop reusable data engineering frameworks
- Ensure data quality availability and governed data products
- Implement data security governance and privacy controls
- Lead cloud migration to Databricks and Azure native services
- Lead team recruitment coaching and mentoring
- Mentor and guide data engineers
- Modernize data architecture and engineering practices
- Monitor troubleshoot and performance tune Databricks workloads
- Oversee ETL and ELT pipeline development and deployment
Perks/Benefits
Skills/Tech-stack
Agile | Apache Spark | Avro | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure RBAC | Blob Storage | CI/CD | Cloud Resource Management | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Privacy | Data mesh | Databricks | Delta Lake | DevSecOps | ELT | ETL | IAM | Parquet | PySpark | RBAC | Resource Management | SQL | Scala | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
SSE_Analytics Enablement INR 2250K-5000KAI/ML | Alteryx | Analytics engineering | Architecture Review | AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India5h ago
-
SSE_Analytics Enablement INR 2250K-5000KAlteryx | Architecture Review | Artificial Intelligence | CI/CD | Code AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India5h ago
-
GCP Data Engineer / Consultant Specialist INR 1500K-2000KAirflow | Alerting | Apache Beam | Automation | BigQueryFlexible working | Inclusive workplace | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R12h ago
-
Senior AI Testing Engineer (Generative AI) INR 2000K-3300KAI Agents | API Testing | AWS | Azure | CI/CDSenior-level Full TimeBangalore North, India12h ago
-
AI Solution Architect INR 2000K-4500KAPI Integration | AWS | Agentic Orchestration | Async workflows | AutogenSenior-level Full TimeBangalore North, India12h ago
-
Data Architect INR 1500K-2500KBatch Processing | CI/CD | Cluster management | Cost Optimization | Data EngineeringSenior-level Full TimeCoimbatore, India12h ago
-
Senior-level Full TimeIN-KA-Bangalore13h ago
-
Senior-level Full TimeIN-KA-Bangalore13h ago
-
Senior-level Full TimeIN-TN-Chennai13h ago
-
Data Science and Tech Lead AMEA INR 2000K-3500KAWS | Agile | Amazon Bedrock | Amazon SageMaker | CI PipelinesSenior-level Full TimePune, ASIA, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Assistant Manager- AI Engineer INR 1500K-2800KAmazon Web Services | Anthropic Claude | Autogen | Azure | Cloud platformMid-level Full TimeBangalore, Karnataka, India14h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India14h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2500KAI | Automation | C plus plus | Data Infrastructure | Data ModelingMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Data Engineer, YouTube INR 800K-1400KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ArchitectureMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior Software Engineer, Cloud Bigtable INR 2000K-2500KBigtable | C++ | CI/CD | Cassandra | Consensus ProtocolsSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Sr Devops Engineer INR 2000K-3200KAWS | AWS CloudFormation | Access Control | Airflow | Amazon ECSDocumentation and standards | On-call rotationSenior-level Full TimePune, Maharashtra, India14h ago
-
Engineer - Embedded Automation QA INR 480K-1000KAPI Testing | Agile | Azure DevOps | BACnet | Behavior-Driven DevelopmentMid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101314h ago
-
Gen AI Developer Specialist INR 1800K-2500KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsMid-level Full TimeIndia15h ago
-
Gen AI Developer Specialist INR 1800K-2500KAPIs | Azure | Azure Data | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeIndia15h ago
-
Gen AI Developer Specialist INR 1800K-3000KA2A protocol | AI Governance | AWS Bedrock | Agent patterns | AutogenMid-level Full TimeIndia15h ago
-
Gen AI Developer Associate INR 2000K-3300KA2A | API Integration | AWS | AWS Bedrock | Agent to AgentEntry-level Full TimeIndia15h ago