Databricks AWS Engineer - Vice President
PLOT NO-1, S.NO. 77, India
INR 1500K-6000K (estimate) Executive-level Full Time
Tasks
- Collaborate with architects platform teams and DevOps engineers
- Create unit integration and data validation tests
- Design data models and reusable pipeline components
- Develop and optimize Databricks jobs using Delta Lake
- Eliminate Hadoop dependencies and adopt AWS patterns
- Implement scalable job clusters on Databricks
- Optimize spark job performance
- Orchestrate data pipelines using Databricks Workflows
- Provide troubleshooting support and implementation guidance
- Refactor and modernize Spark pipelines to Databricks native architecture
- Simplify complex pipelines into standardized patterns
- Support production releases and post deployment validation
- Translate architecture into detailed technical designs
- Write clean, modular, testable code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Auto Scaling | Data Modeling | Data Validation | Databricks | Databricks Workflows | Delta Lake | Distributed Systems | Java | Job Scheduling | Performance Tuning | PySpark
Education
Related jobs
-
Associate Engineer - Embedded AI & Data Analytics INR 1000K-1141KC plus plus | Classification | Data Modeling | Data Observability | Data PipelinesCollaborative work environment | On-site work schedule | Professional development opportunities | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …2h ago
-
Senior Data Engineer - Big Data & Automation INR 1500K-2500KAgile | Ansible | Apache Hive | Apache Spark | ArgoCDFlexible work policy | Work from homeSenior-level Full TimeIndia5h ago
-
Senior Data Engineer - ETL Framework INR 1500K-2500KApache Doris | Apache Hive | Apache Iceberg | Apache Spark | Apache TezFlexible work policy | Work from homeSenior-level Full TimeIndia6h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India7h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS | AWS CloudFormation | AWS Step Functions | Airflow | Amazon S3Senior-level Full TimePune, Maharashtra, India7h ago
-
Consultant INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India8h ago
-
Executive-KDNI - Data & Analytics INR 1500K-5199KAWS | Azure | Dashboarding | Data Governance | Data ModelingExecutive-level Full TimeGurgaon, Haryana, India8h ago
-
Analytics Engineer - SQL & Data Visualization INR 1500K-2500KAgile | Cloud Data | Cloud Data Warehouse | Data Interpretation | Data ModelingMid-level Full TimeBengaluru, KA, India8h ago
-
AES - DE - Generative AI Application Developers INR 2500K-4200KAWS | Agent Loops | Anthropic | Asynchronous programming | AutogenSenior-level Full TimePune, Maharashtra, India8h ago
-
Manager Software Engineer - RLE INR 1800K-2500KAmazon Web Services | Applied AI | Backend architecture | CI/CD | Cloud platformEquity grant | Food Credit | Housing bonus | Medical insurance | Performance bonusMid-level Full TimeIndia9h ago
-
Senior-level Full TimePune9h ago
-
AWS | Apache Spark | Databricks | GenAI | Hugging FaceFlexible work arrangements | Professional growth opportunitiesSenior-level Full TimeIndia9h ago
-
Applied AI ML Senior Associate INR 2500K-4500KAPIs | AWS Bedrock | Azure OpenAI | CI/CD | DatabricksSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India11h ago
-
TC-CS-IAM-AI and Agentic AI Engineer- Senior INR 2000K-4800KAWS | Agile | Autogen | Azure | ClassificationSenior-level Full TimeBengaluru, KA, IN, 56004815h ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India15h ago
-
Data Analyst/PowerBI Engineer INR 1628K-2500KData Modeling | ETL | Microsoft Excel | Microsoft Fabric | Power BISenior-level Full TimeHyderabad, Telangana, India - Remote R15h ago
-
Senior Data Engineer INR 3000K-4000KAmazon Redshift | BigQuery | DBT | Data Modeling | Data WarehousingGlobal opportunities | Inclusive onboarding | Supportive work culture | Wellness programSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Data Engineer – Databricks INR 1500K-2500KAWS | AWS Glue | Amazon Redshift | Apache Spark | DatabricksSenior-level Full TimePune IN (Office: 5th & 6th …15h ago
-
Software Engineer II - Data Engineer - Data & ML Engineering INR 980K-1820KAPI Development | AWS | AWS CloudFormation | AWS Glue | AWS Lake FormationMid-level Full TimeHyderabad, India15h ago
-
Mid-level Full TimePune, Gera Commerzone SEZ, India15h ago
-
Data Scientist - MLOps INR 1500K-2500KAWS | Apache Airflow | CI/CD | CloudFormation | Data GovernanceMid-level Full TimePune, Gera Commerzone SEZ, India15h ago
-
Artificial Intelligence / Machine Learning Engineer Lead (GenAI-powered applications) INR 2475K-3500KAWS | Agentic AI | Agents | Azure | CI/CDSenior-level Full TimeIND BNGL FL2-3 TWR 3, India15h ago
-
Senior Software Engineer/AI-ML INR 2500K-5000K12-Factor | 12-Factor App | AWS SageMaker | Asyncio | BedrockSenior-level Full TimeIndia GCC-Puppalaguda Village15h ago
-
Software Engineer/AI-ML INR 2500K-5000KAI Search | AWS | AWS Bedrock | AWS SageMaker | Agent systemsSenior-level Full TimeIndia GCC-Puppalaguda Village15h ago