Databricks AWS Engineer - Vice President
PLOT NO-1, S.NO. 77, India
INR 1500K-6000K (estimate) Executive-level Full Time
Tasks
- Collaborate with architects platform teams and DevOps engineers
- Create unit integration and data validation tests
- Design data models and reusable pipeline components
- Develop and optimize Databricks jobs using Delta Lake
- Eliminate Hadoop dependencies and adopt AWS patterns
- Implement scalable job clusters on Databricks
- Optimize spark job performance
- Orchestrate data pipelines using Databricks Workflows
- Provide troubleshooting support and implementation guidance
- Refactor and modernize Spark pipelines to Databricks native architecture
- Simplify complex pipelines into standardized patterns
- Support production releases and post deployment validation
- Translate architecture into detailed technical designs
- Write clean, modular, testable code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Auto Scaling | Data Modeling | Data Validation | Databricks | Databricks Workflows | Delta Lake | Distributed Systems | Java | Job Scheduling | Performance Tuning | PySpark
Education
Related jobs
-
Senior-level Full TimeMitratech India6h ago
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 5600376h ago
-
APIs | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru6h ago
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110577h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R7h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India12h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India12h ago
-
Technical Lead-Azure Databricks INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN12h ago
-
Software Engineer - Python Expert, API Frameworks, RAG, Gen AI, Devops, Frontend Frameworks (5+ Years) INR 2500K-5000KAgentic AI | Alerting | Angular | CI/CD | Cause analysisSenior-level Full TimeIND-BANGALORE, India12h ago
-
Snowflake Data Engineer INR 2000K-2600KAmazon Web Services | Apache Spark | Bitbucket | CI/CD | Cloud platformSenior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBengaluru, KA, IN12h ago
-
EY - GDS Consulting - AI And DATA - Databricks - Senior INR 2400K-4000KAPI | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeTrivandrum, KL, IN, 69558112h ago
-
Senior Data Engineer - PySpark & Python INR 1500K-2500KApache Airflow | Apache Spark | CI/CD | Data Cleansing | Data LinkingSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
A/B | A/B Testing | AWS | Azure | B testingGrowth opportunities | Learning and development | Mentorship | Well-beingSenior-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India12h ago
-
AWS | Autogen | Azure | BERT | Computer VisionCollaborative team environment | Continuous learning | Professional growthMid-level Full TimeIndia21h ago
-
Senior-level Full TimeMaharashtra, Pune, India23h ago
-
Software Engineer, BizTech(Python, LLM, GenAI, MCP) INR 2380K-3400KAI Agents | AI Assisted Development | API Design | AWS | ClaudeMid-level Full TimeBangalore, India23h ago
-
Senior-level Full TimeIN-AP-Hyderabad23h ago
-
Senior-level Full TimeIN-AP-Hyderabad23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R1d ago
-
Apache Kafka | Distributed Systems | Java | Kafka Connect | Kafka ProducersCollaborative environment | Long term role | Mission-driven work | Remote workMid-level Full TimeIndia1d ago