Databricks AWS Engineer - Vice President
PLOT NO-1, S.NO. 77, India
INR 1500K-6000K (estimate) Executive-level Full Time
Tasks
- Collaborate with architects platform teams and DevOps engineers
- Create unit integration and data validation tests
- Design data models and reusable pipeline components
- Develop and optimize Databricks jobs using Delta Lake
- Eliminate Hadoop dependencies and adopt AWS patterns
- Implement scalable job clusters on Databricks
- Optimize spark job performance
- Orchestrate data pipelines using Databricks Workflows
- Provide troubleshooting support and implementation guidance
- Refactor and modernize Spark pipelines to Databricks native architecture
- Simplify complex pipelines into standardized patterns
- Support production releases and post deployment validation
- Translate architecture into detailed technical designs
- Write clean, modular, testable code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Auto Scaling | Data Modeling | Data Validation | Databricks | Databricks Workflows | Delta Lake | Distributed Systems | Java | Job Scheduling | Performance Tuning | PySpark
Education
Related jobs
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 500K-1500KAWS | Amazon Aurora | Amazon S3 | Backup and Recovery | CDCMid-level Full TimeMumbai, MH7h ago
-
Amazon Aurora | Amazon RDS | Amazon S3 | Amazon Web Services | CI/CDMid-level Full TimeDahisar West, Mumbai City, Maharashtra7h ago
-
Data and Digital Initiatives INR 3000K-4000KAI | API Integration | Cloud Computing | Credit Risk | DashboardingFlexible working | Inclusive work environment | Opportunities to grow | Professional developmentSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
SDET ETL Testing INR 1500K-2500KAWS | AWS Command Line Interface | AWS Data | AWS Data Catalog | AWS GlueSenior-level Full TimeIN-HR-Gurgaon10h ago
-
AWS Data Engineer- Gen AI INR 1500K-2500KAWS CDK | AWS Glue | AWS Step Functions | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai10h ago
-
AWS Data Engineer- Airflow INR 1500K-2000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache HadoopMid-level Full TimeIN-AP-Hyderabad10h ago
-
MLOps Engineer INR 1200K-1680KAWS | Bedrock | CI/CD | Data Versioning | DockerEmployee Share Savings Plan | Hybrid work | Learning and mentoring | Paid volunteer day | Personal coachingMid-level Full TimeBengaluru12h ago
-
Senior-level Full TimePune, Maharashtra, India12h ago
-
Senior-level Full TimePune, Maharashtra, India12h ago
-
Mid-level Full TimeIndia13h ago
-
Lead Software Engineer - Data Engineering INR 3500K-5000KAWS | Airflow | Authentication | Authorization | CI/CDSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior-level Full TimeMumbai, Maharashtra, India13h ago
-
Engineer - Digital & AI Solutions INR 302K-346KAWS | Agile | Azure | Big Data | Cloud platformCharity Programmes | Discounted gym memberships | Environmental initiatives | Flexible working | Hybrid workingEntry-level Full TimeHyderabad, Telangana, India15h ago
-
AI/ML Engineer_MS INR 2500K-5000KAI Foundry | AI Search | AWS Bedrock | Amazon QuickSight | App ServiceSenior-level Full Timetelengana, India16h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia16h ago
-
Senior INR 3000K-5000KAI Foundry | Azure AI | Azure AI Foundry | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeGurgaon, Haryana, India17h ago
-
AI Engineer II INR 3799K-6000KAgentic AI | Agile methodology | Algorithms | Automated testing | Distributed SystemsSenior-level Full TimeBengaluru, KA, India17h ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1300K-2200KApache Airflow | Apache Beam | Apache Flink | BigQuery | ClickHouseMid-level Full TimePune, Maharashtra, India R17h ago
-
Senior-level Full TimeBengaluru, KA, India17h ago
-
Data Analyst Technical Lead (Alteryx) INR 3000K-4000KAPI Integration | Alteryx Designer | Alteryx Server | Data Cleansing | Data ReconciliationUK shiftSenior-level Full TimeNoida, UP, India17h ago
-
Software Engineer III - AI/ML, Java/Python, REACT INR 3500K-5000KAPI Contract | API contract management | AWS | Asynchronous processing | CI/CDSenior-level Full TimeMumbai, Maharashtra, India17h ago
-
GCP Data Engineer INR 1500K-2000KAgile | Apache Airflow | Ascend.io | CI/CD | Cloud ComposerFlexible work model | Wellbeing cultureMid-level Full TimeHyderabad, India18h ago
-
Mid-level Full TimeBangalore, Karnataka, India18h ago
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R18h ago
-
A/B | A/B Testing | AWS | Azure | B testingFlexible working hours | Flextime policy | Hybrid work model | International collaboration | Technical growth opportunitiesSenior-level Full TimeIndia18h ago