Senior Databricks & Apache Spark Developer - Vice President
PLOT NO-1, S.NO. 77, India
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Build and optimize Delta Lake pipelines
- Collaborate with architects and devops engineers
- Configure auto scaling job clusters
- Design data models and reusable components
- Develop Databricks native solutions
- Develop unit integration and data validation tests
- Eliminate Hadoop dependencies
- Follow Databricks and Spark engineering standards
- Optimize spark job performance
- Orchestrate Databricks workflows
- Refactor Spark pipelines to Databricks architectures
- Simplify over engineered pipelines
- Support production releases and post deployment validation
- Translate architecture into technical designs
- Write modular testable code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon S3 | Apache Spark | Auto Scaling | Databricks | Databricks Workflows | Delta Lake | Java | Job Clusters | PySpark
Education
Related jobs
-
AWS | Access Control | Apache Airflow | Azure | CI/CDAutonomy | Career growth | Inclusive culture | Learning and developmentSenior-level Full TimeIndia1h ago
-
Sr Data Engineer II - Salesforce (Hybrid) INR 1500K-2700KAmazon Redshift | Apache Airflow | Boomi | Bulk API | DBTMid-level Full TimeBangalore, INDIA R11h ago
-
Artificial Intelligence | ETL | Git | Pandas | PySparkCollaborative team | Personal growth | Technical mentorship | Values-driven cultureEntry-level Full TimeHyderabad, Telangana16h ago
-
API Development | Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud ComputingCareer growth opportunities | Collaborative work culture | Flexible work environment | Mentoring opportunitiesMid-level Full TimeIndia17h ago
-
API Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India17h ago
-
API Integration | AWS | Active Directory | Anthropic | Azure Active DirectoryCareer growth opportunities | Continuous learning and professional development | Cross-functional project exposure | Flexible and collaborative environment | Inclusive workplace cultureSenior-level Full TimeIndia18h ago
-
Senior-level Full TimeIN-TN-Chennai18h ago
-
Data Engineer INR 1400K-1800KAnomaly Detection | Apache Spark | Azure DevOps | Azure DevOps Pipelines | CDCHybrid work modelSenior-level Full TimeMumbai, Maharashtra, India19h ago
-
Principal AI Engineer INR 2475K-4500KAI Security | Access Control | Agent Frameworks | Agent Orchestration | Agent observabilityHybrid work | Onsite requirements in Bengaluru IndiaSenior-level Full TimeBengaluru, India19h ago
-
AI Engineer – Retail/CPG Domain INR 1500K-2500KAWS | Azure | Cloud platform | Data Governance | Data ModelingMid-level Full TimeGurugram, Haryana, India20h ago
-
REF82383U - Data science (ML Algorithms, unsupervised techniques, Databricks, Python, PySpark, Azure,AB testing ) 3- 6 yrs exp INR 1500K-2040KA/B | A/B Testing | B testing | Databricks | Machine LearningSenior-level Full TimeBangalore, KA, India21h ago
-
Specialist - Data Engineering-Data Engineering INR 180K-200KAWS | Apache Kafka | Apache Spark | Data Modeling | Data QualityEntry-level Full TimeMumbai, Maharashtra, India21h ago
-
AWS | Agent Orchestration | Agent systems | Anomaly Detection | AzureCharity match | Corporate volunteering | Dental insurance | Medical insurance | Paid time offSenior-level Full TimeBengaluru, KA, IN21h ago
-
API Development | AWS | Azure | Cloud platform | Google CloudCharity contribution match | Corporate Volunteering Hours | Dental insurance | Discounts on tickets and travel | Medical insuranceMid-level Full TimeBengaluru, KA, IN23h ago
-
Sr. Staff Engineer (Python,Pyspark,AWS) INR 2800K-4000KAI Agents | API Gateway | AWS | Apache Spark | BedrockEmployee volunteering | Family wellbeing benefits | Health insurance | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimeIndia - Bengaluru; India - Hyderabad1d ago
-
GCP Data Engineer INR 2000K-3000KApache Airflow | Apache Spark | BigQuery | Cloud Composer | Cloud DataflowSenior-level Full TimeIndia - Bengaluru; India - Hyderabad1d ago
-
Senior Data Engineer INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactoryFlexible work environment | Hybrid work model | Learning and development supportSenior-level Full TimeIndia R1d ago
-
AWS | Agentic AI | Apache Spark | Databricks | Generative AICollaborative global engineering culture | Continuous learning | Flexible work environment | Opportunity to work on cutting edge GenAI | Remote-friendly work environmentSenior-level Full TimeIndia1d ago
-
Senior Data Engineer INR 3000K-4200KAWS | Access Management | Amazon Neptune | Apache Airflow | Apache KafkaCareer advancement | Hybrid work options | Professional development programs | Remote work options | Training programsSenior-level Full TimeBengaluru1d ago
-
Data Engineer INR 1500K-2000KAWS Glue | Access Control | Amazon EMR | Amazon Snowflake | Apache AirflowMid-level Full TimeIndia1d ago
-
API | Agile | Apache Airflow | Bitbucket | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India1d ago
-
Lead Software Engineer INR 3000K-4500KAWS | CI/CD | DevOps | Docker | EMRCareer development opportunities | Comprehensive benefits | Continuous learning | Flexible working hours | Work-life balanceSenior-level Full TimeMumbai, India1d ago
-
Staff Software Engineer - Data INR 3200K-4600KAWS Lambda | Airflow | Ansible | Apache Flink | Apache SparkSenior-level Full TimeBengaluru, INDIA, India1d ago
-
.NET | APIs | AWS | Alerting | AzureAdoption leave | Employee assistance program | Health care benefits | Maternity leave | Mental wellness programsSenior-level Full TimeIndia1d ago