Senior Databricks & Apache Spark Developer - Vice President
PLOT NO-1, S.NO. 77, India
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Build and optimize Delta Lake pipelines
- Collaborate with architects and devops engineers
- Configure auto scaling job clusters
- Design data models and reusable components
- Develop Databricks native solutions
- Develop unit integration and data validation tests
- Eliminate Hadoop dependencies
- Follow Databricks and Spark engineering standards
- Optimize spark job performance
- Orchestrate Databricks workflows
- Refactor Spark pipelines to Databricks architectures
- Simplify over engineered pipelines
- Support production releases and post deployment validation
- Translate architecture into technical designs
- Write modular testable code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon S3 | Apache Spark | Auto Scaling | Databricks | Databricks Workflows | Delta Lake | Java | Job Clusters | PySpark
Education
Related jobs
-
Data Operation Engineer INR 2040K-3000KAsset bundles | Azure | Cloud platform | Confluence | DBTHybrid work arrangementMid-level Full TimeChennai, Tamil Nadu, India2h ago
-
AWS | Azure | Cloud platform | Deep learning | Generative AIContinuous learning and growth | Fully remote work | Technical excellence and experimentation cultureSenior-level Full TimeIndia R2h ago
-
Senior Data Engineer, Payments INR 3050K-4350KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore, India2h ago
-
AWS | Access Control | Apache Airflow | Azure | CI/CDAutonomy | Career growth | Inclusive culture | Learning and developmentSenior-level Full TimeIndia2h ago
-
Senior-level Full TimeAnywhere in India R3h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
Forward Deployed Engineer INR 2000K-3500KAI | APIs | Agent Orchestration | Agent-based | Agent-based AISenior-level Full TimeHyderabad, India6h ago
-
Senior AI Engineer (Agents) INR 2000K-3500KA/B | A/B Testing | Agent Assist | Anthropic | B testingEmployee benefits | Flexible culture | Remote work flexibilitySenior-level Full TimeHyderabad, India6h ago
-
Senior AI Engineer (Search/Retrieval) INR 2000K-3465KAWS | Azure | BM25 | CI/CD | Citation AccuracySenior-level Full TimeHyderabad, India6h ago
-
Computer Scientist ( Java Backend ) INR 2500K-3500KApache Kafka | CI/CD | Docker | Event Driven | Event-driven architectureSenior-level Full TimeBangalore, India R8h ago
-
Computer Scientist 2 ( Data Engineering + AI ) INR 2475K-3465KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeNoida, India R8h ago
-
Computer Scientist - II ( Data Engineering ) INR 1500K-2000KAWS | Apache Spark | Azure | CI/CD | Data ModelingMid-level Full TimeNoida, India R8h ago
-
Senior Data Engineer INR 3000K-4200KAWS | Automated testing | CI/CD | DBT | Data GovernanceEducational assistance | Employee assistance program | Flexible time off | Free Cab Transport Facility | Hybrid work modelSenior-level Full TimeIND - NonGBS-Pune-Kharadi, India8h ago
-
Staff Data Engineer INR 1500K-2400KAI code generation | AWS | AWS Glue | Agentic Frameworks | Apache IcebergSenior-level Full TimeGurugram12h ago
-
Sr Data Engineer II - Salesforce (Hybrid) INR 1500K-2700KAmazon Redshift | Apache Airflow | Boomi | Bulk API | DBTMid-level Full TimeBangalore, INDIA R12h ago
-
Senior Azure Data Engineer INR 3000K-3900KAPI Integration | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia15h ago
-
Artificial Intelligence | ETL | Git | Pandas | PySparkCollaborative team | Personal growth | Technical mentorship | Values-driven cultureEntry-level Full TimeHyderabad, Telangana17h ago
-
API Development | Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud ComputingCareer growth opportunities | Collaborative work culture | Flexible work environment | Mentoring opportunitiesMid-level Full TimeIndia18h ago
-
API Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India18h ago
-
API Integration | AWS | Active Directory | Anthropic | Azure Active DirectoryCareer growth opportunities | Continuous learning and professional development | Cross-functional project exposure | Flexible and collaborative environment | Inclusive workplace cultureSenior-level Full TimeIndia18h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
Data Engineer INR 1400K-1800KAnomaly Detection | Apache Spark | Azure DevOps | Azure DevOps Pipelines | CDCHybrid work modelSenior-level Full TimeMumbai, Maharashtra, India19h ago
-
Principal AI Engineer INR 2475K-4500KAI Security | Access Control | Agent Frameworks | Agent Orchestration | Agent observabilityHybrid work | Onsite requirements in Bengaluru IndiaSenior-level Full TimeBengaluru, India20h ago