Senior Databricks Architect & Apache Spark Engineer - Senior Vice President
PLOT NO-1, S.NO. 77, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Adopt advanced Databricks capabilities
- Communicate architecture risks and roadmap progress to stakeholders
- Define Databricks target state architecture
- Define performance scalability and cost optimization framework
- Design high-throughput low-latency data pipelines
- Enable data sharing real time analytics and AI ML integration
- Enforce architectural compliance quality gates
- Establish engineering standards and design reviews
- Improve observability and operational resilience
- Lead migration roadmap sequencing and refactoring
- Mentor engineers and lead design forums
- Modernize and optimize Databricks platform
- Simplify legacy pipelines using reusable frameworks
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon S3 | Apache Hadoop | Apache Spark | Architecture governance | Cloudera | Cost Optimization | Data Observability | Data pipeline | Data pipeline optimization | Databricks | Design review | Distributed Systems | Performance Engineering | Pipeline Optimization | SQL | Scalability | Spark SQL | Spark Tuning
Education
Roles
Apache Spark Engineer | Architect | Databricks Architect | Engineer | Spark Engineer
Related jobs
-
Data Scientist (GenAI/Core DS) INR 2000K-3000KAWS | Data Analysis | Data Modeling | Data Visualization | LangchainSenior-level Full TimeGurugram, Haryana, India6h ago
-
Senior-level Full TimeIN-AP-Hyderabad6h ago
-
Senior-level Full TimeIN-AP-Hyderabad6h ago
-
Tech Lead INR 1500K-2400KAmazon Web Services | Data Governance | Data Modeling | Data Quality | DataOpsSenior-level Full TimeIN-TN-Chennai6h ago
-
APIs | AWS Kinesis | ClickHouse | DBT | Data GovernanceCareer growth | Flexible collaboration | Inclusive culture | Innovation focus | Remote-friendly work setupSenior-level Full TimeIndia6h ago
-
Senior-level Full Timebangalore, India6h ago
-
Full Stack Engineer – MERN Stack INR 1300K-2500KAPIs | AWS | Azure | Bootstrap | CI/CDCollaborative culture | Growth opportunities | MentorshipMid-level Full TimeMaharashtra, Pune, India7h ago
-
Python AI Engineer INR 1800K-3500KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerHybrid workSenior-level Full TimeIndia7h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2040KApache Kafka | Data Warehousing | Dimensional Modeling | Flink | GitSenior-level Full Timebangalore, India8h ago
-
Software Engineer (SDE 2) - Full Stack (Frontend), Lakeflow INR 1800K-3000KAPI Integration | AWS | Accessibility | Azure | CSSMid-level Full TimeBengaluru, India8h ago
-
API performance | API reliability | API scalability | AWS Glue | AWS LambdaAI training | Community forums | Laptop provided | Medical insurance | MentorshipEntry-level Full TimeIndia R8h ago
-
Software Engineering INR 1400K-1820KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeHyderabad, TS, IN10h ago
-
AWS | AWS CloudWatch | Alerting | Backups | BashSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2000K-3630KAWS | Apache Spark | Azure | C++ | Convolutional Neural NetworksSenior-level Full Timebengaluru, India11h ago
-
Senior-level Full TimePune, Maharashtra, India11h ago
-
AWS | Amazon Bedrock | Anthropic | Azure | Azure AIFlexible work arrangements | Health insurance | Learning and development | Paid time off | Retirement benefitsSenior-level Full TimeIndia12h ago
-
AWS | Accessibility | Cloud Architecture | Code Reviews | Design PatternsAccess to AI tools | Continuous learning | Flexible paid time off | Global impact | Learning membershipSenior-level Full TimeIndia R12h ago
-
AWS | Anthropic API | C++ | CI/CD | DockerFully remote | Healthcare coverage | No Internal Meetings Fridays | Paid sabbatical | Paid time offSenior-level Full TimeIndia R12h ago
-
Software Engineer - Spark, scala, Python, SQL, Databricks INR 1500K-2500KAirflow | Apache Spark | Automated testing | Azure Data | Azure Data LakeEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
Senior-level Full TimeMumbai, Maharashtra, India12h ago
-
Associate Engineer - Agentic AI Developer INR 2000K-3000KAgent systems | Azure | CI/CD | Docker | FastAPIMid-level Full TimeMumbai, MH, India13h ago
-
Staff Machine Learning Engineer INR 2500K-3500KAWS | Agentic Systems | Deep learning | Experiment design | Language ModelsSenior-level Full TimeHyderabad, Telangana, India13h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimePune, Maharashtra, India14h ago
-
Azure | CSV | ETL | Python | SQLSenior-level Full TimeBangalore, India14h ago
-
AI SW Stack Deployment Architect INR 2500K-4500KAPI Design | Cloud Computing | Distributed Systems | Edge Computing | Inference ServerSenior-level Full TimeBengaluru, KA, India14h ago