DE&A - Databricks - Data Engineer, Platform Admin and Operations Support
Pune, Maharashtra, India
INR 3000K-3900K (estimate) Senior-level Full Time
Tasks
- Configure and optimize Databricks clusters
- Design efficient data layouts
- Ensure job reliability and system stability
- Maintain high availability for workloads
- Manage high-severity incidents
- Monitor clusters and workflows
- Optimize Delta Lake for performance
- Partition and Z order data
- Perform root cause analysis and preventive actions
- Support Snowflake Databricks integrations
- Troubleshoot performance bottlenecks
- Tune driver and executor settings
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Spark | Azure | Cause analysis | Cloud platform | Cluster management | Data Partitioning | Databricks | Delta Lake | File Compaction | Google Cloud | Google Cloud Platform | High Availability | Incident Management | Monitoring | Performance Tuning | PySpark | Root Cause Analysis | Root cause | SQL | Scala | Snowflake | Storage Optimization | Z-ordering
Education
N/A
Related jobs
-
Entry-level InternshipHyderabad, India2h ago
-
Entry-level InternshipHyderabad, India3h ago
-
DTICI_T8_Data_engineer_Manufacturing_Operations INR 1500K-2500KAgile | Apache Spark | Azure | Azure Blob | Azure Blob StorageSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Confluent Kafka Data Engineer INR 1500K-2500KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-KA-Bangalore4h ago
-
GEN AI Developer INR 2000K-5000KAgile | Continuous integration | Data Modeling | Generative AI | Language ProcessingSenior-level Full TimeIN-KA-Bangalore4h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIN-MH-Mumbai4h ago
-
GCP Data Engineer INR 1500K-2500KADLS Gen2 | Airflow | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-MH-Mumbai4h ago
-
Principal AI Engineer with Java INR 2475K-4800KAI Services | Agent Framework | Agentic AI | Alembic | AutogenEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India4h ago
-
Software Engineer, PhD, Early Career, 2026 INR 3500K-5000KAlgorithms | Artificial Intelligence | Best practices | Cause analysis | CodingSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Lead Assistant Manager INR 1500K-2800KAccess Control | Caching | Data Governance | Databricks | Databricks SQLSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Associate Director - Forward Deployed Engineer/AI Engineer INR 1500K-3000KAI Foundry | AWS Bedrock | Agent systems | App Service | Artificial IntelligenceMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Azure Data Engineer INR 1500K-2000KApache Spark | Azure | DBX Notebooks | Data Infrastructure | Data ModelingMid-level Full TimeBangalore, Karnataka, India7h ago
-
Alerting | Ansible | App Monitoring | AppDynamics | AutomationSenior-level Full TimePune, India7h ago
-
Associate - Java Developer - Prime Brokerage INR 1500K-2000KAgile | Crystal Reports | Data Warehousing | Database Triggers | Database functionsMid-level Full TimePune, India7h ago
-
BI Developer (Gen AI) – (BI and Analytics)-Analyst INR 2500K-4000KCI/CD | Control-M | Data Modeling | Database Design | DatabricksSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data Scientist- GenAi/Agentic Ai INR 2000K-5000KAI orchestration | AWS | CrewAI | Data Mining | Generative AIMentoring program | Team collaboration | Training and coachingEntry-level Full TimeIndia7h ago
-
Data Scientist - Gen Ai/ Agentic Ai INR 2000K-5000KAI orchestration | AWS | Agentic AI | Crew AI | Data MiningCoaching | Mentoring program | Training and developmentEntry-level Full TimeIndia7h ago
-
Software Engineer - (Java Full Stack,AWS) INR 1500K-2700KAPI Gateway | AWS | Angular | Bitbucket | CI/CDMedical benefits | Paid time off | Work-life balanceMid-level Full TimeHyderabad, India7h ago
-
Software Engineer I - Python GenAI INR 3000K-4000KAWS | Data analytics | GenAI | Object-Oriented | Object-oriented programmingEntry-level Full TimeHyderabad, Telangana, India7h ago
-
Senior AI / ML Data Scientist I INR 3000K-4500KCI/CD | CNN | CatBoost | Component analysis | Cross-validationSenior-level Full TimeBangalore, India9h ago
-
Data Scientist & AI Developer INR 3000K-5000KA/B | A/B Testing | AWS SageMaker | Azure ML | B testingSenior-level Full TimeBangalore, KA, IN, 56007610h ago
-
Senior Data Engineer - BI Data Products & Databricks (Channel) INR 1971K-3000KAWS | Amazon Redshift | Data Modeling | Data Observability | Data QualitySenior-level Full TimeBangalore, KA, IN, 56007610h ago
-
DE&A - AIML Generative AI FTE INR 1200K-2500KAI Agents | AI Evaluation | AI orchestration | API Gateway | AWSMid-level Full TimeBangalore, Karnataka, India11h ago
-
Senior-level Full TimeChennai, TN, India12h ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Amazon Redshift | Apache Airflow | CI/CDComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India12h ago