DE&A - Databricks - Data Engineer, Platform Admin and Operations Support
Pune, Maharashtra, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Configure Databricks clusters
- Design data layouts for analytics
- Ensure platform stability
- Ensure storage performance
- Implement Delta Lake optimizations
- Implement preventive measures
- Manage high-severity incidents
- Monitor clusters and workflows
- Optimize cluster performance
- Perform root cause analysis
- Support Snowflake Databricks integration
- Troubleshoot production workloads
- Tune driver and executor settings
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Autoscaling | Cause analysis | Cluster management | Data Optimization | Databricks | Delta Lake | File Compaction | High Availability | Incident Management | Monitoring | On Demand | On Demand Instances | Partitioning | Performance Tuning | PySpark | Root Cause Analysis | Root cause | SQL | Scala | Snowflake | Spot instances | Storage Optimization | Troubleshooting | Z-Order
Education
N/A
Related jobs
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data ProcessingMid-level Full TimePune, Maharashtra, India R17h ago
-
AI Engineer INR 3000K-5000KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicMid-level Full TimePune, Maharashtra, India18h ago
-
Jr Data Engineer INR 360K-420KAWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEntry-level Full TimeBangalore North, India18h ago
-
Senior-level Full TimeBangalore, IN18h ago
-
Senior Consultant INR 2000K-2700KAzure Data | Azure Data Lake | Azure Databricks | Azure Machine Learning | Data LakeSenior-level Full TimeIN-KA-Bangalore19h ago
-
Apprentice-IT INR 360K-562KAPI | Data Architecture | Data Governance | Data Modeling | Data QualityEntry-level ApprenticeshipPune, Maharashtra, IND, 41101419h ago
-
Monitoring-Operations Support-Analytics and Reporting INR 938K-1300KAWS | Excel | ITIL | Incident Management | Microsoft PowerPointFlexible hoursEntry-level Full TimeHyderabad, Telangana, India20h ago
-
Mid-level Full TimeBangalore, Karnataka, India21h ago
-
DE&A - AI Engineer INR 2000K-3300KAPI Keys | AWS | Agent systems | Agentic Workflows | Anthropic APIMid-level Full TimeBangalore, Karnataka, India21h ago
-
Mid-level Full TimeBangalore, Karnataka, India21h ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Production Support Engineer - LoanIQ - Bangalore INR 3000K-5000KAPIs | Automation | Cause analysis | Incident Management | JavaSenior-level Full TimeIndia21h ago
-
Assistant Manager-KDNI INR 1500K-2000KAgile | Apache Spark | Azure | Azure Data | Azure Data FactoryMid-level Full TimeHyderabad, Telangana, India21h ago
-
Senior Consultant Specialist INR 3000K-5500KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data AnalysisSenior-level Full TimeBangalore, Karnataka, India R22h ago
-
Senior Data Systems Software Engineer INR 3264K-5572KAPI Integration | APIs | Agentic AI | C# | C++Senior-level Full TimeBENGALURU, KARNATAKA, India22h ago
-
Software Engineer I- Eng INR 300K-350KAWS | Agile | Automation | CI/CD | Cloud ComputingFlexible work arrangements | Health benefits | Mentorship | Paid time offEntry-level Full TimeNoida,UP,India R23h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101323h ago
-
AWS DMS | Amazon Bedrock | Amazon Kinesis | Amazon QuickSight | Amazon SageMakerFlexible shifts | Long-term career growth | Mentorship and community | No weekend work | Remote workSenior-level Contract Full TimeDelhi R23h ago
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN23h ago
-
Sr. Specialist , Data Engineering INR 2520K-3380KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN23h ago
-
DevOps Engineer INR 1500K-2700KAWS | Ansible | Azure | Bash | Best practicesHealth insurance | Paid parental leave | Paid sick leave | Work from OfficeMid-level Full TimeBengaluru1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 2500K-4400KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Analytics Modeler INR 1500K-2800KARIMA | Data Visualization | Generative AI | GitHub Copilot | Hypothesis TestingMid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Software Development Engineer INR 1430K-2200KAPIs | Agile | Anonymization | Batch Job Scheduling | Batch jobMid-level Full TimeChennai, Tamil Nadu, India1d ago