Databricks Lead – Delivery & Engineering
Tasks
- Build and optimize Spark and Delta Lake pipelines
- Build scalable ETL/ELT pipelines
- Design and implement Databricks Lakehouse platforms
- Develop Delta Lake data modeling bronze silver gold
- Develop data ingestion batch and streaming
- Ensure reliability scalability and observability of data pipelines
- Implement CI/CD
- Implement Databricks Jobs and Workflows
- Lead Databricks delivery
- Lead data engineering teams
- Optimize Spark workloads for performance and cost
- Optimize performance and DBU usage
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | CI/CD | Cloud Native | Cloud-native data engineering | Data Engineering | Data Lineage | Data Modeling | Data Quality | Databricks | Delta Lake | ELT | ETL | Lakehouse | Performance Tuning | PySpark | Spark SQL | Troubleshooting
Education
N/A
Roles
Big Data Engineer | Data Engineer | Databricks Lead | Engineer | Lead
Related jobs
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R4h ago
-
Manufacturing Data Analytics Technical Expert INR 1628K-2146KApache Hive | Apache Spark | Data Historian | Data analytics | Data integrationSenior-level Full TimeBangalore, Karnataka, IN, 5601005h ago
-
Senior Manager - Systems and Master Data Management Lead INR 600K-1500KAnalytics | Asset Management | CMMS | Change Management | Clean CoreSenior-level Full TimeIndia - Hyderabad11h ago
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India22h ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad22h ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R22h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago
-
Technical Program Manager, AI Agent Prototyping INR 1875K-3000KA/B | A/B Testing | B testing | Cloud Computing | Data QualityMid-level Full TimeBengaluru, Karnataka, India1d ago
-
GCP and Databricks Assistant Manager Hiring INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud FunctionsMid-level Full TimeBangalore, Karnataka, India1d ago
-
Finance - Analytics Finance - Associate INR 1960K-2461KCRM | Data Governance | Data Pipelines | Data Quality | Data StewardshipSenior-level Full TimeBengaluru1d ago
-
DE&A - Core - Big Data Engineering - ETL INR 2040K-2400KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud ArchitectureSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Agentic / GEN AI INR 2500K-4000KAI Foundry | AI Services | Agentic AI | Azure AI | Azure AI ServicesSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Manager Data Reliability Engineering INR 1500K-2000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeHyderabad1d ago
-
Lead, AI Engineer INR 2000K-4500KAI Assistants | API Integration | AWS | AWS Bedrock | AWS CDKBenefits | Bonus eligibility | Competitive pay | Equity | Hybrid work environmentSenior-level Full TimeAhmedabad, Gujarat1d ago
-
Sr. Data Engineer INR 3200K-4500KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeBengaluru, India1d ago
-
Database Engineer I INR 800K-1200KAgile | Amazon Web Services | Automation | Data Modeling | Database AdministrationSenior-level Full TimeIndia1d ago
-
Database Engineer II INR 1000K-1330KAmazon Web Services | Automation | Data Modeling | Database Administration | Database DesignSenior-level Full TimeIndia1d ago
-
Associate Data Scientist - AI/ML 1 Job INR 1500K-2000KData Modeling | Data Preprocessing | Data Visualization | Data cleaning | ExcelContinuous learning opportunities | Flexible work arrangements | Inclusive workplace | Stable employmentMid-level Full TimeHyderabad, IN1d ago
-
Principal Software Engineer - Linux, Filesystems & Storage INR 3375K-4590KAgile Scrum | C# | Device Drivers | Dm-crypt | File SystemSenior-level Full TimeBangalore - Carina, India R1d ago
-
Manager, Software Engineering - ML, NLP, Gen AI INR 1100K-1680KAWS | AWS Bedrock | Agile | Azure | Azure AIEqual employment opportunity | Flexible work schedule | Hybrid work environmentMid-level Full TimeGurgaon - Cyber Park, India1d ago
-
Software Engineer INR 1500K-1700KAWS | Apache Flink | Apache Spark | Data Modeling | ETLEmployee wellness programs | Hybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R1d ago
-
Data Engineer II - Decision Analytics INR 800K-1050KAWS Lambda | Agile | Amazon EC2 | Amazon EMR | Amazon KinesisAccess to learning courses | Adoption Assistance | Flexible benefits | Health and welfare insurance | Parental leaveMid-level Full TimeGurgaon, India1d ago
-
Artificial Intelligence | Business Intelligence | Data Quality | Data Science | Data VisualizationFlexibility programme | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago