Senior Databricks Engineer
Tasks
- Apply data governance and best practices
- Architect scalable data pipelines
- Build ETL/ELT pipelines
- Collaborate with ML teams on LLM data workflows
- Design cloud-native data platforms
- Develop spark jobs
- Implement Delta Lake tables
- Implement data engineering solutions
- Improve data quality
- Orchestrate workflows with Apache Airflow
- Use Python for data processing
- Use SQL for data modeling
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Spark | Azure | Data Architecture | Databricks | Delta Lake | ELT | ETL | LLM | NLP | Python | SQL
Education
N/A
Related jobs
-
AI Software Engineer (Multimodal AI Agents) INR 1800K-3000KAWS | Azure | BERT | C Sharp | Deep learningEmployee assistance program | Learning and development | Medical insurance | Provident fund and gratuity | Wellness initiativesMid-level Full TimeChennai, Tamil Nadu (Hybrid) R15h ago
-
Software Engineer INR 3200K-4600KArtificial Intelligence | CI/CD | Data Compliance | Data Governance | Data pipelineMid-level Full TimePune, India R19h ago
-
Principal Software Engineer INR 3125K-4725KAI APIs | APIs | Distributed Systems | Intelligent Automation | JavaSenior-level Full TimeBangalore - Carina, India R19h ago
-
Principal Software Engineer INR 3375K-5000KAirflow | Artificial Intelligence | Automation | CI/CD | DBTSenior-level Full TimePune - Tower 6, India R19h ago
-
Lead Data Engineer INR 2000K-2040KBigQuery | Cloud Spanner | Cloud platform | Data Modeling | ETLAutonomy | Flexible work arrangements | Health and wellbeing benefits | Life balance support | OwnershipSenior-level Full Time(DEAI HD) IN Remote, India R19h ago
-
Lead BI/ML Developer – Conversational Analytics INR 2500K-3380KConversational AI | Data Modeling | Data Pipelines | Data Visualization | Embedded AnalyticsFlexible working hours | Health and wellbeing benefitsSenior-level Full Time(DEAI HD) IN Remote, India R19h ago
-
AI Agents | Agent Orchestration | Express | JavaScript | LangchainCommunity | Laptop provided | Medical insurance | Mentorship | No weekend workMid-level Full TimeIndia R1d ago
-
AI Engineer INR 2500K-4500KAI Agents | Amazon Web Services | Azure | Cloud platform | Deep learningSenior-level Full TimeAnywhere in India R1d ago
-
Senior Data Engineer INR 2500K-3380KAirflow | Apache Kafka | Apache Spark | Data Governance | Data ModelingGlobal team | Remote workSenior-level Full TimeIndia R1d ago
-
Senior Analytics Engineer – Product & Customer Analytics INR 2516K-3356KDBT | Data Documentation | Data Lineage | Data Modeling | Data QualityGlobal team collaboration | Remote-first work environmentSenior-level Full TimeIndia R1d ago
-
Staff Analytics Engineer – Customer Data Platform INR 2516K-3380KDBT | Data Architecture | Data Documentation | Data Modeling | Data TestingSenior-level Full TimeIndia R1d ago
-
Computational Algorithms | Computational problem-solving | Generative AI | Machine Learning | NumPyFlexible schedule | Part-time freelance | Portfolio building | Remote workMid-level FreelanceIndia - Remote R1d ago
-
Computational Algorithms | Generative AI | Machine Learning | NumPy | Numerical MethodsFlexible schedule | Part-time | Remote workMid-level FreelanceIndia - Remote R1d ago
-
Senior Data Engineer INR 2500K-3380KAI machine learning | Agile | CI/CD | Capacity Planning | Data Lifecycle ManagementSenior-level Full TimeIndia (home based) R1d ago
-
LLM | Langchain | MLOps | Matplotlib | NumPyFlexible schedule | Part-time freelance | Remote workMid-level FreelanceIndia - Remote R1d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeIndia - Remote R1d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeIndia - Remote R1d ago
-
Sr ETL Engineer INR 2040K-2800KApache Airflow | Apache Spark | Azure | Data Architecture | DatabricksRemote workSenior-level Full TimeIndia - Remote R1d ago
-
Data Engineer (L3) INR 3200K-3880KAWS | Agile | Apache Hudi | Azure | DBTDonation support | Generous time off | Healthcare | Parental leave | Remote-first workSenior-level Full TimeRemote - India R2d ago
-
Senior Staff Engineer,Azure Data Factory INR 2040K-2400KAzure Data | Azure Data Factory | Azure DevOps | Azure Integration | Azure Integration RuntimeSenior-level Full TimeRemote, India R2d ago
-
Staff Machine Learning Engineer INR 2520K-4500KAWS | Amazon Redshift | Big Data | Classification | ClusteringAdditional day off quarterly | Calm subscription | Employee assistance program | Extended parental leave | Flexible working hoursSenior-level Full TimeIndia R2d ago
-
Lead Systems Support Engineer (Python, AWS) INR 3222K-4600KAWS | Agile | Application Monitoring | Azure Pipelines | Buildkite24x7 on-call rotationSenior-level Full TimeBangalore, India; Hyderabad, India R2d ago
-
Databricks/ Pyspark Developer INR 500K-1400KApache Kafka | Azure Data | Azure Data Factory | Data Factory | DatabricksFlexible work hours | Remote workSenior-level Full TimeChennai, IN - Remote R2d ago
-
Senior GENAI Engineer INR 2500K-4500KAPI Integration | Azure OpenAI | CNN | Convolutional Neural Networks | EmbeddingsRemote work | Work from homeSenior-level Full TimeIndia - Remote R2d ago
-
Agentic AI Engineer INR 2500K-4500KAzure OpenAI | CNN | Embedding Models | Langchain | LanggraphRemote workSenior-level Full TimeIndia - Remote R2d ago