Databricks SME (Subject Matter Expert)
Tasks
- Build ETL/ELT workflows
- Design Databricks data platforms
- Ensure security compliance coding standards
- Implement Delta Lake
- Implement data governance
- Implement data quality frameworks
- Integrate Apache Spark with Databricks
- Mentor Databricks Spark teams
- Migrate legacy data platforms to Databricks
- Optimize Databricks pipelines
- Optimize data processing cost efficiency
- Optimize data processing performance
- Provide Databricks architecture guidance
- Troubleshoot production issues
- Tune Databricks performance
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Apache Spark | Azure | CI/CD | Cloud platform | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | DevOps | Google Cloud | Google Cloud Platform | Kafka | Lakehouse Architecture | PySpark | Python | SQL | Scala | Structured Streaming | Unity Catalog | Web Services
Education
N/A
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R29d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R29d ago
-
Access Control | Ansible | Apache Spark | CI/CD | CPU Resource ManagementConcierge services | Employee representative council support | Employee savings plan | Meal benefits | Paid leaveEntry-level Full TimeDAM Île-de-France R21h ago
-
Ansible | Apache Spark | CI/CD | CPU Scheduling | CompliancePaid leave | TeleworkEntry-level Full TimeDAM Île-de-France R21h ago
-
Generative AI / Sr. Associate Director, Tech SME INR 1400K-2200KAWS | Active Directory | Ansible | Azure | CI/CDMid-level Full TimePune, Maharashtra, India R23h ago
-
Data SME (Subject Matter Expert) USD 125K-155KAmazon Web Services | Business Intelligence | Cloud platform | Data Architecture | Data CleansingCareer advancement | Flexible working conditions | Professional development | Remote work | Supportive work environmentSenior-level ContractRemote R23h ago
-
AI tools | CI/CD | Cloud services | Dimensional Modeling | ETLHybrid workSenior-level ContractAustin, United States R23h ago
-
Azure Data engineer con inglés alto. EUR 30K-35KAzure Data | Azure Data Factory | Data Factory | Databricks | Microsoft AzureEnglish communication | Remote workEntry-level Full TimeMadrid, MD, Spain R1d ago
-
Tech Lead DataOps EUR 46K-60KAgile | Alerting | Apache Airflow | Automation | CI/CDAgile environment | Career growth | Fully remote | Multicultural teamSenior-level Full TimeMálaga, AN, Spain R1d ago
-
Data Engineer Lead | $140k-$175k + Hybrid + Equity | Exciting High Growth AI Operational Intelligence Startup A USD 140K-175KApache Airflow | Apache Kafka | DBT | Dagster | Data LineageEquity | Health insurance | Hybrid work | Medical insurance | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
Applied AI Engineer | $150K-$175K + Hybrid + Equity | High Growth AI Operational Intelligence Startup A USD 150K-175KAI Agents | AI orchestration | APIs | LLM | Model EvaluationEquity | Health medical and vision coverage | Hybrid work | One day per week onsite | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
AWS | Azure | CD pipelines | CI/CD | CI/CD pipelinesCareer growth | Flexible engagement | Fully remoteSenior-level Full TimeIndia R1d ago
-
Data Governance | Data Modeling | Data Quality | Data Security | Data WarehousingCareer growth | Collaborative environment | Continuous learning | Flexible day shift | Fully remote workSenior-level Full TimeIndia R1d ago
-
Associate AI Engineer (Entry Level) USD 100K-110KAPI Development | AWS | Agentic AI | Autogen | AzureEntry-level Full TimeRemote, Remote R1d ago
-
1094- AI Platform Engineer (Generative AI) USD 158K-168KAI Agents | AWS | CI/CD | DevOps | Generative AIIndependent contractor arrangement | International collaboration | Remote workSenior-level Full TimeRemote R1d ago
-
Software Development Engineer 4 INR 1500K-2800KAI Foundry | API Gateway | AWS Step Functions | Airflow | Amazon EventBridgeSenior-level Full TimeBangalore, India R1d ago
-
Sr. Data Engineer INR 2800K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | Batch ProcessingAnnual leave | Contributory pension scheme | Diversity forums | Hybrid work | Mindfulness app accessSenior-level Full TimePune, India R1d ago
-
Data Engineering Operations Lead INR 3000K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | BigQueryAnnual leave | Away from keyboard time | Contributory pension scheme | Diversity forums and networking groups | Fitness Wellbeing ProgrammesSenior-level Full TimePune, India R1d ago
-
API Integration | AWS | Agentic Systems | Azure | Cloud ArchitectureLong term engagement with stable business | Paid Holidays | Remote work | Training and professional growthSenior-level Full TimeMetro Manila, Philippines - Remote R1d ago
-
Senior Computer Scientist 1 INR 2475K-3800KAI orchestration | CI/CD | Cloud Platforms | Docker | Integration TestingSenior-level Full TimeNoida, India R1d ago
-
Machine Learning Engineer 4 INR 2000K-3465KAlgorithms | C++ | Computer Vision | Data Structures | Deep learningSenior-level Full TimeNoida, India R1d ago
-
Agent Frameworks | Deep learning | Distributed Systems | Fine Tuning | LLM InferenceEquity package | High-impact work | Hybrid schedule | Remote work optionSenior-level Full TimeRemote; New York, New York; Onsite R1d ago
-
GenAI Engineering INR 2200K-3500KAWS | Azure | Bias detection | Continuous Deployment | Data PrivacyHybrid work schedule | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India R1d ago
-
Salesforce & Omnichannel Data Analytics Lead (m/f/d) CHF 117K-176KCRM | Cause analysis | Dashboarding | Data Automation | Data ModelingFully remoteSenior-level Full TimeBern, Switzerland R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityMid-level Full TimeUnited States - Remote R1d ago