Databricks SME (Subject Matter Expert)
Tasks
- Build ETL/ELT workflows
- Design Databricks data platforms
- Ensure security compliance coding standards
- Implement Delta Lake
- Implement data governance
- Implement data quality frameworks
- Integrate Apache Spark with Databricks
- Mentor Databricks Spark teams
- Migrate legacy data platforms to Databricks
- Optimize Databricks pipelines
- Optimize data processing cost efficiency
- Optimize data processing performance
- Provide Databricks architecture guidance
- Troubleshoot production issues
- Tune Databricks performance
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Apache Spark | Azure | CI/CD | Cloud platform | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | DevOps | Google Cloud | Google Cloud Platform | Kafka | Lakehouse Architecture | PySpark | Python | SQL | Scala | Structured Streaming | Unity Catalog | Web Services
Education
N/A
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R29d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R29d ago
-
Senior AI & ML Engineer USD 194K-228KAPIs | Agent Orchestration | Agent routing | Agents SDK | Cloud infrastructureSenior-level Full TimeUnited States - Remote R17h ago
-
Senior MLOps Engineer (Full Remote from France) EUR 55K-70KArgoCD | Bash | BigQuery | CI/CD | Cloud StorageFull remote workSenior-level Full TimeParis, IDF, France R18h ago
-
Data Engineer PHP 420K-480KAPI Development | AWS | Amazon Web Services | Apache Airflow | Apache SparkGlobal Training Network | Health insurance | Mentorship | Sports discount | Sports voucherMid-level Full TimeAlabang, Philippines (Hybrid) R20h ago
-
Ingénieur de recherche Bioinformatique EUR 30K-34KATAC sequencing | Clustering | Comparative Genomics | High Performance | High-Performance ComputingFamily health insurance | Meal benefits | RTT benefits | Sports facilities | TeleworkEntry-level Full TimeFrance, Paris R21h ago
-
Access Control | Ansible | Apache Spark | CI/CD | CPU Resource ManagementConcierge services | Employee representative council support | Employee savings plan | Meal benefits | Paid leaveEntry-level Full TimeDAM Île-de-France R22h ago
-
Ansible | Apache Spark | CI/CD | CPU Scheduling | CompliancePaid leave | TeleworkEntry-level Full TimeDAM Île-de-France R22h ago
-
AI Savvy Data Analyst MXN 480K-480KAnomaly Detection | Cloud APIs | Data Governance | Data Management | Data ModelingAdditional day off for birthday | Competitive benefits package | Flex days | Flexible work hours | Remote workMid-level Full TimeGuadalajara, Jalisco, Mexico R22h ago
-
AI Savvy Data Analyst USD 127K-220KAnomaly Detection | Cause analysis | Cloud APIs | Colab | Data GovernanceAdditional day off for birthday | Competitive benefits package | ESG focused company | Flex days between Christmas and New Year | Flexible work hoursMid-level Full TimeDenver, CO, United States R23h ago
-
Generative AI / Sr. Associate Director, Tech SME INR 1400K-2200KAWS | Active Directory | Ansible | Azure | CI/CDMid-level Full TimePune, Maharashtra, India R1d ago
-
Data SME (Subject Matter Expert) USD 125K-155KAmazon Web Services | Business Intelligence | Cloud platform | Data Architecture | Data CleansingCareer advancement | Flexible working conditions | Professional development | Remote work | Supportive work environmentSenior-level ContractRemote R1d ago
-
AI tools | CI/CD | Cloud services | Dimensional Modeling | ETLHybrid workSenior-level ContractAustin, United States R1d ago
-
Azure Data engineer con inglés alto. EUR 30K-35KAzure Data | Azure Data Factory | Data Factory | Databricks | Microsoft AzureEnglish communication | Remote workEntry-level Full TimeMadrid, MD, Spain R1d ago
-
Tech Lead DataOps EUR 46K-60KAgile | Alerting | Apache Airflow | Automation | CI/CDAgile environment | Career growth | Fully remote | Multicultural teamSenior-level Full TimeMálaga, AN, Spain R1d ago
-
AWS | Azure | CI/CD | CircleCI | CloudFormationCareer growth | Collaborative innovation driven engineering culture | Continuous learning | Fully remote friendly work environment | MentorshipSenior-level Full TimeIndia R1d ago
-
Data Engineer Lead | $140k-$175k + Hybrid + Equity | Exciting High Growth AI Operational Intelligence Startup A USD 140K-175KApache Airflow | Apache Kafka | DBT | Dagster | Data LineageEquity | Health insurance | Hybrid work | Medical insurance | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
Apache Spark | CI/CD | Cloud platform | DBT | DatabricksDental insurance | Education Discounts | Fully remote work | Health insurance | Healthcare service discountsSenior-level Full TimeBrazil R1d ago
-
Applied AI Engineer | $150K-$175K + Hybrid + Equity | High Growth AI Operational Intelligence Startup A USD 150K-175KAI Agents | AI orchestration | APIs | LLM | Model EvaluationEquity | Health medical and vision coverage | Hybrid work | One day per week onsite | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
AWS | Azure | CD pipelines | CI/CD | CI/CD pipelinesCareer growth | Flexible engagement | Fully remoteSenior-level Full TimeIndia R1d ago
-
Data Governance | Data Modeling | Data Quality | Data Security | Data WarehousingCareer growth | Collaborative environment | Continuous learning | Flexible day shift | Fully remote workSenior-level Full TimeIndia R1d ago
-
Associate AI Engineer (Entry Level) USD 100K-110KAPI Development | AWS | Agentic AI | Autogen | AzureEntry-level Full TimeRemote, Remote R1d ago
-
1094- AI Platform Engineer (Generative AI) USD 158K-168KAI Agents | AWS | CI/CD | DevOps | Generative AIIndependent contractor arrangement | International collaboration | Remote workSenior-level Full TimeRemote R1d ago
-
Software Development Engineer 4 INR 1500K-2800KAI Foundry | API Gateway | AWS Step Functions | Airflow | Amazon EventBridgeSenior-level Full TimeBangalore, India R1d ago
-
Sr. Data Engineer INR 2800K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | Batch ProcessingAnnual leave | Contributory pension scheme | Diversity forums | Hybrid work | Mindfulness app accessSenior-level Full TimePune, India R1d ago