Senior Databricks Engineer
Tasks
- Apply data warehousing dimensional modeling
- Automate Databricks deployments with CI CD
- Build PySpark and SQL ETL ELT jobs
- Conduct code reviews and mentor engineers
- Deploy Databricks data pipelines
- Design scalable data pipelines
- Develop Databricks Delta Live Tables pipelines
- Develop data infrastructure
- Develop native Databricks dashboards
- Develop reusable Python libraries
- Establish data quality standards
- Implement Slowly Changing Dimensions
- Implement medallion architecture
- Implement structured streaming pipelines
- Integrate data ingestion from REST APIs
- Manage infrastructure as code
- Monitor data quality dashboards
- Share data with external BI tools
- Tune Spark jobs and Databricks clusters
Perks/Benefits
- 401k matching
- Dental insurance
- Flexible spending accounts
- Health insurance
- Paid Holidays
- Paid time off
- Remote work
- Vision insurance
Skills/Tech-stack
Asset bundles | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | CI/CD | Data Lake Storage Gen2 | Data Quality | Data Vault | Data Vault 2.0 | Data Warehousing | Data quality monitoring | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Delta | Databricks Delta Live Tables | Delta Lake | Delta Live Tables | Dimensional Modeling | Elasticsearch | Git | HTTP | Infrastructure as Code | Jupyter Notebooks | Key Vault | Lucene | Medallion Architecture | Oracle PL | Oracle PL/SQL | PL/SQL | PeopleSoft | Power BI | PySpark | Python | Quality monitoring | REST APIs | SAP BusinessObjects | SQL | Slowly Changing Dimensions | Solr | Structured Streaming | Tableau | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R14d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R14d ago
-
EVERGREEN AI Software Engineering Teaching Experts USD 80K-160KCSS | Express.js | Git | HTML | JavaScriptFlexible schedule | Remote work | Training in mentoring techniquesSenior-level Full TimeRemote, Remote, BR R6h ago
-
API Integration | AWS ACM | Agile | Alerting | AnsibleCross-functional workshops | Hybrid work | Professional mentorship | Remote work flexibilitySenior-level ContractPittsburgh, United States R7h ago
-
Senior Staff Applied ML Engineer CAD 360K-380KAPIs | Amazon SageMaker | Classification | Dimensionality Reduction | EmbeddingsSenior-level Full TimeCanada, Remote R14h ago
-
Senior AI Engineer AUD 142K-163KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy in role | Learning and development programs | Mentorship cultureSenior-level Full TimeMelbourne, Australia R15h ago
-
Associate Director, Biostatistics & AI USD 173K-217K21 CFR | 21 CFR Part 11 | ADaM | Adaptive Design | Annex 11401k employer match | Company provided life and disability | Comprehensive health care | Employee stock purchase program | Flex Spending AccountsMid-level Full TimeRemote - USA R20h ago
-
Autonomy | C++ | CPU GPU | CPU/GPU Optimization | DDS401k | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R20h ago
-
Senior Computational Fluid Dynamics Engineer USD 100K-190KANSYS-FLUENT | Computational Fluid Dynamics | Data Preprocessing | Data postprocessing | Fluid Dynamics401k | Bonuses | Equity | FSA | Flexible time offSenior-level Full TimeSanta Clara, CA or Remote R20h ago
-
AI Engineer INR 2000K-4500KAI SDK | AWS | Accelerate | Autogen | AzureDisconnect week | Flexible working hours | Health insurance | Learning budget | MacBookSenior-level Full TimeIndia - Remote R20h ago
-
Anomaly Detection | Azure Data | Azure Data Factory | CI/CD | ClaudeFlexible schedule | Remote workSenior-level Full TimePhilippines - Remote R20h ago
-
Freelance Machine Learning Engineer USD 116K-116KLangchain | MLOps | NumPy | Pandas | Prompt engineeringPart time flexible scheduling | Project based workMid-level FreelanceRomania - Remote R20h ago
-
Machine Learning Developer (Freelance) USD 116K-116KLangchain | MLOps | Machine Learning | NumPy | PandasFreelance opportunities | Part-time availability | Project based workMid-level FreelanceFrance - Remote R20h ago
-
Langchain | MLOps | NumPy | Pandas | Prompt engineeringFlexible schedule | Part-time opportunities | Project based workMid-level FreelanceSpain - Remote R20h ago
-
Freelance Machine Learning Engineer USD 68K-68KLLMs | Langchain | MLOps | Machine Learning | NumPyPart-time opportunity | Project based workMid-level FreelanceItaly - Remote R20h ago
-
Freelance Machine Learning Engineer USD 110KLangchain | Language Models | Large Language Models | MLOps | NumPyFreelance opportunities | Paid per project | Part-time project-based workMid-level FreelanceUnited Kingdom - Remote R20h ago
-
LLMs | Langchain | MLOps | NumPy | PandasProject based workMid-level FreelanceAustralia - Remote R20h ago
-
Data Analysis | Deep learning | GenAI | Langchain | Language ModelsFreelance project-based work | Part-time hours | Project-based compensationMid-level FreelanceUnited States - Remote R20h ago
-
Freelance Machine Learning Engineer USD 180KLLMs | Langchain | MLOps | Machine Learning | NumPyFreelance engagement | Part-time project-based workMid-level FreelanceUnited States - Remote R20h ago
-
LLM | Langchain | MLOps | Machine Learning | Model DeploymentFreelance project work | Part-time schedule | Project-based paymentsMid-level FreelanceUnited Kingdom - Remote R20h ago
-
Freelance Machine Learning Engineer USD 116K-116KLLMs | Langchain | MLOps | NumPy | PandasFreelance assignments | Part-time project-based workMid-level FreelanceIreland - Remote R20h ago
-
Freelance Machine Learning Engineer USD 116K-116KLangchain | Language Models | Large Language Models | MLOps | NumPyFlexible weekly hours | Part-time project-based workMid-level FreelanceGermany - Remote R20h ago
-
Freelance Machine Learning Engineer CAD 110KLLMs | Langchain | MLOps | Machine Learning | NumPyFlexible schedule | Part-time availability | Project based workMid-level FreelanceCanada - Remote R20h ago
-
Freelance Machine Learning Engineer AUD 110KLLMs | Langchain | MLOps | Machine Learning | NumPyPart-time availability | Project based workMid-level FreelanceAustralia - Remote R20h ago
-
Machine Learning Developer (Freelance) USD 116K-116KLLM | Langchain | MLOps | NumPy | PandasEnglish CV submission required | Flexible project hours | Freelance project-based work | Part-time availabilityMid-level FreelanceRomania - Remote R20h ago