Databricks Developer
Tasks
- Build Databricks notebooks
- Configure Databricks Jobs and workflows
- Configure notebook libraries and deployments
- Create reusable data assets
- Design data pipelines
- Develop ETL/ELT workflows
- Develop PySpark data transformations
- Implement CI CD for data engineering
- Implement Delta Lake solutions
- Implement Lakehouse medallion models
- Implement data governance and compliance controls
- Implement data modeling for reporting analytics and machine learning
- Implement data quality checks
- Ingest streaming data
- Integrate Databricks with cloud storage and services
- Integrate data from databases and APIs
- Manage Databricks clusters
- Manage metadata and data lineage
- Monitor and troubleshoot data processing issues
- Optimize Databricks performance and cost
- Write SQL queries and transformations
Perks/Benefits
- Company-Paid Holidays
- Dental insurance
- Disability insurance
- Employee assistance program
- Health insurance
- Life insurance
- Paid time off
- Retirement savings plan
- Sick leave
- Vision insurance
Skills/Tech-stack
Apache Spark | Bronze Silver Gold | CI/CD | Data Modeling | Databricks | Databricks Clusters | Databricks Jobs | Databricks Notebooks | Delta Lake | Delta Lakehouse | ELT | ETL | ETL pipeline | Lakehouse | Medallion Architecture | PySpark | SQL | Spark SQL | Streaming Data | Workflow
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States9h ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States9h ago
-
Senior-level Full TimeUnited States15h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California15h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R15h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York15h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois15h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA15h ago
-
Developer Advocate - AI & Developer Experiences USD 122K-175KAPIs | Agent Tool Calling | CI/CD | CLI tools | Command LineSenior-level Full TimeUS-CA-Menlo Park16h ago
-
Accounting Analytics & BI Engineer USD 220K-270KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working hours | Generous vacation | Health benefits | Hybrid work policy | Optional equity donation matchingMid-level Full TimeSan Francisco, CA R18h ago
-
Cloud Solutions Architect (AI Developer) USD 130K-260KAlgorithms | Amazon Web Services | C++ | Conda | Data Modeling401k employer match | Dedicated training budget | Employer Covered Dental Insurance | Employer Covered Disability Insurance | Employer Covered Vision InsuranceSenior-level Full TimeChantilly, VA18h ago
-
Senior Analytics Engineer, Marketing Sciences USD 100K-125KAmazon Kinesis | DBT | Docker | JSON | Kafka401k match | Dental insurance | Employee resource groups | Flexible time off | Life and disability insuranceSenior-level Full TimeUnited States R18h ago
-
Senior Analytics Engineer USD 111K-160KAirflow | Business Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Dental insurance | Fitness Center | Health insurance | Paid time offSenior-level Full TimeLehi, Utah19h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI Integration | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeRichmond19h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeDallas19h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-196KAPIs | AWS | AWS Glue | Amazon Redshift | Apache AirflowSenior-level Full TimeMinneapolis19h ago
-
AI Engineer/Scientist, Staff USD 185K-250KAPIs | Agent Frameworks | Argo CD | Attribution methods | CI/CD401k match | Comprehensive health coverage | Hybrid work environment | Paid Company Holidays | Parental leaveSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R19h ago
-
Sr Engineer, Data Engineering USD 30K-46KAmazon Web Services | Apache Spark | Azure | Data Lake | Data WarehouseSenior-level Full TimeRoswell, GA, United States19h ago
-
Data Engineer Intern USD 44K-54KBusiness Intelligence | Cloud Data | Cloud Data Warehouse | Data Modeling | Data VisualizationHybrid workEntry-level InternshipWeave - Headquarters (Lehi, UT) R20h ago
-
Machine Learning Engineer USD 161K-200KA/B | A/B Testing | B testing | Collaborative Filtering | Content-Based Filtering401k matching | Disability insurance | Fertility benefits | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA R20h ago
-
Data Scientist USD 132K-202KDBT | Data Engineering | Data pipeline | Databricks | Feature Engineering401k | Medical/Dental/Vision insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeWorcester, MA, United States R20h ago
-
Algorithm Engineer USD 150K-170KCI/CD | Deep learning | Digital Signal | Digital Signal Processing | DockerPTO | Remote workMid-level Full TimeBoston, MA / Remote R20h ago
-
Data Engineer USD 144K-153KAirflow | BigQuery | CI/CD | Code Reviews | DBT401k match | Half-day Fridays | Home Tickets | Medical, dental, vision benefits | Paid time offMid-level Full TimeSan Francisco, CA20h ago
-
Senior AI & Platforms Engineer USD 30K-84KAIOps | Asyncio | Autogen | CI/CD | CrewAIContract position | Local candidates required | Onsite work 3 days per weekSenior-level Contract Full TimeBrooklyn, NY, United States21h ago
-
Senior Engineer, Platform & Data USD 150K-200KAWS | Concurrency | Consistency | Containerization | Data Management401k | Employee insurance coverage | Flexible PTO | Stock optionsSenior-level Full TimeSanta Clara R21h ago