Databricks Data Engineer
Anywhere USA, United States
R
USD 129K-215K (estimate) Mid-level Full Time
Tasks
- Build ETL and ELT pipelines
- Configure Databricks Workflows
- Design Lakehouse architecture
- Design semantic layers
- Develop PySpark and Spark SQL jobs
- Document architectures and runbooks
- Implement CI CD pipelines for Databricks assets
- Implement Databricks Genie
- Implement Delta Live Tables
- Implement Unity Catalog governance and lineage
- Implement data quality checks
- Integrate Databricks with cloud and data platforms
- Lead Databricks implementations
- Optimize Databricks performance and cost
- Support client workshops and POCs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Asset bundles | Azure | CI/CD | DBT | Data Quality | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Jobs | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | GCP | Git | Kafka | Lakehouse | MLflow | PySpark | Python | SQL | Snowflake | Spark SQL | Spark Structured Streaming | Structured Streaming | Terraform | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer USD 81K-97KAWS | AWS Lambda | Apache Airflow | CI/CD | DBT401k | Flexible spending accounts | Health/vision/dental insurance | Hybrid work model | Paid disability benefitsMid-level Full TimeChicago - RAPP R13h ago
-
AWS | Anomaly Detection | Databricks | Docker | Explainability401k | Dental insurance | Equity compensation | Healthcare | Paid time offSenior-level Full TimeSan Francisco (Remote) R14h ago
-
Senior Software Engineer USD 107K-150KAWS | Agile | Datadog | GitHub | GitHub ActionsOn-call rotation | Remote workSenior-level Full TimeCosta Mesa, CA, United States R14h ago
-
Senior AI Product Engineer, Frameworks USD 166K-225KAgentic Workflows | Anthropic API | Chunked HTTP | Context Management | Data Processing401k plan | Healthcare concierge services | Hybrid work model | In office Tuesday through Thursday | Life and disability insuranceSenior-level Full TimeHybrid - San Francisco R14h ago
-
Quantitative Developer USD 135K-150KAPI Integration | C# | Compliance | Financial Data | Java401k match | Educational reimbursement | Gym subsidy | Health benefits | PTOMid-level Full TimeRemote - US R14h ago
-
Early-Career Network Engineer (RAN Optimization) USD 85K-130K4G | 5G | Automation | C Band | CBRS401k match | Dental insurance | Disability insurance | Educational assistance | Financial wellness programsMid-level Full TimePlano,Texas,United States R14h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R15h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R16h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R16h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R17h ago
-
AI/ML Engineer USD 170K-220KBenchmarking | Cloud Computing | Containerization | Debugging | Distributed Systems401k match | Education & training benefits | Healthcare dental vision coverage | Paid Holidays | Paid time offSenior-level Full TimeRome, NY R18h ago
-
Case design | Data Integrity | Database Testing | Database optimization | Defect ReportingSenior-level Full TimeAustin, TX R18h ago
-
Principal Software Engineer - Data Infrastructure USD 266K-425KAPIs | Architecture | Batch Processing | Data Infrastructure | Data ModelingSenior-level Full TimeRemote - USA R20h ago
-
Software Engineer, Machine Learning USD 213K-293KAPI Design | Agent Orchestration | Artificial Intelligence | Bias Mitigation | C++Senior-level Full TimeSunnyvale, CA | Remote, US | … R20h ago
-
Senior AI Data Engineer USD 155K-185KApache Airflow | Apache Spark | Azure Synapse | BigQuery | ClickHouseEmployer paid Medical Dental Vision Insurance | Flexible paid time off | Manager check ins | Paid cell phone and service | Paid parental leaveSenior-level Full TimeRemote - United States R1d ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS Glue | AWS IAM | Amazon EMR | Amazon S3 | AmundsenDevelopment dollars | Employee stock purchase program | Family-forming benefits | Financial coaching | Flexible time offSenior-level Full TimeRemote, USA R1d ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS EMR | AWS Glue | AWS IAM | AWS S3 | Apache AirflowDevelopment dollars | Financial coaching | Flexible remote work | Flexible time off | Free therapy sessionsSenior-level Full TimeRemote, USA R1d ago
-
Staff Machine Learning Engineer USD 189K-389KCalibration | Contextual Bandits | Contextual Decisioning | Data Validation | EmbeddingsEquity eligible | In Office 1 Day Per WeekSenior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Principal AI/ML Engineer USD 165K-226KC# | C++ | CI/CD | CUDA | Computer Vision401k match | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeRemote PA - PA PAR, United … R1d ago
-
AV Safety Engineering Analytics Engineer (GPSSC) USD 160K-246KCI/CD | Dash | Docker | GitHub | JenkinsRemote workMid-level Full TimeWork From Home - United States, … R1d ago
-
Agile | C++ | Deep learning | Distributed Computing | GPU ComputingDiscretionary bonus | Flexible time off | Healthcare | Leave benefits | Retirement benefitsExecutive-level Full TimeNY7 - 50 Hudson Yards, New … R1d ago
-
Lead Data Engineer USD 224KApache Airflow | Apache Beam | BigQuery | CI/CD | CMEK401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Senior Software Engineer, AI USD 171K-210KAirflow | Amazon Web Services | Apache Hive | Apache Impala | C#Career development access | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-California-Remote, United States R1d ago
-
Senior Software Engineer USD 144K-192KAWS | Angular | Apache Spark | Azure | BuildahCareer development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago