AI/ML Data Engineer (Databricks)
US - CA - San Diego - Summers Ridge, United States
R
USD 70K-80K Mid-level Full Time
Tasks
- Automate data and machine learning workflows with CI CD
- Design build and optimize data pipelines in Databricks
- Develop Apache Spark data processing jobs
- Identify AI ML use cases with business stakeholders
- Implement ETL ELT and orchestrate workflows
- Implement data security, governance, and compliance
- Integrate data sources with Azure Data Factory
- Maintain documentation for workflows and best practices
- Monitor troubleshoot and resolve Databricks workflow issues
- Support model training tuning and deployment with Databricks and Azure Machine Learning
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Employee assistance program
- Employee stock purchase plan
- Life insurance
- Medical insurance
- Paid Holidays
- Paid time off
- Vision insurance
Skills/Tech-stack
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | Data Factory | Data Governance | Data Lake | Data Security | Databricks | Databricks Delta | Databricks Delta Lake | Databricks Runtime | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | MLflow | Machine Learning | Python | Scala | Synapse Analytics | Unity Catalog
Education
Roles
AI | AI/ML Data Engineer | Data Engineer | Engineer | ML Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Databricks Solution Architect USD 180K-247KAWS S3 | Apache Spark | Autoscaling | Azure Data | Azure Data LakeSenior-level Full TimeUnited States R8h ago
-
C++ | Cloud Computing | Code Reviews | Deployment Automation | Distributed Systems401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R12h ago
-
Manager, AI Engineering - Analytics USD 197K-267KAgent systems | Artificial Intelligence | Data Modeling | Data Warehousing | EvalsHybrid work flexibility | Professional growth opportunities | Stock equity | Work-life balanceMid-level Full TimeHybrid - San Francisco R13h ago
-
Machine Learning Operations Engineer USD 133K-167KAWS SageMaker | Docker | GitHub Actions | Machine Learning | NumPyCareer development | Communities | Commuting cost coverage | Corporate giving programs | Daily free lunchMid-level Full TimeBoston, Massachusetts, United States R13h ago
-
Senior-level Full TimeRemote - United States R14h ago
-
AI Solutions Manager, Digital Native USD 140K-175KAI Observability | AI systems | CRM | Customer Success | Data Infrastructure401k | Medical/Dental/Vision | Mental wellness support | Parental leave | Unlimited paid time offMid-level Full TimeRemote (San Francisco) R14h ago
-
Forward Deployed AI Engineer, West USD 125K-175KAWS | Azure | Docker | GCP | Generative AI401k plan | Dental insurance | Medical insurance | Parental leave | Unlimited paid time offMid-level Full TimeRemote (San Francisco) R17h ago
-
Senior Machine Learning Engineer, Reinforcement Learning USD 150K-250KDomain Randomization | Embedded Systems | Gazebo | Isaac-Gym | Mujoco401k retirement plan | Dental insurance | Employee referral bonus | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R17h ago
-
Senior Data Platform Engineer USD 140K-220KApache Hudi | Apache Spark | CI/CD | Delta Lake | Distributed StorageSenior-level Full TimePittsburgh, PA or Remote R18h ago
-
Staff Software Engineer, Data Platform USD 170K-240KAPI Design | Backend Services | Frontend Development | JavaScript | Node.js401k match | Dental insurance | Equity stock options | Health insurance | Learning GrantSenior-level Full TimeRemote - USA R18h ago
-
Senior Engineer - Data Platform USD 148K-201KAirgapped environments | CI/CD | CRD | ConnectRPC | Consistency models401k retirement plan | Conference support | Dental insurance | Disability insurance | Flexible time offSenior-level Full TimeRemote, United States R18h ago
-
Associate Engineer - Data Platform USD 102K-138KAI Assisted Development | Command Line | Command-line Interface | Containerization | Docker401k retirement plan | Conferences travel lodging fees | Dental & vision insurance | Disability insurance | Flexible time offMid-level Full TimeRemote, United States R19h ago
-
Data Science Engineer (Shreveport, LA) USD 37K-40KData Historian | Data Visualization | Data analytics | Excel | Machine Learning401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeAtlanta, GA, United States R21h ago
-
C++ | CUDA | CUDA kernels | Concurrency | Distributed SystemsSenior-level Full TimePittsburgh, PA or Remote R21h ago
-
C++ | CUDA | Data parallelism | GRPC | GoSenior-level Full TimePittsburgh, PA or Remote R21h ago
-
Staff Machine Learning Engineer, Underwriting and Credit USD 276K-415KA/B | A/B Testing | AWS | Airflow | B testingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of … R22h ago
-
ML Engineer USD 138K-225KAnomaly Detection | Artificial Intelligence | Data Pipelines | Feature Stores | Fine TuningEquity | Flexible work schedule | Holidays | Home office setup | Medical benefitsSenior-level Full TimePalo Alto, CA R1d ago
-
Director, Data Science: Data Science Tools USD 123K-201KAI Agents | Airflow | Bash | Celery | DashHybrid work schedule | Occasional travel | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R1d ago
-
BI Analytics Engineer USD 113K-165KAgile | Azure | CI/CD | Data Modeling | Data PipelinesHealth and welfare benefits | Hybrid work | Paid time off | Retirement benefits | Unpaid time offSenior-level Full TimeMoon Township, Pennsylvania, USA, 15108 R1d ago
-
AWS | Agent systems | Agentic Workflows | Azure | ClaudeCertification support | Continuous learning | Equity incentives | Fully remote within Canada | Knowledge sharingSenior-level Full TimeCanada R1d ago
-
Principal Research Data Engineer USD 142K-185KAirflow | Analytical processing | ArcGIS | Avro | CI/CDDental | Health care | PTO | Retirement | Sick leaveSenior-level Full TimeSt. Louis, Missouri, US R1d ago
-
Mid-level Full TimeScott AFB, IL, United States R1d ago
-
Machine Learning Engineer (Active Secret Clearance) USD 160K-190KAgile | Asynchronous programming | CI/CD | Data Engineering | Docker401k plan | FSA | Fully remote work | HSA | Hybrid onsite optionMid-level Full TimeRemote; Tacoma, WA R1d ago
-
Cloud Storage | Compute Orchestration | Computer Vision | Data Lineage | Data PipelinesEnd-to-end responsibility | Fast-paced startup environment | High autonomy | Onsite work | OwnershipMid-level Full TimeSan Mateo, CA; Onsite R1d ago
-
Principal Optimization Engineer USD 117K-234KCONOPT | Cloud Computing | Convergence analysis | Discrete Optimization | Fluid modelingHealth care benefits | Hybrid remote option | Paid Holidays | Paid sick days | Paid vacationSenior-level Full TimeCAG10: ALC HQ, 1025 Cobb Place … R1d ago