Databricks Platform & Data Engineer
Tasks
- Build batch and streaming data pipelines with Spark and Delta Lake
- Contribute to CoE accelerators frameworks and reusable assets
- Deliver use cases from requirements to production deployment
- Design and deploy Databricks Lakehouse platforms
- Develop data products and domain oriented pipelines
- Establish Unity Catalog governance and role based access
- Implement CI CD and environment promotion automation
- Implement platform standards reusable patterns guardrails
- Improve data quality observability and pipeline reliability
- Lead client workshops and solution design sessions
- Mentor junior engineers
- Optimize platform performance cost reliability
- Translate business requirements into data platform architecture and roadmaps
Perks/Benefits
- 401k match
- Dental insurance
- Employee assistance program
- Flexible spending account
- Health savings account
- Life insurance
- Long-term disability
- Medical insurance
- Paid time off
- Short-term disability
- Vision insurance
Skills/Tech-stack
AWS | Access Control | Apache Spark | Azure | CI/CD | Cost Optimization | Data Governance | Data Lineage | Data Quality | Databricks | Delta Lake | GCP | Kafka | Lakehouse | Observability | Python | Role-Based Access | Role-Based Access Control | Scala | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Low Power Design Methodology and Optimization Engineer USD 192K-278KANSYS | C# | C++ | CPU Benchmarking | CPU microarchitectureSenior-level Full TimeAustin, TX, USA2h ago
-
Senior Data Engineer, Databricks USD 119K-145KApache Spark | Asset bundles | Auto Loader | Azure Data | Azure Data Factory401k company match | Accrued vacation time off | Dental insurance | Long-term disability | Medical insuranceSenior-level Full TimeDENVER, CO, US8h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 190K-252KAnomaly Detection | Bayesian Filtering | Big Data | C# | C++Health benefits | Recovery BenefitsSenior-level Full TimeFort Collins, Colorado, United States14h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Senior-level Full TimeWashington, District of Columbia, United States14h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Competitive benefits | Employee assistance program | Health insurance | Recovery BenefitsSenior-level Full TimeWaltham, Massachusetts, United States14h ago
-
Software Engineer, Robotics Tracking and Fusion USD 165K-218KAnomaly Detection | Bayesian Filtering | C# | C++ | ClassificationHealth benefits | Paid time off | Recovery Benefits | Relocation assistance | U S Top Secret clearance supportMid-level Full TimeFort Collins, Colorado, United States15h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee benefits | Health and Recovery Support | Health benefits | Paid time offMid-level Full TimeWashington, District of Columbia, United States15h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee assistance | Flexible time off | Health benefits | Recovery supportMid-level Full TimeWaltham, Massachusetts, United States15h ago
-
Lead Machine Learning Engineer USD 139K-304KAI Services | Agile | Azure AI | Azure AI Services | Azure Container401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States16h ago
-
Behavior planning | C++ | Computer Vision | Control Systems | IMUEquity compensation | In-office work schedule | Relocation assistance | Visa sponsorship for transfersSenior-level Full TimeSan Francisco, California, United States1d ago
-
Agentic Workflows | Automation | Data integration | Enterprise Integration | GenAIMedical/Dental/Vision insurance | Unlimited PTO | Wellness stipendMid-level Full TimeSan Francisco, California, United States1d ago
-
AWS | Adversarial Machine Learning | Azure | Bias and fairness | C++401k profit sharing | Dental insurance | Education reimbursement | Employee referral incentive | Flexible spending accountsSenior-level Full TimeHuntsville, Alabama, United States1d ago
-
Consultant (LLM/AI Skillset) USD 110K-160KAPI Development | Agile | Language Models | Large Language Models | Machine LearningMid-level Full TimeDallas, Texas, United States1d ago
-
System Software Engineer (Embedded) USD 175K-275KBSP | C++ | Cluster Orchestration | Device Drivers | Distributed SystemsJob stability | Startup vitalitySenior-level Full TimeHeadquarters/Sunnyvale Office1d ago
-
Agent systems | Enterprise Data | Fine Tuning | LLM Fine-tuning | Language ModelsRemote workSenior-level Full TimeAustin R1d ago
-
Senior Data Analytics Engineer USD 175K-214KBusiness Intelligence | Dashboard Development | Data Engineering | Data Pipelines | Data QualitySenior-level Full TimeSan Francisco, CA1d ago
-
Senior-level Full TimePalo Alto, CA1d ago
-
Robotics Field Engineer USD 90K-160KAWS | Data Visualization | Electromechanical troubleshooting | Grafana | Laboratory automation401k company match | Flexible PTO | Green card sponsorship | H1B sponsorship | Medical, dental, vision plansMid-level Full TimeLos Angeles1d ago
-
Senior Software Engineer, Robotics Platform USD 160K-265KC# | C++ | CUDA | DDS | Embedded SystemsHigh ownership team | On site five days a week | Real production impactSenior-level Full TimeSan Francisco1d ago
-
Spacecraft Embedded Software Engineer, RTOS USD 131K-184KBare Metal | C++ | Computer Architecture | Computer Networking | Data Structures401k employer match | Flexible PTO | HSA matching | Medical, dental, and vision insurance | Paid HolidaysEntry-level Full TimeEl Segundo, California, United States1d ago
-
Senior Spacecraft Embedded Software Engineer, RTOS USD 169K-216KBare Metal | C++ | Computer Architecture | Computer Networking | Critical software401k match | Cell phone reimbursement | Complimentary EV charging | FSA option | Flexible PTOSenior-level Full TimeEl Segundo, California, United States1d ago
-
Manager, Data Engineering USD 120K-165KAgile | BigQuery | Bitbucket | CI/CD | Cloud StorageBonus Incentive Opportunities | In-office collaborationSenior-level Full TimeSouthlake, TX, United States1d ago
-
Title: Principal AI Engineer – Agentic AI | Contract to Hire | Irvine, CA (Hybrid) | AS A USD 122K-168KAWS | Agent Orchestration | Agentic AI | Embeddings | Function CallingSenior-level Full TimeIrvine, CA; Irvine, CA1d ago
-
Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) | A USD 147K-170KAWS RDS | Airflow | Amazon EMR | Amazon Redshift | Amazon Web ServicesContract-to-hire | Hybrid work | Mentorship opportunitiesSenior-level Full TimeIrvine, CA R1d ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeFort Lauderdale, United States2d ago