Senior Data Engineer - Databricks
Tasks
- Architect data migrations using Databricks
- Assess ETL jobs and workflows
- Build data pipelines and services
- Operate in dev test and prod environments
- Optimize performance reliability and scalability
- Reimplement existing data pipelines in Databricks
- Support agile software development lifecycle
- Support data governance
- Support data product integration and customization
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Alation | Apache Iceberg | Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | C++ | CI/CD | Collibra | Data Governance | Data Lake Storage | Data Lakehouse | Data Lakehouse Architecture | Databricks | Delta Lake | Delta Lakehouse | EC2 | GCP | Informatica EDC | Java | JavaScript | Lakehouse Architecture | PySpark | Python | RDS | S3 | SQL | Scala | Step Functions | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Agent Orchestration | Data Quality | Deep learning | Generative UI | GoSenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Context engineering | Deep learning | Dynamic Orchestration | Generative AI | Golang401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Data Quality | Deep learning | Experimentation | Golang | LLM EvaluationSenior-level Full TimeMountain View, CALIFORNIA, United States9h ago
-
Staff Partner Engineer, AI Partnerships USD 150K-206KAI integration | Agent Frameworks | Architecture | Cost Optimization | EvaluationGlobal travelSenior-level Full TimeNew York City, New York; San …10h ago
-
Staff Analytics Analyst, Full Stack (Revenue) USD 220K-280KAI enablement | Access Control | Apache Spark | BI Dashboards | DBTDental insurance | Employee stock purchase plan | Flexible spending wallet | Health insurance subsidized | Remote-firstSenior-level Full TimeRemote US R11h ago
-
Data Engine & Annotation Systems Engineer USD 130K-190KAPIs | Active Learning | Auto-labeling | Bash | Computer VisionMid-level Full TimeSan Francisco Bay Area11h ago
-
Customer Facing Applied AI Engineer, Retail Perception USD 106K-128KComputer Vision | Data Engineering | Data Pipelines | Data Validation | GitMid-level Full TimeSan Francisco Bay Area11h ago
-
Senior Computer Vision / Applied AI Engineer USD 150K-235KActive Learning | Annotation QA | Barcode Decoding | CUDA | Computer VisionSenior-level Full TimeSan Francisco Bay Area11h ago
-
Principal / Staff Robotics Perception Engineer USD 150K-261KC++ | CUDA | Camera Calibration | Depth Estimation | Edge inferenceSenior-level Full TimeSan Francisco Bay Area11h ago
-
Senior Machine Learning Engineer, Price Modeling USD 196K-227KData Analysis | Data Visualization | Machine Learning | Model Evaluation | PythonEmployee travel credits | Inclusion and belonging initiatives | Occasional travel | Remote eligibleSenior-level Full TimeUnited States12h ago
-
Machine Learning Ops Engineer USD 140K-175KAnomaly monitoring | Ansible | CI/CD | Infrastructure as Code | Kubernetes401k match | Annual Company Holidays | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States12h ago
-
Application Insights | Azure | Azure Monitor | BeautifulSoup | CI/CD401k | Dental insurance | Educational assistance | Health insurance | Open to remoteMid-level Full TimeNew York, United States R13h ago
-
Senior Data Platform Engineer USD 160K-220KAnalytics | CDC | Data Classification | Data Governance | Data Lake401k employer matching | Childcare reimbursement | Company events | Company-paid parking | Fertility treatment coverageSenior-level Full TimeSan Diego, CA, United States13h ago
-
Senior Embedded Firmware Engineer CAD 130K-180KARM Cortex | ARM Cortex-M | C# | CI/CD | CMakeEmployee resource groups | Generous time-off policies | Healthcare benefits | Retirement benefits | Reward and recognition programsSenior-level Full TimeUnited States13h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated testing | CI/CD | Data Versioning | Experimental Design | MLOpsDiscretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R14h ago
-
Senior-level Full TimeCincinnati, OH, United States15h ago
-
Mechanical Robotics Engineer USD 77K-130KAutomation Controls | CAD design | Cause analysis | Condition Monitoring | Current Signature AnalysisMid-level Full TimeLincolnton, NC, United States15h ago
-
Staff Embedded C++ Software Engineer - Robotics USD 90K-140KAgile | C++ | CI/CD | Debugging | Functional testingSenior-level Full TimeWestborough, MA15h ago
-
Sr. Systems Engineer - AI USD 141K-209KAlerting | Artificial Intelligence | Auto Scaling | Automation | Backup and RecoverySenior-level Full TimeKansas City, KS, United States15h ago
-
Data Analytics Engineer USD 139K-230KAWS | Azure | Azure Data | Azure Data Lake | Cloud platformDEI initiatives | Dental insurance | Medical insurance | Mental health support | Remote workSenior-level Full TimeRemote, United States R15h ago
-
Data Engineer USD 126K-208KAPI Integration | APIs | AWS | Amazon Redshift | Apache AirflowDEI initiatives | Dental insurance | Employee recognition program | Medical insurance | Mental health supportMid-level Full TimeRemote, United States R15h ago
-
Senior-level Full TimePleasanton, CA, United States16h ago
-
Software Engineer III – Data Platform USD 172K-201KAWS | Alerting | Ansible | Asynchronous processing | Azure401k match | Dental insurance | Employee assistance program | Flexible spending accounts | Health savings accountSenior-level Full TimeMountain View, California, United States16h ago
-
Data Engineer (Healthcare) USD 105K-130KAWS | AWS Redshift | Apache Airflow | Azure | Azure DataKnowledge sharing | Mentoring | Quarterly travel | Remote workMid-level Full TimeUSA, Remote; USA, Remote; USA, Remote R16h ago