Senior Data Engineer - Databricks
Tasks
- Architect data migrations using Databricks
- Assess ETL jobs and workflows
- Build data pipelines and services
- Operate in dev test and prod environments
- Optimize performance reliability and scalability
- Reimplement existing data pipelines in Databricks
- Support agile software development lifecycle
- Support data governance
- Support data product integration and customization
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Alation | Apache Iceberg | Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | C++ | CI/CD | Collibra | Data Governance | Data Lake Storage | Data Lakehouse | Data Lakehouse Architecture | Databricks | Delta Lake | Delta Lakehouse | EC2 | GCP | Informatica EDC | Java | JavaScript | Lakehouse Architecture | PySpark | Python | RDS | S3 | SQL | Scala | Step Functions | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Agent Orchestration | Data Quality | Deep learning | Generative UI | GoSenior-level Full TimeMountain View, CALIFORNIA, United States9h ago
-
Context engineering | Deep learning | Dynamic Orchestration | Generative AI | Golang401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States10h ago
-
Data Quality | Deep learning | Experimentation | Golang | LLM EvaluationSenior-level Full TimeMountain View, CALIFORNIA, United States10h ago
-
Bioinformatics | C++ | CUDA | Cloud Computing | Computer VisionSenior-level Full TimeBaltimore, MD, United States11h ago
-
Staff AI Engineer USD 228K-288KArtificial Intelligence | Cloud infrastructure | Data Science | Distributed Systems | Graph Databases401k match | Company-sponsored life and disability insurance | Flexible spending accounts | Learning and development stipend | Mental health resourcesSenior-level Full TimeOakland, California, United States11h ago
-
Staff Partner Engineer, AI Partnerships USD 150K-206KAI integration | Agent Frameworks | Architecture | Cost Optimization | EvaluationGlobal travelSenior-level Full TimeNew York City, New York; San …11h ago
-
Staff Analytics Analyst, Full Stack (Revenue) USD 220K-280KAI enablement | Access Control | Apache Spark | BI Dashboards | DBTDental insurance | Employee stock purchase plan | Flexible spending wallet | Health insurance subsidized | Remote-firstSenior-level Full TimeRemote US R12h ago
-
Data Engine & Annotation Systems Engineer USD 130K-190KAPIs | Active Learning | Auto-labeling | Bash | Computer VisionMid-level Full TimeSan Francisco Bay Area12h ago
-
Customer Facing Applied AI Engineer, Retail Perception USD 106K-128KComputer Vision | Data Engineering | Data Pipelines | Data Validation | GitMid-level Full TimeSan Francisco Bay Area12h ago
-
Senior Computer Vision / Applied AI Engineer USD 150K-235KActive Learning | Annotation QA | Barcode Decoding | CUDA | Computer VisionSenior-level Full TimeSan Francisco Bay Area12h ago
-
Principal / Staff Robotics Perception Engineer USD 150K-261KC++ | CUDA | Camera Calibration | Depth Estimation | Edge inferenceSenior-level Full TimeSan Francisco Bay Area12h ago
-
Senior Machine Learning Engineer, Price Modeling USD 196K-227KData Analysis | Data Visualization | Machine Learning | Model Evaluation | PythonEmployee travel credits | Inclusion and belonging initiatives | Occasional travel | Remote eligibleSenior-level Full TimeUnited States13h ago
-
Lead Machine Learning Engineer USD 172K-276KAWS | Azure | CI/CD | Databricks | Distributed SystemsFlexible autonomy | Learning and development programs | MentorshipSenior-level Full TimeChicago, Illinois, USA R13h ago
-
Human Data Engineer USD 144K-270KData Annotation | Data Integrity | Data Quality | Dataset evaluation | Machine Learning401k retirement plan | Dental insurance | Disability insurance | Discounts | Life insuranceMid-level Full TimePalo Alto, California, United States13h ago
-
Machine Learning Ops Engineer USD 140K-175KAnomaly monitoring | Ansible | CI/CD | Infrastructure as Code | Kubernetes401k match | Annual Company Holidays | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States13h ago
-
Application Insights | Azure | Azure Monitor | BeautifulSoup | CI/CD401k | Dental insurance | Educational assistance | Health insurance | Open to remoteMid-level Full TimeNew York, United States R14h ago
-
Principal Robotics Software Engineer USD 190K-210KC++ | Debugging | Embedded Systems | Linux | Performance optimizationEquity | Health benefitsSenior-level Full TimeBurlington, Massachusetts, United States14h ago
-
Senior Data Platform Engineer USD 160K-220KAnalytics | CDC | Data Classification | Data Governance | Data Lake401k employer matching | Childcare reimbursement | Company events | Company-paid parking | Fertility treatment coverageSenior-level Full TimeSan Diego, CA, United States14h ago
-
Senior Embedded Firmware Engineer CAD 130K-180KARM Cortex | ARM Cortex-M | C# | CI/CD | CMakeEmployee resource groups | Generous time-off policies | Healthcare benefits | Retirement benefits | Reward and recognition programsSenior-level Full TimeUnited States15h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated testing | CI/CD | Data Versioning | Experimental Design | MLOpsDiscretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R15h ago
-
Principal Engineer, Data & ML Infrastructure USD 200K-275KAWS | Cloud Computing | Data Mining | Data Processing | Data Warehousing401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimeBoston, Massachusetts, United States; Pittsburgh, Pennsylvania, … R15h ago
-
Senior-level Full TimeCincinnati, OH, United States16h ago
-
Mechanical Robotics Engineer USD 77K-130KAutomation Controls | CAD design | Cause analysis | Condition Monitoring | Current Signature AnalysisMid-level Full TimeLincolnton, NC, United States16h ago
-
Senior Data Engineer (Snowflake) USD 165K-216KAgile | CRM | DBT | Data Governance | Data ModelingGrowth opportunities | International impact | Professional development | Remote workSenior-level Full TimeChicago, Illinois, United States R16h ago