Senior Databricks Engineer
Tasks
- Architect build maintain ETL ELT pipelines
- Build orchestrate data workflows
- Collaborate with analytics and data science teams
- Design medallion data architecture
- Implement Delta Live Tables
- Implement data quality governance and lineage
- Manage Unity Catalog access control and governance
- Monitor pipelines troubleshoot failures root cause analysis
- Optimize Spark jobs and clusters
- Set engineering standards for performance reliability cost
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Spark | Autoscaling | Azure | CCPA | CI/CD | Caching | DBT | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | GCP | GDPR | Git | HIPAA | Infrastructure as Code | MLflow | Partitioning | PySpark | RAG | Retrieval-Augmented Generation | SOC 2 | Spark SQL | Structured Streaming | Unity Catalog | Vector Search | “as-code”
Education
Related jobs
-
Senior-level Full TimeCanada R7h ago
-
Senior-level Full TimeUnited States R8h ago
-
Deep Learning Quality Specialist USD 72K-90KAnnotation Guidelines | Computer Vision | Confluence | Convolutional Neural Networks | Data Annotation401k plan | Commuter benefits | Employee assistance program | Flexible PTO | Fully paid medical/dental/visionMid-level Full TimeSeattle, WA R14h ago
-
Corporate AI Engineer USD 154K-200KAPI Integration | Access Control | Data Quality | Embeddings | Generative AIHybrid work schedule | Volunteer time offMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R14h ago
-
FDE Data Engineer- Space USD 123K-166KABAC | Apache Airflow | Apache Flink | Apache Hudi | Apache IcebergHealth benefits | Remote work | Travel for site workMid-level Full TimeUnited States - Remote R19h ago
-
Senior FDE Data Engineer USD 148K-201KABAC | Airflow | Apache Iceberg | Apache Kafka | Argo WorkflowsCompany paid premiums | Health savings account | Medical/Dental/Vision | Remote work | Travel to classified sitesSenior-level Full TimeUnited States - Remote R19h ago
-
AI Observability | AWS | Azure | CI/CD | Cost ControlCareer advancement | Fully remote work | Professional development opportunities | Work-life balanceSenior-level Full TimeCanada R22h ago
-
Senior Data Engineer 🇺🇸 USD 160K-200KAWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testingSenior-level Full TimeHybrid (New York, New York, US) R1d ago
-
AWS Data Engineer - Fully Remote - US Only USD 139K-210KAWS Glue | AWS Lambda | AWS Step Functions | Amazon DynamoDB | Amazon RedshiftAbility to work independently | Fully remote | US onlySenior-level Full TimePlano, Texas, United States - Remote R1d ago
-
AI Workflow Orchestration | AI workflow | AWS DynamoDB | AWS Lambda | AWS Step FunctionsArchitectural influence | Engineering Led Collaboration | High technical ownership | Learning opportunities | Remote-first work modelSenior-level Full TimeCanada R1d ago
-
Senior Machine Learning Engineer, Applied AI Modeling USD 139K-218KClassification | Embeddings | Evaluation | Fine Tuning | Hugging FaceHome office stipend | Medical, dental & vision coverage | Paid Holidays | Paid parental leave | Professional development budgetSenior-level Full TimeRemote US R1d ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic Frameworks | Auditability | CI/CD | Cloud Native401-k match | Dental insurance | Expense Reimbursement for Home Office | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R1d ago
-
Senior Analytics Engineer USD 159K-200KAWS | Airflow | DBT | Dagster | Data ObservabilityAutonomy | Fully remote | High-impact work | Use of AI toolsSenior-level Full TimeRemote US R1d ago
-
Senior-level Full TimeSan Jose, United States R1d ago
-
AEP Debugger | AEP Web SDK | Adobe Experience | Adobe Experience Platform | Adobe TagsSenior-level Full TimeLehi, United States R1d ago
-
Lead Data Engineer USD 188K-230KAirflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataDomestic travel up to 5 percent | Relocation not authorized | Remote workSenior-level Full TimeRemote - Minnesota, United States R1d ago
-
BigQuery | Cloud Data | Cloud data platform | Code review | DBTLong-term contract | Onsite work in Atlanta GA metro area | Potential conversion to full time | W2 employmentSenior-level Contract Full TimeAtlanta, Georgia, United States R1d ago
-
Senior Machine Learning Operations Engineer USD 166K-208KAlerting | CI/CD | Canary Deployment | Champion Challenger | Drift DetectionSenior-level Full TimeSan Francisco, CA, New York, NY, … R1d ago
-
Staff Analytics Engineer USD 109K-125KAmazon Redshift | Automated testing | BigQuery | CI/CD | Cloud Data401k plan | Coaching | Flexible spending account | Flexible vacation policy | Healthcare coverageSenior-level Full TimeUnited States R1d ago
-
AI Engineer USD 99K-163KAPI Integration | AWS | Amazon Bedrock | Data Analysis | Embeddings401k match | Dental insurance | Disability insurance | Hybrid work model | Life insuranceMid-level Full TimeRemote, United States R1d ago
-
Senior-level Full TimeUnited States (Remote) R1d ago
-
Forward Deployed AI Product Engineer USD 167K-200KAI Evaluation | AI guardrails | CI/CD | Data Pipelines | Data TransformationOn site client collaboration | Remote work | Travel opportunitiesSenior-level Full TimeUS-Remote R1d ago
-
Sr. Software Engineer - Engineering Enablement USD 150K-190KAWS | Agent Orchestration | Automated testing | Azure | CI/CDDocumentation and onboarding support | Office hoursSenior-level Full TimeUS Remote R1d ago
-
Staff Backend AI Engineer, Remote USD 140K-209KAPI Gateway | AWS | AWS Cloud | AWS Cloud Development Kit | AWS Lambda401k matching | Dental insurance | Flexible time off | Health insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
A/B | A/B Testing | AWS | Apache Kafka | B testingDental insurance | Equity | Medical insurance | Remote work environment | Vision insuranceSenior-level Full TimeRemote, USA; Remote, Canada R1d ago