Lead Databricks Consultant - Strategic Solution Architecture
USA, TX, Work-at-Home, United States
R
USD 170K-225K Senior-level Full Time
Tasks
- Address technical objections
- Build batch and streaming data pipelines
- Configure access control and lineage
- Create documentation runbooks and training
- Define engineering standards
- Deliver technical presentations and demos
- Develop notebooks and Databricks SQL assets
- Develop proposals and statements of work
- Enforce testing and code quality
- Facilitate handover to operations
- Implement CI/CD and observability
- Implement data governance and security
- Integrate upstream and downstream systems
- Lead Databricks lakehouse architecture design
- Monitor and manage Databricks costs
- Optimize cluster tuning and storage
- Plan releases and manage dependencies
- Review designs and code for data engineering
- Run discovery sessions
- Shape solution visions
- Support production go-lives
Perks/Benefits
- 401k retirement plan
- Dental insurance
- Employee assistance program
- Medical insurance
- Paid Holidays
- Paid learning days
- Paid time off
- Vision insurance
Skills/Tech-stack
AWS | Access Control | Azure | CI/CD | Cluster tuning | Data Governance | Data Lineage | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | DevOps | ETL | GCP | Jobs | Lakehouse | Monitoring | Observability | PySpark | Python | SQL | Spark | Unity Catalog
Education
N/A
Roles
Consultant | Data Engineer | Databricks Consultant | Engineer
Related jobs
-
Principal Machine Learning Engineer USD 205K-230KAWS Lambda | BigQuery | C# | CI/CD | Cloud Functions401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeUnited States of America - Remote … R2h ago
-
.NET | AI Foundry | Anthropic | Azure AI | Azure AI FoundryFull suite of benefits | Healthcare impact | Mentorship | Remote workSenior-level Full TimeOak Brook, IL, United States R10h ago
-
Associate Applied AI Engineer USD 85K-100KAPI Integration | Language Models | Large Language Models | Machine Learning | Prompt engineeringDental insurance | Flexible time off | Health insurance | Home internet allowance | Mobile phone allowanceMid-level Full TimeRemote R10h ago
-
Senior AI Engineer USD 200K-220KCI/CD | Code review | Deep learning | Generative AI | LLM Evaluation401k retirement savings plan | Employer sponsored health dental vision | Equity participation | Flexible spending account | Health savings accountSenior-level Full TimeRemote, USA R10h ago
-
Senior Data Engineer USD 166K-275KAWS | Agile | Apache Airflow | CI/CD | Data Governance401k matching | Flexible unlimited time off | HSA FSA matching funds | Medical, dental, vision benefits | OneMedical subscriptionSenior-level Full TimeRemote - United States R10h ago
-
Staff SW Engineer, Machine Learning Operations USD 150K-180KAPI Integration | AWS Batch | AWS EKS | AWS IAM | Amazon Aurora401k match | AD&D insurance | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeRemote, USA R12h ago
-
.NET | ASP.Net Core | App Service | Azure App | Azure App ServiceRemote workSenior-level Contract Full TimeMt. Juliet, TN, United States R14h ago
-
ML Engineer - Verifications USD 150K-180KAWS | Access Control | Alerting | Anomaly Detection | Batch inference401k retirement plan | Biannual offsites | Company holidays | Medical, dental, vision plans | Paid parental leaveMid-level Full TimeUS-Remote R14h ago
-
Principal Data Engineer - MarTech USD 143K-178KAPI Integration | Batch Data Processing | Batch data | CCPA | Customer DataHealth and welfare benefits | Hybrid work model | Paid time off | Remote work flexibilitySenior-level Full TimeRemote, US or Remote, Ontario, Canada R14h ago
-
Senior Data Engineer-JT0224 USD 120K-180K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R15h ago
-
AI Governance Leader USD 165K-216KAI Act | AI Governance | AI RMF | AI compliance | Cloud ComputingMentorship opportunities | Remote-first work environment | Travel opportunitiesSenior-level Full TimeUS-Remote R15h ago
-
Databricks Data Engineer USD 120K-140KAWS | Apache Spark | Asset bundles | Azure | Cloud Data401k matching | Dental insurance | Flexible spending account | Growth opportunities | Health insuranceMid-level Full TimeDenver, CO, United States R15h ago
-
A/B | A/B Testing | Attribution Modeling | B testing | CachingAnnual equity refresh grants | Flexible remote work | New hire equity grantSenior-level Full TimeUS - Remote R16h ago
-
Staff Backend Engineer (AI Platform team) USD 185K-242KAWS | Agent Frameworks | Compliance | Data Privacy | DatadogEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - United States & Canada R18h ago
-
Senior Solution Engineer, Media & Entertainment USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehouse | Data fabricSenior-level Full TimeUS-CA-Bay Area-Remote R19h ago
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R1d ago
-
AI Solution Consultant USD 148K-215KAWS | Alerting | Azure | CI/CD | Data PrivacyCommuter benefits | ESOP | Employee assistance program | Health insurance contribution | Parental leaveSenior-level Full TimeSan Francisco, United States R1d ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k | Health insurance | Paid time offMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k plan | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
AI Engineer USD 132K-205KBatch inference | CI/CD | Continuous Evaluation | Data Drift | Data Drift Detection401k retirement plan | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote - Michigan, United States R1d ago
-
Data Engineer USD 119K-165KAutomated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeRemote, United States R1d ago
-
DataOps Engineer USD 120K-150KADLS Gen2 | Azure | Azure Cost Management | Azure Data | Azure Data FactorySenior-level Full TimeRemote South Carolina, Remote South Carolina, … R1d ago
-
Staff Software Engineer - Data Services USD 184K-230KAKS | Apache Airflow | Apache Iceberg | Apache Spark | CeleryCareer development | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-Massachusetts-Remote, United States R1d ago
-
Lead Data Engineer - Primary Care USD 142K-195KApache Spark | Artificial Intelligence | Big Data | Cloud Computing | DBT401k retirement savings | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeRemote US, United States R1d ago
-
Staff Data Engineer, Ads USD 248K-279KAPI Integration | Airflow | Alerting | Anomaly Detection | BigQuerySenior-level Full TimeRemote (U.S.) R1d ago