Lead Databricks Consultant - Strategic Solution Architecture
USA, TX, Work-at-Home, United States
R
USD 170K-225K Senior-level Full Time
Tasks
- Address technical objections
- Build batch and streaming data pipelines
- Configure access control and lineage
- Create documentation runbooks and training
- Define engineering standards
- Deliver technical presentations and demos
- Develop notebooks and Databricks SQL assets
- Develop proposals and statements of work
- Enforce testing and code quality
- Facilitate handover to operations
- Implement CI/CD and observability
- Implement data governance and security
- Integrate upstream and downstream systems
- Lead Databricks lakehouse architecture design
- Monitor and manage Databricks costs
- Optimize cluster tuning and storage
- Plan releases and manage dependencies
- Review designs and code for data engineering
- Run discovery sessions
- Shape solution visions
- Support production go-lives
Perks/Benefits
- 401k retirement plan
- Dental insurance
- Employee assistance program
- Medical insurance
- Paid Holidays
- Paid learning days
- Paid time off
- Vision insurance
Skills/Tech-stack
AWS | Access Control | Azure | CI/CD | Cluster tuning | Data Governance | Data Lineage | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | DevOps | ETL | GCP | Jobs | Lakehouse | Monitoring | Observability | PySpark | Python | SQL | Spark | Unity Catalog
Education
N/A
Roles
Consultant | Data Engineer | Databricks Consultant | Engineer
Related jobs
-
.NET | AI Foundry | Anthropic | Azure AI | Azure AI FoundryFull suite of benefits | Healthcare impact | Mentorship | Remote workSenior-level Full TimeOak Brook, IL, United States R9h ago
-
Associate Applied AI Engineer USD 85K-100KAPI Integration | Language Models | Large Language Models | Machine Learning | Prompt engineeringDental insurance | Flexible time off | Health insurance | Home internet allowance | Mobile phone allowanceMid-level Full TimeRemote R9h ago
-
Senior Data Engineer USD 166K-275KAWS | Agile | Apache Airflow | CI/CD | Data Governance401k matching | Flexible unlimited time off | HSA FSA matching funds | Medical, dental, vision benefits | OneMedical subscriptionSenior-level Full TimeRemote - United States R9h ago
-
.NET | ASP.Net Core | App Service | Azure App | Azure App ServiceRemote workSenior-level Contract Full TimeMt. Juliet, TN, United States R12h ago
-
Principal Data Engineer - MarTech USD 143K-178KAPI Integration | Batch Data Processing | Batch data | CCPA | Customer DataHealth and welfare benefits | Hybrid work model | Paid time off | Remote work flexibilitySenior-level Full TimeRemote, US or Remote, Ontario, Canada R13h ago
-
Senior Data Engineer-JT0224 USD 120K-180K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R13h ago
-
Databricks Data Engineer USD 120K-140KAWS | Apache Spark | Asset bundles | Azure | Cloud Data401k matching | Dental insurance | Flexible spending account | Growth opportunities | Health insuranceMid-level Full TimeDenver, CO, United States R14h ago
-
Staff Backend Engineer (AI Platform team) USD 185K-242KAWS | Agent Frameworks | Compliance | Data Privacy | DatadogEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - United States & Canada R16h ago
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R1d ago
-
AI Solution Consultant USD 148K-215KAWS | Alerting | Azure | CI/CD | Data PrivacyCommuter benefits | ESOP | Employee assistance program | Health insurance contribution | Parental leaveSenior-level Full TimeSan Francisco, United States R1d ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k | Health insurance | Paid time offMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k plan | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
AI Engineer USD 132K-205KBatch inference | CI/CD | Continuous Evaluation | Data Drift | Data Drift Detection401k retirement plan | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote - Michigan, United States R1d ago
-
Data Engineer USD 119K-165KAutomated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeRemote, United States R1d ago
-
DataOps Engineer USD 120K-150KADLS Gen2 | Azure | Azure Cost Management | Azure Data | Azure Data FactorySenior-level Full TimeRemote South Carolina, Remote South Carolina, … R1d ago
-
Staff Software Engineer - Data Services USD 184K-230KAKS | Apache Airflow | Apache Iceberg | Apache Spark | CeleryCareer development | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-Massachusetts-Remote, United States R1d ago
-
Lead Data Engineer - Primary Care USD 142K-195KApache Spark | Artificial Intelligence | Big Data | Cloud Computing | DBT401k retirement savings | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeRemote US, United States R1d ago
-
Staff Data Engineer, Ads USD 248K-279KAPI Integration | Airflow | Alerting | Anomaly Detection | BigQuerySenior-level Full TimeRemote (U.S.) R1d ago
-
Senior Solution Engineer USD 165K-216KCloud Computing | Data Lake | Data Warehouse | Data fabric | Data mesh401k matching | Flexible PTO | Health, dental, vision coverage | Professional development budgetSenior-level Full TimeUS-MN-Remote R1d ago
-
Applied AI Engineer USD 205K-282KAMS Integration | API Integration | Carrier Portal | Carrier Portal Integration | Data integration401k plan | FSA | Flexible vacation | HSA | Health insuranceExecutive-level Full TimeAustin - HQ R1d ago
-
Distinguished AI Engineer USD 350K-600KAgent systems | DBT | EHR Integration | Fine Tuning | GuardrailsSenior-level Full TimeNew York, NY R1d ago
-
Distinguished AI Engineer USD 350K-600KAgent systems | DBT | Data integration | Deep learning | EHR IntegrationHybrid workSenior-level Full TimeNew York, NY R1d ago
-
A/B | A/B Testing | AWS | Alerting | B testingAnnual refresh grants | Equity grant | Flex First Work Options | On-call rotation | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Platform Engineer USD 110K-156KAWS CloudWatch | AWS EMR | AWS Glue | AWS Lambda | Agent coreHealth and life insurance | Hybrid work model | Paid time off | Pension or retirement benefits | Personal/family care leaveMid-level Full TimeDallas, TX, United States R1d ago
-
Senior Data Analytics Engineer USD 100K-140KAWS | Apache Airflow | Azure | BigQuery | DBT401k match | Flexible work arrangements | Health insurance | Life insurance | Paid time offSenior-level Full TimeRemote - US R1d ago