Lead Databricks Consultant - Strategic Solution Architecture
USA, TX, Work-at-Home, United States
R
USD 170K-225K Senior-level Full Time
Tasks
- Address technical objections
- Build batch data pipelines
- Build streaming data pipelines
- Configure access control and lineage
- Create change management plans
- Create documentation and runbooks
- Create reference architectures
- Define engineering standards
- Define storage strategies
- Deliver technical presentations and demos
- Design and implement Delta Lake
- Develop notebooks and Databricks SQL assets
- Develop proposals and statements of work
- Drive operational readiness
- Ensure observability
- Facilitate knowledge transfer
- Identify high value Databricks use cases
- Implement Unity Catalog governance
- Implement code quality and testing
- Implement data governance and security
- Integrate upstream and downstream systems
- Lead production handover
- Lead secure scalable Databricks Lakehouse architecture
- Mitigate risks
- Monitor workloads
- Optimize performance, reliability, and cost
- Plan releases and manage dependencies
- Provide technical leadership
- Resolve complex technical issues
- Review designs and code
- Run discovery sessions
- Set up CI/CD
- Shape solution visions
- Stabilize post go live
- Support customer enablement
- Support production go-lives
- Tune clusters
Perks/Benefits
- 401k retirement plan
- Dental insurance
- Employee assistance program
- Medical insurance
- Paid Holidays
- Paid learning days
- Paid time off
- Vision insurance
Skills/Tech-stack
Access Control | Amazon Web Services | Azure | CI/CD | Cloud Architecture | Cloud platform | Cluster tuning | Data Governance | Data Lineage | Databricks | Databricks SQL | Delta Lake | DevOps | Google Cloud | Google Cloud Platform | Lakehouse | Monitoring | Observability | Performance Tuning | PySpark | Python | SQL | Spark | Storage strategy | Unity Catalog | Web Services
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiBenefits | Career growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior AI Software Engineer USD 145K-200KAWS | Asynchronous programming | Asyncio | Azure | CI/CD401k matching | Commuter benefits plan | Education reimbursement | Holiday leave | Life insuranceSenior-level Full TimeWashington, DC or Fully Remote R1d ago
-
Data Modeling | Data Quality | Data Stewardship | Data Validation | Healthcare AnalyticsRemote workSenior-level Full TimeUnited States R1d ago
-
Lead Data Engineer USD 160K-193KAPI | Access Control | Amazon Redshift | CI/CD | DBT100% remote | 401k match | Adoption benefits | Employee resource groups | Flexible time offSenior-level Full TimeDeerfield, IL, United States R1d ago
-
Lead Data Engineer – Snowflake & Data Platforms USD 121K-159KAgile | Amazon QuickSight | Bitbucket | CI/CD | Change ManagementEmployee development support | Flexible remote days | Health insurance | Hybrid work model | Life insuranceSenior-level Full TimeJersey City, NJ, United States R1d ago
-
Software Engineering Manager, Data & Analytics USD 120K-150KAWS | Alerting | Amazon Redshift | Amazon S3 | Architecture401k match | Flexible PTO | Fully remote | HSA match | Health, dental, and vision insuranceMid-level Full TimeCharlotte, NC R1d ago
-
AWS | BI Data modeling | Cloud Data | Cloud Data Platforms | DAXHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefitsSenior-level Full TimeJersey City, NJ, United States R1d ago
-
Data Architect USD 117K-160KAWS Glue | AWS Lambda | AWS RDS | AWS S3 | Access Control401k match | Dental insurance | Flexible spending accounts | Health insurance | Life insuranceSenior-level Full TimeArlington, Virginia, United States R1d ago
-
A/B | A/B Testing | Attribution Modeling | B testing | Causal Inference401-k match | Education assistance | Flexible remote work | Health and wellbeing resources | Insurance benefitsSenior-level Full TimeRemote, United States R2d ago
-
Data Analytics Senior Consultant I USD 85K-145KAnomaly Detection | Big Data | Business Intelligence | Data Quality | Data ReconciliationConnectivity reimbursement | Laptop and equipment provided | Work from homeSenior-level Full TimeUSA - IL (Remote), United States R2d ago
-
VP, Global Analytics USD 114K-210KAI Automation | Actuarial Science | Alteryx | Capital modeling | Databricks401k savings | Employee assistance programs | Health and welfare benefits | Retirement programs | Tuition assistanceExecutive-level Full TimePhiladelphia - South 17th, United States R2d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache OozieCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Enterprise Data Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiSenior-level Full TimeUnited States - Remote R2d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache KafkaBenefits package | Career growth | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Data Platform Architect USD 100K-150KAWS | Access Control | Alation | Amazon Redshift | Apache FlinkCareer growth | Health benefits | Remote work | W2 employmentSenior-level Full TimeUnited States - Remote R2d ago
-
Data Platform Architect USD 100K-150KAWS | Access Management | Alation | Amazon Redshift | Apache FlinkCareer growth | Employee benefits | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Prompt Engineering USD 100K-150KAgent systems | Agentic Workflows | Cost Optimization | Embeddings | Evaluation PipelinesBenefits | Career growth potential | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Lead Data Engineer USD 224KAirflow | Apache Beam | Autoscaling | BigQuery | CI/CD401k plan | Health benefits | Hybrid schedule | Paid time off | Parental leaveSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R2d ago
-
Lead Data Engineer USD 224KApache Beam | Autoscaling | BigQuery | CI/CD | CMEKCommuter benefits | Disability benefits | Life insurance | Paid time off | Parental leaveSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R2d ago
-
Director, AI, Data and Developer Enablement USD 165K-275KAccess Controls | Apache Kafka | Apache Spark | CI/CD | Change ManagementDevelopment programs for advancement and career growth | Paid education assistance | Paid parental leave | Scheduling flexibility | Team member discountExecutive-level Full Time985 - Fred Meijer Office, United … R2d ago
-
EPIC Certified ETL Architect USD 95K-130KAutomation | Change Data Capture | Data Capture | Data Governance | Data LineageSenior-level Full TimeRemote - Georgia, United States R2d ago
-
AI Solutions Architect (Remote) USD 125K-350KAWS | Agentic AI | Azure | Cloud Computing | Data GovernanceHealthcare benefits | Remote workSenior-level Full TimeDurham, North Carolina, United States of … R2d ago
-
Business Analysis | Business Intelligence | DAX | Data Analysis | Data QualityMonthly Connectivity reimbursement | Remote work | Technology equipment providedMid-level Full TimeUSA - IL (Remote), United States R2d ago
-
Lead Data Engineer - Data Platform Engineering (Hybrid) USD 130K-165KApache Airflow | Apache Hadoop | Apache OpenLineage | Apache Spark | BigQueryHybrid work scheduleSenior-level Full TimeMelville, Suffolk, United States R2d ago