Lead Databricks Consultant
Tasks
- Address technical objections
- Build notebooks and Databricks SQL assets
- Configure access control lineage and compliance
- Create documentation, runbooks, and training materials
- Create solution visions and reference architectures
- Define engineering standards for code quality
- Deliver technical presentations and demos
- Design secure scalable Delta Lake solutions
- Develop proposals and statements of work
- Drive change management for adoption
- Enforce testing and CI CD
- Facilitate knowledge transfer to client teams
- Identify Databricks use cases
- Implement data governance and security with Unity Catalog
- Implement data pipelines batch and streaming
- Implement observability and operational readiness
- Lead Databricks lakehouse architecture design
- Monitor workloads
- Optimize performance, reliability, and cost
- Plan releases manage dependencies mitigate risks
- Review designs and code for data engineers and analysts
- Run discovery sessions
- Support production go lives and stabilization
- Support release handover to operations or managed services
- Tune clusters and storage strategies
Perks/Benefits
- 401k retirement plan
- Dental insurance
- Employee assistance program
- Medical insurance
- Paid Holidays
- Paid learning days
- Paid time off
- Vision insurance
Skills/Tech-stack
AWS | Access Control | Apache Spark | Azure | Batch Processing | CI/CD | Cloud Storage | Cluster tuning | Code review | Data Governance | Data Lineage | Data Security | Data pipeline | Databricks | Databricks SQL | Delta Lake | DevOps | GCP | Identity Management | Medallion Architecture | Monitoring | Networking | Observability | PySpark | Python | SQL | Streaming processing | Testing | Unity Catalog
Education
Roles
Architect | Consultant | Data Engineer | Databricks Consultant | Engineer | Solutions Architect
Related jobs
-
AI Systems & ML Engineering Industry Expert CAD 140K-185KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly paySenior-level Part TimeToronto, Ontario, CA R8h ago
-
AI Evaluation | AI Observability | ASP.Net Core | AWS | Agentic Architectures401k matching | Continuing education | Flexible PTO | Health and wellness programs | Health, dental, and vision insuranceSenior-level Full TimeCanada R16h ago
-
AWS | Amazon Bedrock | Amazon SageMaker | Apache Spark | Automated DeliveryEmployer pension contribution | Equipment and home office stipend | Learning and development stipend | Long-Term Disability coverage | Paid HolidaysSenior-level Full TimeCanada R16h ago
-
Senior Machine Learning Engineer CAD 150K-210KAPIs | Algorithms | Concurrency | Data Modeling | Data StructuresSenior-level Full TimeToronto, Ontario, Canada R1d ago
-
Staff Full Stack AI Engineer CAD 145K-175K.NET | AI Evaluation | AWS | Agentic Workflows | AutoGPT401k matching | Company lunches | Company outings | Continuing education | Flexible PTOSenior-level Full TimeAtlanta, Charlotte, Denver, New York, Remote … R1d ago
-
Senior Data Engineer CAD 135K-159KAWS | Agile | DBT | Data Governance | Data ModelingHybrid work model | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimeOttawa, ON, Canada R1d ago
-
Principal Data Architect — Databricks Enablement CAD 180K-202KAmazon Bedrock | Amazon Redshift | Amazon S3 | Amazon SageMaker | Amazon Web ServicesEquipment stipend | Health insurance | Learning and development stipend | Long-term disability | Paid HolidaysSenior-level Full TimeCANADA R1d ago
-
Senior Software Engineer, Data - Mapping CAD 136K-170KA/B | A/B Testing | AWS | Airflow | Apache IcebergChild care benefits | Disability benefits | Extended health and dental coverage | Family building benefits | Flexible paid time offSenior-level Full TimeToronto, Canada R1d ago
-
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryAnnual company retreat | Conference talk sponsorship | Employee leave policies | Home office fund | In person coworking sprintsMid-level Full TimeCanada R1d ago
-
Databricks | Power BI | Python | SQL | TableauDeloitte Days | Flexible benefits spending account | Flexible work arrangements | Hybrid work structure | Learning and development daysSenior-level Full TimeToronto, ON, CA, M5H 0A9 R1d ago
-
AI Agents | API Integration | Access Management | Agent Frameworks | Cost OptimizationCompany offsites | Equity participation | Flexible schedule | Flexible vacation | Fully remoteMid-level Full TimeCanada R1d ago
-
.NET | AI orchestration | API Integration | Automation | C#Autonomy in work | Comprehensive benefits package | Fully remote work | Learning opportunities | Professional developmentSenior-level Full TimeCanada R1d ago
-
Advisor, Data engineering CAD 83K-133KAlgorithms | Data Engineering | Data Modeling | Data Pipelines | Data StorageDefined benefit pension plan | Flexible vacation | Group insurance | Health & wellness reimbursement | TelemedicineSenior-level Full TimeComplexe Desjardins Montréal, Canada R1d ago
-
Senior Software Engineer, AI Enablement & Solutions CAD 140K-210KAPIs | AWS | AWS Bedrock | Distributed Systems | MicroservicesEmployee accounts required as applicable | Hybrid work environment | In-office collaborationSenior-level Full TimeToronto, Canada R1d ago
-
Advisor, AI Solutions Architecture CAD 96K-115KAI | Advanced Analytics | Agile | Application Integration | Artificial IntelligenceDiscounts on iA products | Employee and family assistance program | Employee share purchase plan | Ergonomic furniture program | Flexible insurance plansSenior-level Full TimeQuebec / 1080, Grande Allee West … R1d ago
-
Consultant, Risk Analytics CAD 92K-112KArtificial Intelligence | Data Aggregation | Data Quality | Data integration | DatabricksHybrid work arrangement | Paid volunteer daySenior-level Full TimeToronto-81 Bay, 31st Floor, Canada R1d ago
-
AWS ETL Data Engineer - REMOTE CAD 86K-133KAWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Apache AirflowDisability insurance | Employee assistance program | Gym discounts | Health and dental coverage | Income protectionSenior-level Full TimeHalifax, NS, CA R1d ago
-
Data Engineer (Databricks) CAD 80K-90KAlgorithms | Apache Spark | CI/CD | Data Modeling | Data Structures401k | Dental insurance | Educational events | Health insurance | Networking eventsSenior-level Full TimeToronto, Ontario, Canada - Remote R1d ago
-
AI Governance | Agentic AI | Artificial Intelligence | Cloud Architecture | Data LineageEmployee resource groups | Four weeks of vacation per year | Opportunities for professional development | Work-from-home opportunitiesSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada R1d ago
-
Staff Data Engineer CAD 131K-164KAWS | Azure | CI | CI/CD | Cloud platform401k | Dental insurance | Discretionary time off | Equity participation | Health insuranceSenior-level Full TimeRemote - Canada R2d ago
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R2d ago
-
Access Management | Business glossary | Change Data Capture | Data Capture | Data Catalog401k matching | Dental insurance | Flexible work arrangements | Fully remote | Health insuranceMid-level Full TimeCanada R2d ago
-
Senior Data Engineer CAD 80K-138KActive Directory | Azure Active Directory | Azure Blob | Azure Blob Storage | Azure DataDeloitte Days | Development and Innovation Days | Flexible benefit spending account | Flexible work arrangements | Hybrid workSenior-level Full TimeToronto, ON, CA, M5H 0A9 R2d ago
-
Agentic design | Amazon Athena | Amazon Redshift | Amazon S3 | Apache FlinkFully remoteEntry-level Full TimeToronto, ON, Canada R2d ago
-
AWS | AWS Bedrock | Agent patterns | Airtable | Backend DevelopmentFully remote | Globally distributed team | Home office stipend | Learning and development stipend | Long-Term Disability coverageMid-level Full TimeCanada R2d ago