Team Lead, Data Engineering - Databricks
Tasks
- Apply security governance using Unity Catalog and IAM
- Build and manage ETLELT and streaming pipelines
- Conduct code reviews and knowledge-sharing sessions
- Configure and optimize Databricks clusters and Spark jobs
- Design develop and optimize Databricks solutions
- Implement Delta Lake and Lakehouse architecture
- Lead and mentor data engineering team
- Monitor pipeline performance and data quality
- Support infrastructure using Terraform
Perks/Benefits
Skills/Tech-stack
AI | API Development | AWS | Data Governance | Data Modeling | Data Pipelines | Databricks | Delta Lake | Git | Lakehouse | ML | Python | Real Time | Real-time Processing | SQL | Spark | Terraform | Time processing
Education
N/A
Roles
Data Engineer | Engineer | Lead | Team Lead
Related jobs
-
Data Modelling | Data Validation | Hadoop | Java | PythonLearning opportunities | Product DiscountsEntry-level Full Time2180 Yonge, Canada18h ago
-
Staff AI/ML Data Engineer CAD 145K-180KAI systems | AWS | Data Engineering | Data Infrastructure | Data ModelingCompany events | Dental benefits | Flexible work arrangements | Growth opportunities | Health benefitsSenior-level Full TimeOttawa Office23h ago
-
Amazon Redshift | Cloud Data | Cloud Data Warehouse | Data Management | Data Management CloudSenior-level ContractToronto, Canada1d ago
-
ADLS Gen2 | Azure | Azure Databricks | Azure DevOps | Azure Log AnalyticsProfessional development opportunities | Remote-flexible workSenior-level ContractDowntown Toronto (Richmond / Adelaide / …1d ago
-
AI Agents | C++ | CUDA | GPU Profiling | HIPAMD benefits | Flexible work arrangementsMid-level Full TimeMARKHAM, ON, Canada1d ago
-
ML Data Engineer CAD 105K-130KCloud Platforms | Data Preprocessing | Data Validation | Machine Learning | NumPyDisability insurance | Health and dental coverage | Holidays | Life insurance | Paid time offMid-level Full TimeOttawa, Canada1d ago
-
AI/ML Engineer CAD 121K-171KAWS | Azure | CI/CD | Computer Vision | Distributed SystemsDiscretionary bonuses | Health insurance | Retirement plansMid-level Full TimeToronto, CAN, Canada1d ago
-
Senior Software Engineer, Data Platform CAD 128K-172KAWS | Columnar Databases | Data Storage | Data platforms | Distributed SystemsCareer growth opportunities | Collaborative team environmentSenior-level Full TimeRemote - Canada R1d ago
-
Data Engineering Architect USD 210K-260KAI/ML | BI tools | Cloud Data | Cloud Data Services | Data GovernanceFamily support | Flexible time off | Health, dental, vision insurance | Home office stipend | Life insuranceSenior-level Full TimeAmericas (USA or Canada) R1d ago
-
Data & Analytics Engineer CAD 69K-106KApache Spark | Change Management | Data Governance | Data Modeling | Data StorageCharitable donation matching | Flex benefits | Mentorship | Training programs | Tuition assistanceMid-level Full TimeCalgary, AB, Canada1d ago
-
Data Analytics Engineer CAD 115K-150KBI tools | Cloud Platforms | Data Governance | Data Modeling | Data WarehouseDEI initiatives | Dental | Medical | Mental health support | Retirement plansSenior-level Full TimeRemote, Canada R2d ago
-
ML Developer, Senior CAD 129K-230KAutomation | Data Transformation | Data Visualization | Data cleaning | MLflowCommunity volunteer opportunities | Flexible time off | Recognition programs | Wellness programsSenior-level Full TimeCanada2d ago
-
ML Developer, Senior CAD 129K-230KAnalysis | Azure | Cloud Computing | Data Science | Data TransformationCommunity impact initiatives | Comprehensive wellness programs | Professional growth opportunities | Recognition programs | Volunteer daysSenior-level Full TimeCanada2d ago
-
A/B | A/B Testing | B testing | Data Analysis | JAXBenefits | Bonus | EquitySenior-level Full TimeWaterloo, ON, Canada; Toronto, ON, Canada2d ago
-
A/B | A/B Testing | B testing | Data Analysis | JAXBenefits | Bonus | EquitySenior-level Full TimeWaterloo, ON, Canada; Toronto, ON, Canada2d ago
-
Data Engineer Student - Digital & AI Solutions CAD 113K-143KAWS | Azure | Azure Data | Azure Data Factory | Azure DevOpsFlexible work environment | Global collaboration opportunities | Long-term career developmentSenior-level Full TimeMississauga, ON, CA2d ago
-
Al Engineer, Materia (New Grad - 2026) CAD 80K-100KAPI Development | AWS | Embeddings | FastAPI | Generative AICareer development opportunities | Community engagement programs | Flexible-hybrid work | Mental health support | Work-life balance programsEntry-level Full TimeCanada, Toronto, Ontario2d ago
-
L3 Data Management CAD 118K-144KBigQuery | Cloud Platform (GCP | Cloud platform | Containerization | Data ArchitectureFlexible work environment | Professional development opportunitiesSenior-level Full TimeVancouver, BC, CA2d ago
-
Lead Data Engineer - GCP CAD 94K-171KBigQuery | Cloud Dataflow | CloudPubSub | CloudSQL | CloudSpannerCommunity engagement | Diversity and inclusion programs | Flexible benefits | Upskilling opportunitiesSenior-level Full TimeToronto, ON, CA, M5C2V92d ago
-
Software Development Engineer, Security - Evisort CAD 112K-168KAWS | Ansible | Automation | CloudFormation | ContrastFlexible work | Remote optionsMid-level Full TimeCanada, BC, Vancouver2d ago
-
Data Engineer CAD 100K-136KAWS | Airflow | Apache Spark | Artificial Intelligence | AzureCommunity involvement | Family-friendly benefits | Flexible work hours | Medical/Dental/Vision | Paid time offMid-level Full TimeCanada2d ago
-
Data Engineer CAD 100K-136KAI | AWS | Airflow | Apache Spark | AzureCommunity support | Flexible work hours | Medical/Dental/Vision | Paid time off | Parental leaveMid-level Full TimeCanada2d ago
-
Staff Software Engineer, AI CAD 146K-195KAWS | Agent systems | CI/CD | Evaluation methodology | LLMDental insurance | Learning and development budget | Life and disability insurance | Medical insurance | Office setup stipendSenior-level Full TimeRemote - British Columbia, Canada R2d ago
-
Staff Software Engineer, AI CAD 146K-195KAWS | CI/CD | Deployment | LLM | LanggraphDental insurance | Disability insurance | Financial planning | Learning and development budget | Life insuranceSenior-level Full TimeRemote - Ontario, Canada R2d ago
-
Analytics Engineer CAD 56K-70KAgile | CI/CD | Data Modeling | Data Visualization | Data WarehousingEmployer-paid healthcare | Flexible time off | Ride credits | Work from home stipendEntry-level Full TimeRemote- Canada R3d ago