Team Lead, Data Engineering - Databricks
Tasks
- Apply security governance using Unity Catalog and IAM
- Build and manage ETLELT and streaming pipelines
- Conduct code reviews and knowledge-sharing sessions
- Configure and optimize Databricks clusters and Spark jobs
- Design develop and optimize Databricks solutions
- Implement Delta Lake and Lakehouse architecture
- Lead and mentor data engineering team
- Monitor pipeline performance and data quality
- Support infrastructure using Terraform
Perks/Benefits
Skills/Tech-stack
AI | API Development | AWS | Data Governance | Data Modeling | Data Pipelines | Databricks | Delta Lake | Git | Lakehouse | ML | Python | Real Time | Real-time Processing | SQL | Spark | Terraform | Time processing
Education
N/A
Roles
Data Engineer | Engineer | Lead | Team Lead
Related jobs
-
Disaster Recovery Program Lead CAD 86K-110KAWS | Automation | Azure | Business Continuity | Business Continuity PlanningSenior-level Full TimeSaskatoon, SK, CA, S7K 5R65h ago
-
Senior Data Engineer CAD 86K-118KAWS DMS | AWS Glue | AWS Lambda | Agile | Amazon AthenaAccident and life insurance | Health insurance | Other location specific benefitsSenior-level Full TimeCalgary, Alberta, Canada; Winnipeg, Manitoba, Canada; …8h ago
-
Staff Software Engineer - Applied AI CAD 140K-180KAWS | Amazon Bedrock | CI/CD | Claude | Data Pipelines401k match | Charitable donation match | Commuter benefits | Flexible time off | Paid parental leaveSenior-level Full TimeRemote - Ontario, Canada R13h ago
-
Senior-level Full TimeToronto, Ontario, Canada14h ago
-
Machine Learning Engineer - IV (Biometrics) CAD 106K-154KAWS | Airflow | Algorithmic Bias Mitigation | Algorithmic bias | Amazon EC2Mid-level Full TimeMontreal14h ago
-
Senior-level Full TimeToronto, Ontario, Canada R14h ago
-
GTM AI Engineer CAD 141K-191KAPIs | Agents | Attribution | Automation | CRM SyncChange management support | Hybrid work option | Playbooks | Remote work flexibility | Stakeholder trainingSenior-level Full TimeCanada - Remote (0002) R16h ago
-
Senior Software Engineer, AI/LLM USD 202K-227KAPI Development | API Orchestration | Automated testing | Best practices | CI/CDFlexible PTO | Health, dental, vision coverage | Mental health & wellness benefits | Parental leave | Professional development stipendSenior-level Full TimeRemote (US/Canada) R20h ago
-
Senior Analytics Engineer | Canada | Remote CAD 129K-155KAPM | AWS | BigQuery | Cloud platform | DBT100% remote | Annual leave | Global culture | In-person onboarding | Remote-firstSenior-level Full TimeCanada (Remote) R20h ago
-
Data Developer - TG Quality Engineering TGQF CAD 120K-161K.NET | Agile | Algorithms | Amazon Web Services | Apache FlumeSenior-level Full TimeQuebec City, QC, Canada21h ago
-
Senior-level Full TimeMontreal, QC, Canada21h ago
-
Entry-level Full TimeQuebec City, QC, Canada21h ago
-
.NET | AWS | Agile | Apache Flume | Apache IcebergEntry-level Full TimeQuebec City, QC, Canada22h ago
-
Software Engineer, ML Ops CAD 100K-130KC# | C++ | Computer Vision | Data Preprocessing | Deep learningMid-level Full TimeToronto22h ago
-
C++ | Chat systems | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeWaterloo, ON, Canada23h ago
-
Professional, Engineering - Multidisciplinary Design, Analysis & Optimization (MDAO / MDO) CAD 77K-127KBayesian optimization | CI/CD | Fidelity optimization | GEMSEO | GitDisability insurance | Employee assistance program | Health insurance | Life insurance | Retirement savings planMid-level Full TimeDorval, Québec, CA, H4S 1Y91d ago
-
Database Management | Debugging | Distributed Computing | Docker | GitHubMid-level Full TimeKitchener1d ago
-
Apache Hadoop | Apache Hive | Apache Kafka | Apache NiFi | Apache PinotSenior-level Full TimeKitchener1d ago
-
AI Engineer - New Grad CAD 56K-70KAPI | Agent Frameworks | Fine Tuning | Language Models | Large Language ModelsDiscount program | Flexible Medical Health Spending Account | Health benefits | RRSP matching | Tuition reimbursementEntry-level Full TimeGreater Toronto Area, ON, Canada1d ago
-
Senior-level Full TimeCAN - Ontario - Toronto, Canada1d ago
-
APIs | Deployment | Design Patterns | Java | Machine LearningMid-level Full TimeToronto, Ontario, CAN1d ago
-
MTS Software Engineer, Data Platform CAD 142K-190KAgile | Algorithms | Apache Spark | Data Structures | Distributed SystemsMedical benefits | Paid time off | Parental leave | RRSP eligibilitySenior-level Full TimeToronto, Canada1d ago
-
Airflow | Automation | Credit Rating Modeling | Credit Risk | Credit ratingHealthcare coverage | Hybrid work environment | Matched donations | Paid volunteer days | Parental leaveMid-level Full TimeToronto, ON, CA1d ago
-
Advanced Database Engineer CAD 83K-138KBackup monitoring | Business Suite | Database Administration | Database Migration | Database PatchingMid-level Full TimeCA Canada (ResMed Halifax)1d ago
-
AI and Data - Manager - AI/ML Engineer CAD 88K-160KAPI Design | AWS | Agile | Azure | CI/CDDental coverage | Flexible work | Learning opportunities | Medical coverage | Paid time offSenior-level Full TimeCalgary, AB, CA, T2P 1M41d ago