Team Lead, Data Engineering - Databricks
Tasks
- Apply security governance using Unity Catalog and IAM
- Build and manage ETLELT and streaming pipelines
- Conduct code reviews and knowledge-sharing sessions
- Configure and optimize Databricks clusters and Spark jobs
- Design develop and optimize Databricks solutions
- Implement Delta Lake and Lakehouse architecture
- Lead and mentor data engineering team
- Monitor pipeline performance and data quality
- Support infrastructure using Terraform
Perks/Benefits
Skills/Tech-stack
AI | API Development | AWS | Data Governance | Data Modeling | Data Pipelines | Databricks | Delta Lake | Git | Lakehouse | ML | Python | Real Time | Real-time Processing | SQL | Spark | Terraform | Time processing
Education
N/A
Roles
Data Engineer | Engineer | Lead | Team Lead
Related jobs
-
DSP | FPGA | FPGA Integration | FPGA implementation | Hardware DesignDental insurance | Employee assistance program | Employer matching retirement savings | Flexible work hours | Health insuranceMid-level Full TimeMontreal (CAN), Canada22h ago
-
Data Engineer Co-op (8-12 Months) CAD 45K-45KAirflow | BI Dashboards | CI/CD | Cloud platform | Data ModelingCorporate partner discounts | Employee purchase program | Free Kobo device | Free weekly ebooks or audiobooks | Hybrid work modelNone Full TimeON-John Street, Canada22h ago
-
Data Engineer CAD 100K-140KAWS | Apache Spark | Azure | CI/CD | Data GovernanceContinuous learning opportunities | Coverage for dependents | Dental insurance | Health insurance | Hybrid workMid-level Full TimeToronto, Ontario1d ago
-
.NET | AWS | Agile | Apache Flume | Apache IcebergEntry-level Full TimeQuebec City, QC, Canada1d ago
-
AWS CDK | AWS EventBridge | AWS Lambda | AWS Step Functions | Amazon DynamoDBMid-level Full TimeToronto, Ontario1d ago
-
AWS CDK | AWS EventBridge | AWS Glue | AWS Lambda | AWS SQSSenior-level Full TimeToronto, Ontario1d ago
-
A/B | A/B Testing | B testing | Data Warehousing | DatabasesSenior-level Full TimeRemote, Canada or US R1d ago
-
SENIOR AI ENGINEER (Canada) CAD 125K-160KAWS ECS | Amazon S3 | Background job | Background job processing | DockerComprehensive training program | Global multicultural team | Great referral programs | Growth opportunities | Product DiscountsSenior-level Full TimeCanada1d ago
-
Embedded Software Developer-Team Lead CAD 130K-140KAgile | Automated testing | Bare Metal | C# | C++In-office workSenior-level Full TimeOttawa, Ontario, Canada1d ago
-
Senior Data Engineering Developer CAD 83K-139KAPI Management | Azure API | Azure API Management | Azure Data | Azure Data FactoryEmployee assistance program | Flexible work options | Group retirement savings plans | Health and wellness programs | Mental health supportSenior-level Full TimeGuelph, Ontario, Canada; Quebec, Quebec, Canada1d ago
-
APIs | AWS | Code Refactoring | Data Modeling | Distributed SystemsContinuing education benefits | Disability | Employee stock purchase plan | Family-forming benefits | Four weeks vacationSenior-level Full TimeBurnaby, British Columbia, Canada1d ago
-
Software Developer-Embedded-Onsite Position CAD 74K-100KBare Metal | Bare metal programming | Board Bring-up | Bring-up | C#Competitive pay | Employee stock purchase plan | Health and wellness benefits | Inclusive & Supportive Culture | Learning and development opportunitiesMid-level Full TimeCanada-Ottawa1d ago
-
ARM | Bare Metal | Board Bring-up | Bring-up | C#Employee stock purchase plan | Health and wellness benefits | Inclusive & Supportive Culture | Learning and development opportunities | Paid time offSenior-level Full TimeCanada-Ottawa1d ago
-
Senior AI Engineer CAD 82K-154KAPI Gateway | API Management | ARM | Access Management | Agent OrchestrationAccident and life insurance | Health insurance | Retirement savings plans | Tuition reimbursementSenior-level Full TimeFCP, Canada1d ago
-
Software Engineer II - Machine Learning (B3617) CAD 81K-115KAIOps | AWS | Agentic AI | Azure | Azure DataCareer development | Health and well-being benefits | Mentoring programs | Paid time off | Skill developmentMid-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
Data Scientist – AI Agents & Advanced Analytics USD 84K-134KAI Agents | AWS | Agile | Apache Spark | CI/CDMid-level Full TimeCanada- Ottawa- 385 Terry Fox- Bldg …1d ago
-
Senior AI Engineer, Microsoft/Azure CAD 111K-130KAI Agents | AI Foundry | Azure | Azure Container | Azure Container AppsDefined benefit pension | Extra vacation days | Flexible work-life balance | Health dental disability and life insurance | Hybrid work modelSenior-level Full TimeOttawa (Downtown), ON, CA1d ago
-
Big Data DBT/Redshift Engineer (Contract) CAD 90K-166KAWS Glue | AWS Lambda | AWS Redshift | AWS Step Functions | Amazon AthenaSenior-level ContractVancouver, British Columbia, Canada1d ago
-
Entry-level Full Time InternshipToronto, Ontario, Canada1d ago
-
Software Developer II (AI/ML) CAD 100K-134KA/B | A/B Testing | Artificial Intelligence | B testing | BanditsDisability insurance | Health insurance | Life insurance | Paid Holidays | Retirement savings planMid-level Full TimeKanata 307 Legget Dr., Canada1d ago
-
Senior Machine Learning Engineer, vLLM CAD 142K-171KComputer Vision | Deep learning | Graph theory | Language Processing | Linear AlgebraCode review feedback culture | Open source collaboration | Remote work flexibilitySenior-level Full TimeRemote CA ON, Canada R1d ago
-
Machine Learning Engineer CAD 128K-192KDeep learning | Graph theory | Inference Optimization | LLM Inference | LLM Inference OptimizationMid-level Full TimeToronto - MSO, Canada R1d ago
-
Staff Analytics Engineer - CANADA (Remote) CAD 140K-200KAI Agents | Airflow | DBT | Data Architecture | Data ModelingRemote work | Team collaboration | Unlimited learning budgetSenior-level Full TimeCanada R1d ago
-
AWS | Agent Orchestration | Agent systems | Amazon SQS | Anthropic ClaudeHigh-growth environment | Ownership culture | Remote work | Unlimited AI token budgetSenior-level Full TimeCanada R1d ago
-
AI Programming Team Lead CAD 128K-150KChange Management | Conflict Resolution | Delegation | Editor tools | Engine knowledgeSenior-level Full TimeToronto, ON, Canada2d ago