Technical Manager - LLMs, RAG and ML
Tasks
- Build evaluation methods for LLM workflows
- Coach and develop AI and product talent
- Create test datasets and benchmark approaches
- Define AI product requirements
- Design and prototype LLM enabled workflows
- Develop Retrieval-augmented generation solutions
- Guide responsible AI practices and human oversight
- Lead cross functional delivery and scalable production handoffs
- Monitor AI performance against KPIs
- Provide technical leadership across product engineering data science and UX
- Recommend model selection and retrieval architecture
- Translate AI strategy into technical roadmap
Perks/Benefits
- Advancement opportunities
- Education assistance program
- Employee assistance program
- Flexible schedule
- Hybrid work opportunities
- Life insurance
- Long term disability benefits
- Medical/Dental/Vision insurance
- Paid time off
- RRSP company match
- Short-term disability
- Workplace mental health resources
Skills/Tech-stack
AWS | Benchmarking | Embedding Models | Evaluation | Fine Tuning | Function Calling | Language Models | Language Processing | Large Language Models | LoRA | Machine Learning | Model Orchestration | Monitoring | NLP | Natural Language | Natural Language Processing | Prompt engineering | Prompt evaluation | Python | Retrieval Indexing | Retrieval-Augmented Generation | Semantic Search | Structured Output | Tool/function calling | Vector Databases | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Sr Manager, Data Engineering CAD 94K-176KAI | AWS | AWS Glue | Agile | Amazon RedshiftHealth insurance | Hybrid work 2 days per week in office | Retirement savings plan | Tuition reimbursementSenior-level Full TimeSCC, Canada1d ago
-
Vice President, AI Software Engineering CAD 208K-333KAgentic AI | CI/CD | Code review | Data Engineering | DatabricksExecutive-level Full TimeToronto, Canada1d ago
-
Manager, Data and Analytics CAD 50K-54KAzure Databricks | BI reporting | Data Analysis | Data Modeling | Data integrationEmployee recognition program | Hybrid work arrangement | Paid time off for growth and development | Vacation offering | Wellbeing supportMid-level Full TimeToronto-81 Bay, 26th Floor, Canada1d ago
-
Product Manager - Data Platform CAD 109K-121KAzure Data | Azure Data Lake | Data Cataloging | Data Governance | Data Health MetricsAdoption support | Allyship and inclusion communities | Caregiver leave | Continuous development support program | Employee assistance programMid-level Full TimeRemote or Mississauga R2d ago
-
Staff Software Engineer Data - DC Tech Lead USD 148K-242KDBT | Databricks | ETL | PySpark | Python401k match | Flexible remote work | Health and wellness benefits | Home office stipend | Mental health supportSenior-level Full TimeRemote - Toronto, Ontario, Canada R2d ago
-
Senior Manager, Data Engineering CAD 113K-156KAgile | Apache Spark | Azure | Big Data | Cloud servicesDisability benefits | Health insurance | Holidays | Life insurance | Paid vacationSenior-level Full TimeOntario, Canada2d ago
-
Director, Financial Crime Analytics and Model Validation CAD 110K-180KAI Explainability | Backtesting | Data Governance | Data Lineage | Data Quality20 vacation days per year | Flexible benefits | Global Learning Center Access | Hybrid work environment | Inclusive cultureExecutive-level Full TimeSun Life Toronto One York, Canada2d ago
-
Advanced Analytics Manager CAD 102K-134KBusiness Intelligence | Business performance | Business performance management | Data Analysis | Data PipelinesDental insurance | Employee Assistance Program (EAP) | Flexible work programs | Health insurance | Hybrid work modelMid-level Full TimeToronto, ON, CA2d ago
-
Senior Product Manager, ETF Analytic and Data Solutions CAD 140K-160KAWS EMR | AWS S3 | Amazon QuickSight | Bloomberg | CiroHybrid work | Time off and leaves | Workplace accommodationsSenior-level Full TimeToronto - 100 Adelaide St W, …2d ago
-
Manager, Growth & Analytics CAD 69K-129KAWS | Artificial Intelligence | Campaign analytics | Data Governance | Data VisualizationAccident insurance | Health insurance | Life insurance | Retirement savings plans | Training and coachingSenior-level Full TimeFCP, Canada2d ago
-
Senior Manager, Wealth Growth & Analytics CAD 86K-160KAWS | Analytics | Artificial Intelligence | Campaign Measurement | Data GovernanceSenior-level Full TimeFCP, Canada2d ago
-
BCBS 239 | Capital Markets | Compliance Risk | Compliance Risk and Control Assessment | Control AssessmentMid-level Full TimeToronto, ON, CA, M5H 0B43d ago
-
Associate Manager, Changeover Data & Analytics CAD 53K-88KAWS | Artificial Intelligence | Azure | Cloud platform | ClouderaCareer growth opportunities | Continuing education program | Employee product discounts | Mental health benefits | Performance incentivesMid-level Full TimeMobile Location Ontario [F009], Canada3d ago
-
Manager, Sales Force & Channel Effectiveness - Oncology- (Business Analytics Manager) 12 month contract CAD 135K-178KArtificial Intelligence | Business Intelligence | Clustering | Dashboard Development | Data GovernanceContract Benefits Program | Flex benefits | Paid vacation | Personal days | Retirement savings planSenior-level Full TimeCanada - Mississauga3d ago
-
Senior Manager, Wealth Growth & Analytics CAD 86K-160KAWS | Agentic Systems | Artificial Intelligence | Campaign Measurement | Data GovernanceAccident insurance | Health insurance | Life insurance | Retirement savings plans | Tuition reimbursementSenior-level Full TimeFCP, Canada3d ago
-
Manager, Data & Analytics Business Partner CAD 106K-138KAI/ML | Business Intelligence | Data analytics | Databricks | Microsoft FabricFlexible paid Values Days | Hybrid work | Inclusion and Diversity support | Paid training and development | Paid volunteer daysSenior-level Full TimeSurrey, BC, V3T 0P9, CAN4d ago
-
Senior Manager, Analytics & Insights CAD 86K-130KAzure | Code Quality | DAX | Data Modeling | Data VisualizationFlexible benefits | Holistic wellbeing programsSenior-level Full TimeToronto, ON, CA, M5J2M44d ago
-
Data Analytics Manager CAD 125K-173KAutomation | Collibra | Dashboards | Data Engineering | Data GovernanceGlobal recognition programs | Hybrid work flexibility | Insurance plans | Paid parental leave | Retirement plansMid-level Full TimeToronto, Canada4d ago
-
Manager, Data Analytics CAD 120K-150KA/B | A/B Testing | B testing | Data Visualization | ForecastingContinuing education | Disability insurance | Employee stock purchase plan | Health benefits | Life insuranceMid-level Full TimeBurnaby, British Columbia, Canada4d ago
-
Manager, Data Engineer CAD 120K-140KAzure DevOps | CI/CD | Cloud Data | Cloud Data Platforms | Data CleansingMid-level Full TimeBrookfield Place, Canada4d ago
-
Data Analytics Manager CAD 125K-173KAutomation | Collibra | Dashboards | Data Governance | Data LineageGlobal recognition programs | Hybrid working | Insurance plans | Paid parental leave | Retirement plansMid-level Full TimeToronto, Canada4d ago
-
Lead Generative AI Engineer Manager, SVP CAD 145K-217KCloud Architecture | Data loading | FastAPI | Generative AI | Language ProcessingSenior-level Full TimeLocation(s): Mississauga, Ontario, Canada4d ago
-
APIs | DAX | Data Modeling | Data Warehouse | ETLMid-level Full TimeMarkham, Ontario, Canada5d ago
-
Senior Technical Product Manager - ML & Analytics USD 92K-142KAgile | Analytics | Artificial Intelligence | Data Pipelines | Data Science401k plan | Commuter benefits | Dental insurance | Employee stock purchase program | Fitness reimbursementSenior-level Full TimeAustin, TX; Toronto, Canada5d ago
-
Manager, Reporting Analytics CAD 80K-128KAWS | Anomaly Detection | Automation | Business Intelligence | Data AnomalyHybrid work options | Wellness programsMid-level Full TimeSun Life Toronto One York, Canada5d ago