Senior Manager, Machine Learning (Data Operations)
Tasks
- Audit labeled dataset quality
- Define labeling guidelines and taxonomies
- Define labeling pipeline and integration requirements
- Design gold standard datasets
- Drive continuous labeling operations improvement
- Identify and remediate mislabeled data
- Manage Label Studio projects and workflows
- Measure cost per label and turnaround time
- Partner with machine learning and product teams on labeling task design
- Set inter annotator agreement targets
- Set quality SLAs and run calibration sessions
- Source and manage labeling vendors and BPOs
- Support active learning and model assisted labeling initiatives
- Track label accuracy and IAA metrics
- Translate model requirements into labeling programs
Perks/Benefits
- Flexible PTO
- Home office stipend
- Medical, dental, and vision coverage
- WeWork access
- Wellness programs
Skills/Tech-stack
Active Learning | Annotation quality | Calibration | Data Engineering | Data Operations | Data labeling | Document extraction | Entity recognition | Error Taxonomy | Gold Standard | Gold Standard Evaluation | Intent detection | Inter-annotator agreement | Label Studio | Machine Learning | Named Entity Recognition | Python | SQL | Text Classification
Education
N/A
Related jobs
-
Data & AI Advisory Associate Manager CAD 88K-136KComputer Vision | Customer Analytics | Data Governance | Data Management | Data ScienceMid-level Full TimeToronto, 40 King St W., Corp, …1d ago
-
Manager, Merchandising Analytics CAD 68K-93KGCP | LLM | Language Processing | Machine Learning | MicrostrategyFlexible work environment | Learning opportunities | MentoringMid-level Full Time1 Presidents Choice Circle, Brampton, ON, …1d ago
-
Data Science Manager, Risk CAD 90K-130KData Pipelines | Decision Tree | Feature Engineering | Loss forecasting | Machine LearningContinuing education stipend | Generous time off | Health and Wellness Spending Accounts | Hybrid work environment | Medical/Dental/Vision insuranceMid-level Full TimeToronto, Ontario R1d ago
-
Embedded Technical Account Manager (Onsite) CAD 74K-118KAPIs | Cause analysis | Data Analysis | Enterprise Software | JSONMid-level Full TimeCanada1d ago
-
Senior Manager AI Solutions Architecture CAD 131K-164KAPI Integration | AWS | Agents | Artificial Intelligence | AtlassianSenior-level Full TimeVancouver, British Columbia, Canada2d ago
-
Senior Manager, Compliance and AML, Data Analytics CAD 86K-156KClient Risk | Client risk rating | Dashboards | Data Automation | Data GovernanceCareer development | Employee share ownership plan | Health benefits | Inclusive workplace | Pension plan matchingSenior-level Full TimeToronto, ON, CA, M5H1B62d ago
-
Business Intelligence | Cloud platform | Credit Risk | Credit Risk Management | Credit ScoreSenior-level Full TimeToronto, ON, CA, M5H1B62d ago
-
AWS | Agentic AI | Agile | Amazon Bedrock | Apache AirflowSenior-level Full TimeToronto, Ontario; New York, USA; Bay … R3d ago
-
Senior Manager, Data Engineer - Collections CAD 94K-130KData Governance | Data Modeling | Data Quality | Data integration | Database ArchitectureComprehensive benefits | Flexible vacation | Personal days | Sick days | Workplace accommodationsSenior-level Full TimeToronto, ON, CA, M1L4S24d ago
-
Senior Manager, LMT Reporting & Analytics CAD 86K-160KAutomation | Behavior scoring | Cause analysis | Credit Risk | Credit ScoringCareer development | Inclusive work environment | Internal training resources | Professional growth opportunitiesSenior-level Full TimeToronto, ON, CA, M5H1B64d ago
-
Senior Manager, Collections Strategy & Analytics CAD 84K-136KAI | Behavioral Scoring | Credit Risk | Credit Scoring | Decision ScienceSenior-level Full TimeToronto, ON, CA, M5H1B64d ago
-
Manager, Analytics and Data Enablement CAD 115K-145KArtificial Intelligence | Automation | Cloud Computing | Data Governance | Data LineageAnnual wellness allowance | Community volunteering opportunities | Employee Discounts on Auto and Property Insurance | Employee discounts | Flexible work arrangementsMid-level Full TimeCanadian Head Office, Canada4d ago
-
AI Governance | Application Modernization | Application Platforms | Artificial Intelligence | Business DevelopmentSenior-level Full TimeVancouver, Canada4d ago
-
Manager/ Senior Manager - Analytics Consulting (Pharma) CAD 101K-140KCampaign Measurement | Data Science | Data Visualization | Databricks | Digital KPI TrackingCareer development opportunities | Entrepreneurial environment | Global team collaboration | High responsibilitySenior-level Full TimeCanada - Remote R4d ago
-
Sr. Data Analytics Manager (MHS/Injectables) CAD 99K-132KData Lineage | Data Modeling | Data Quality | Data Quality Management | Data WarehousingSenior-level Full TimeMississauga, ON, CAN - 2300 Meadowvale …5d ago
-
Artificial Intelligence | B2B SaaS | Capital raising | Customer Value | Go-to-marketAutonomy | Equity stakeMid-level Full TimeMontreal, Quebec, Canada5d ago
-
AI Search | Ahrefs | Answer Engine Optimization | Content Strategy | Core Web VitalsAnnual reviews | Hybrid work | Paid Holidays | Paid sick leave | Paid vacationMid-level Full TimeVancouver, British Columbia, Canada6d ago
-
DBT | Dashboards | Data Dictionary | Data Modeling | Data VisualizationComprehensive health benefits | Parental leave plans | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - Toronto R7d ago
-
A/B | A/B Testing | Attribution Modeling | B testing | Bayesian analysisCareer growth opportunities | Employee benefits and wellness programs | Equity opportunities | Flexible ways of working | High impact analytics projectsMid-level Full TimeCanada8d ago
-
A/B | A/B Testing | Advertising analytics | Airflow | B testingEquity grants | Flexible remote work | Professional developmentSenior-level Full TimeCanada8d ago
-
Bloomberg | Data Preprocessing | Data Visualization | Excel | MATLABFlexible benefits programs | Holistic well-beingSenior-level Full TimeToronto, ON, CA, M5H 1H18d ago
-
Senior Manager, Counterparty Credit Risk Analytics CAD 82K-154KAutomation | Basel | CSA | CVA | Collateral ManagementAccident and life insurance | Health insurance | Hybrid work mode | Retirement savings plans | Tuition reimbursementSenior-level Full TimeYNG, Canada8d ago
-
Manager, Cards Credit Strategy and Data Analytics CAD 67K-110KCredit Risk | Credit Risk Analysis | Data Mining | Data Visualization | ExcelBonuses | Career development coaching | Flexible benefits | Stock optionsMid-level Full TimeRBC WATERPARK PLACE, 88 QUEENS QUAY …8d ago
-
AI | Advanced Analytics | Analytics | Automation | Business Intelligence401k matching | Employee stock purchase program | Fully remote options | Health and wellness benefits | Hybrid work optionsMid-level Full TimeCanada R8d ago
-
Mid-level Full TimeRemote, Canada R9d ago