Senior Machine Learning QA Developer
AMER - Canada - Ontario - Toronto - University Ave
CAD 98K-144K (estimate) Senior-level Full Time
Tasks
- Automate ML QA workflows
- Build deployment pipeline quality checks
- Build training pipeline quality checks
- Contribute to multi team codebases
- Create structured evaluation rubrics
- Create test harnesses
- Define ML quality strategy
- Define acceptance criteria
- Design model evaluation suites
- Detect data drift
- Document evaluation findings
- Evaluate RL CAD model outputs
- Implement quality gates
- Maintain test datasets
- Maintain test harnesses
- Participate in code reviews
- Perform API testing
- Present evaluation findings
- Provide feedback in code reviews
- Set evaluation metrics
- Set regression checks
- Test ML models from product side
Perks/Benefits
Skills/Tech-stack
API Testing | AWS | Airflow | Azure | CI/CD | Cloud platform | Data Pipelines | Data Validation | Data labeling | Data orchestration | Design Patterns | Drift Detection | Experiment tracking | GitHub Actions | Google Cloud | Google Cloud Platform | Jenkins | MLOps | MLflow | Machine Learning | Machine Learning Quality | Metaflow | Model Benchmarking | Model Evaluation | Model Monitoring | PyTorch | Python | QA Framework | Software Architecture | TensorFlow | Test Framework | Test automation | UAT
Related jobs
-
AODA | Agile | CI/CD | Cognos | Data GovernanceContinuous improvement activities | Knowledge transfer support | Public sector domain experienceMid-level ContractQueen's Park Ontario Provincial Government, Canada9h ago
-
Computer Vision, AI (Co-op) CAD 51K-64KComputer Vision | Data Analysis | Data cleaning | Data labeling | Edge ComputingEntry-level Full TimeSaskatoon, SK, CA, S7K 5R618h ago
-
Computer Vision | Document processing | Edge AI | Intelligent agents | Language ModelsEntry-level Full TimeSaskatoon, SK, CA, S7K 5R618h ago
-
Senior Software Engineer, Data CAD 247K-375KAWS DMS | AWS Glue | AWS RDS | Amazon Kinesis | Amazon RedshiftFlexible work hours | Health/dental coverage | Parental leave top-ups | Remote work | Unlimited PTOSenior-level Full TimeCanada (Remote) R18h ago
-
Advisor, Data engineering CAD 58K-90KAlgorithms | Data Engineering | Data Mining | Data Modeling | Data PipelinesFlexible vacation | Group insurance | Health and wellness reimbursement | Pension plan | TelemedicineMid-level Full TimeComplexe Desjardins Montréal, Canada23h ago
-
Advisor, Data engineering CAD 60K-90KCloud Data | Cloud Data Platforms | Data Engineering | Data Mining | Data ModelingFlexible vacation | Group insurance | Health and wellness reimbursement | Pension plan | TelemedicineMid-level Full TimeComplexe Desjardins Montréal, Canada23h ago
-
Senior Machine Learning Engineer CAD 170K-250KAPI Design | C# | C++ | Data Engineering | Deep learningSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada23h ago
-
Software Engineer - AI Pipelines CAD 112K-168KAPI | Asynchronous processing | CI/CD | Context Management | DebuggingFlex work | In-office collaboration | Remote/hybrid scheduleSenior-level Full TimeCanada, ON, Toronto23h ago
-
Product Reliability Engineer (Analytics) CAD 96K-127KData Analysis | KPI Reporting | Microsoft 365 | Python | SQLEmployee assistance program | Hybrid work | Learning and career development | Paid time off | Transit subsidyMid-level Full TimeVancouver1d ago
-
Staff Analytics Engineer CAD 120K-147KAWS Step Functions | Access Control | Airbyte | Apache Airflow | Cost OptimizationPaid time off | Professional growth opportunities | Supportive, inclusive work environmentSenior-level Full TimeCanada1d ago
-
Analytics Engineer CAD 115K-135KAutomated testing | BigQuery | CI/CD | Containerization | DBTComputer purchase program | Employee technology purchase program | Employer pension contribution | Enhanced parental leave | Equity optionsMid-level Full TimeMontreal, Quebec, Canada R1d ago
-
Automated testing | Burst | C# | C++ | CI/CDCommuting cost reimbursement | Employee activities and prizes | Employee and family assistance program | Fitness classes | Flexible scheduleSenior-level Full TimeMontreal, QC, Canada1d ago
-
Senior Data Engineer, Analytics Platform CAD 90K-110KAzure Data | Azure Data Factory | CI/CD | Data Factory | Data Governance4 weeks vacation | Best-in-class tools | Paid health insurance | Teamwork Friendly Working Framework | Unlimited mental health servicesSenior-level Full TimeVancouver, Canada1d ago
-
Senior Data Engineer, Analytics Platform CAD 90K-110KAzure Data | Azure Data Factory | CI/CD | Data Factory | Data GovernanceBest-in-class tools | Career growth | Collaborative work environment | Paid vacation | Premium insuranceSenior-level Full TimeVancouver, Canada1d ago
-
Intermediate AI/ML Engineer CAD 98K-125KAWS | Computer Vision | Data Pipelines | Experimentation | JavaScriptHealth spending account | Health/dental coverage | Hybrid work | Paid time off | Wellness reimbursementMid-level Full TimeOttawa Office1d ago
-
Senior-level Full TimeToronto, Canada1d ago
-
Senior Developer - Data Strategy and Analytics CAD 74K-118KAI/ML | Agile | Azure | Change Management | Data GovernanceSenior-level Full TimeMarkham, ON, CA1d ago
-
Spécialiste en intégration robotique CAD 104K-130KABB | Control Systems | Fanuc | Industrial Automation | Machine ControlCareer development plan | Community engagement events | Comprehensive health insurance | Hybrid work | Mentorship programSenior-level Full TimeMontréal, QC, Canada1d ago
-
Prompt Engineer CAD 110K-140KAgile | Data Visualization | Hugging Face | Language Models | Language ProcessingMid-level Full TimeToronto , Canada1d ago
-
AWS Technical Lead - Data & Analytics CAD 140K-160KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsCareer advancement | Comprehensive benefits plan | Employee referral program | Flexible work environment | Hybrid work scheduleSenior-level Full TimeMarkham, ON, Canada1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote-friendly environment | Supportive teamMid-level Full TimeOttawa, Canada1d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Career growth opportunities | Friendly work environmentMid-level Full TimeCalgary, Canada1d ago
-
Senior AI Engineer CAD 129K-179KAI Foundry | AI Search | Agentic AI | Azure | Azure AIDental insurance | Employee assistance program | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …1d ago
-
Data Engineer CAD 105K-129KApache Spark | Azure Data | Azure Data Factory | CI/CD | Cost OptimizationSenior-level Full TimeTD Centre - TD Tower - …1d ago
-
Data Engineer CAD 90K-100KAzure Data | Azure Data Factory | Azure Data Lake | Cloud Architecture | Data FactoryCoaching opportunities | Dental insurance | Flexible hybrid policy | Health insurance | Higher education certification policySenior-level Full TimeMississauga, ON, Canada1d ago