Senior Machine Learning QA Developer
AMER - Canada - Ontario - Toronto - University Ave
CAD 98K-144K (estimate) Senior-level Full Time
Tasks
- Automate ML QA workflows
- Build deployment pipeline quality checks
- Build training pipeline quality checks
- Contribute to multi team codebases
- Create structured evaluation rubrics
- Create test harnesses
- Define ML quality strategy
- Define acceptance criteria
- Design model evaluation suites
- Detect data drift
- Document evaluation findings
- Evaluate RL CAD model outputs
- Implement quality gates
- Maintain test datasets
- Maintain test harnesses
- Participate in code reviews
- Perform API testing
- Present evaluation findings
- Provide feedback in code reviews
- Set evaluation metrics
- Set regression checks
- Test ML models from product side
Perks/Benefits
Skills/Tech-stack
API Testing | AWS | Airflow | Azure | CI/CD | Cloud platform | Data Pipelines | Data Validation | Data labeling | Data orchestration | Design Patterns | Drift Detection | Experiment tracking | GitHub Actions | Google Cloud | Google Cloud Platform | Jenkins | MLOps | MLflow | Machine Learning | Machine Learning Quality | Metaflow | Model Benchmarking | Model Evaluation | Model Monitoring | PyTorch | Python | QA Framework | Software Architecture | TensorFlow | Test Framework | Test automation | UAT
Related jobs
-
Specialist, Analytics (Developer) CAD 90K-141KAzure | Business Warehouse | Data Modeling | Data Warehousing | Data integrationMid-level Full TimeREGINA, SK, CA8h ago
-
Agile | Apache Spark | Data Engineering | Design Patterns | JavaMid-level Full TimeToronto, Ontario, CAN14h ago
-
Chemistry & Python Expert - Freelance AI Trainer CAD 70K-70KC# | Computational Chemistry | MATLAB | Molecular Modeling | NumPyProject based workSenior-level FreelanceCanada - Remote R14h ago
-
Technical Services Engineer, Named Accounts CAD 115K-160KActive Directory | Alerting | Amazon Web Services | Application Performance Analysis | Application performanceSenior-level Full TimeVancouver15h ago
-
Mid-level Full TimeToronto16h ago
-
Data Engineering, Team Lead CAD 113K-139KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeAdditional statutory holidays | Defined benefit pension | Flexible benefits | Health and dental coverage | Incentive program eligibilitySenior-level Full TimeVancouver, British Columbia, Canada17h ago
-
Embedded Software Developer CAD 84K-100KARM Cortex | ARM Cortex-M | AWS IoT | Bluetooth Low Energy | C#Disability insurance | Employee assistance program | Employee discounts | Employee events | Free on-site parkingMid-level Full TimeTrois-Rivieres, Quebec, Canada19h ago
-
Senior-level Full TimeRemote - Canada R19h ago
-
3D Geometry | AWS Step Functions | Apache Airflow | Apache Beam | Apache SparkDental insurance | Flexible hours | Health insurance | Unlimited vacation | Vision insuranceSenior-level Full TimeToronto, ON21h ago
-
Senior Data Engineer, PickupXP CAD 136K-170KAirflow | Apache Spark | Bash | Data Modeling | Data PipelinesHybrid work scheduleSenior-level Full TimeToronto, Canada21h ago
-
Associate Technical Services Engineer II CAD 94K-130KAPI | AWS | Azure | Benchmarking | Cloud platformDental insurance | Flexible paid time off | Health insurance | Mental health counseling | Parental leaveMid-level Full TimeToronto22h ago
-
Lead Data Engineer CAD 115K-125KAirflow | Dagster | Data Modeling | Data Warehousing | Database performanceSenior-level Full TimeLondon, Ontario23h ago
-
AI Developer – Agentic Systems, RAG & AI Infrastructure CAD 116K-148KAgentic AI | CI/CD | GitHub | GitHub Actions | Inference OptimizationHybrid workMid-level Full TimeOttawa, Ontario, Canada23h ago
-
Agentic AI Developer (Client Facing) CAD 115K-150KAI Evaluation | AI Prototyping | AWS | Agent Frameworks | AzureMid-level Full TimeRemote, Canada R1d ago
-
Architect, Machine Learning CAD 125K-170KAgentic Systems | Artificial Intelligence | Explainability | Generative AI | Language ModelsCareer development | Flexible vacation | Flexible work options | Hackathons | Mentorship programsSenior-level Full TimeRemote, Canada R1d ago
-
Principal Software Development Engineer, MLOps CAD 168K-252KAWS | Access Control | Amazon SageMaker | CI/CD | Cloud EngineeringSenior-level Full TimeCanada, ON, Toronto1d ago
-
AWS | Azure | CI/CD | Cloud Platforms | Cross-validationHybrid work model | Ongoing training and career development supportEntry-level Apprenticeship Full TimeMontreal, QC1d ago
-
Senior Software Developer, AI Solutions CAD 108K-158KAPI Management | Active Directory | Agent Orchestration | Amazon Q | AutomationEmployee share purchase program | Paid time off | Retirement planSenior-level Full TimeWaterloo, Ontario, Canada1d ago
-
Data Engineer CAD 95K-145K.NET | Agile | Apache Airflow | Apache NiFi | ArgoDental insurance | Employee assistance program | Gym discounts | Health insurance | Paid HolidaysSenior-level Full TimeOttawa 1 Chrysalis, Canada1d ago
-
Senior AI/ML Research Engineer CAD 120K-179KAgent systems | Agentic AI | Artificial Intelligence | Data Science | Generative AIConference presentation opportunities | Hybrid work model | Mentorship opportunitiesSenior-level Full TimeToronto, CAN, Canada1d ago
-
AI/ML Engineer CAD 128K-192KAWS | CI/CD | Cloud platform | Computer Vision | Data PreprocessingHybrid work modelMid-level Full TimeToronto, CAN, Canada1d ago
-
Applied AI Specialist – AI Solutions CAD 76K-104KAWS | Automated testing | Azure | CI/CD | DockerBackground check after conditional offer | Health and welfare benefits | Paid time off | Wellness programsMid-level Full TimeToronto, Canada1d ago
-
Applied AI Specialist – Data Systems CAD 62K-86KAWS | Anomaly Detection | Apache Airflow | Azure | CI/CDHealth and welfare benefits | Paid time offMid-level Full TimeToronto, Canada1d ago
-
Associate AI Engineer CAD 69K-115KAPI Development | AWS | Azure | Data Pipelines | Distributed ComputingDental insurance | Flexible work environment | Health insurance | Life and AD and D insurance | Paid time offMid-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …1d ago
-
Aircraft Icing | C# | C++ | CATIA | CFDDental insurance | Disability insurance | Employee assistance program | Flexible work schedule | Hybrid work arrangementSenior-level Full TimeDorval, Québec, CA, H4S 1Y91d ago