Principal Machine Learning Engineer, Evaluation
AMER - Canada - Ontario - Toronto - University Ave
CAD 128K-180K (estimate) Senior-level Full Time
Tasks
- Build evaluation tooling and automation
- Communicate evaluation findings and recommendations
- Curate process and analyze evaluation data
- Design evaluation protocols
- Document model quality issues and prioritize investigations
- Translate product requirements into evaluation criteria
- Validate ML product experiences
Perks/Benefits
Skills/Tech-stack
AWS | Automation | Azure | BIM | CAD | Cloud Computing | Data Pipelines | Machine Learning | PyTorch | Python | Ray | Regression testing | Statistical Analysis | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Data Engineer CAD 92K-171KAPI Integration | Agile | Alerting | Azure | Batch ProcessingCross-functional development opportunities | Employee resource groups | Flexible vacation | Online courses | Personal daysSenior-level Full TimeToronto, ON, CA, M5H4A610h ago
-
API Design | Asynchronous programming | Auditability | Azure | Azure KubernetesAfter hours coverage | Hybrid workSenior-level ContractToronto, Canada22h ago
-
Mid-level Full TimeMarkham, Canada22h ago
-
AI Agents | Computer Vision | Edge AI | Language Models | LinuxEntry-level Full TimeSaskatoon, SK, CA, S7K 5R61d ago
-
APIs | Airbyte | Apache Airflow | DBT | Data ModelingHome office setup budget | Language learning sessions | Paid sick days | Paid time off | Professional development courses accessSenior-level Full TimeCanada R1d ago
-
Senior Data Engineer CAD 64K-106KApache Airflow | Azure | Bash | Change Data Capture | Cloud SDKCareer growth opportunities | Continuing education | Performance incentives | Product Discounts | Retirement programsSenior-level Full Time20 Eglinton West, Canada1d ago
-
Principal Software Engineer, Agentic AI DevOps CAD 185K-309KAWS | DevOps | Generative AI | Go | Information RetrievalSenior-level Full TimeVancouver, British Columbia, CAN1d ago
-
AI DevOps Engineer CAD 125K-214KAWS | Argo CD | Argo CD GitOps | Azure | BTP Cloud FoundryHealth and wellbeing support | Hybrid work model | In office requirement 3 days per week | Learning and skill growthSenior-level Full TimeVancouver, British Columbia, CA, V6B 1A91d ago
-
Backend Developer - Machine Learning Platform CAD 112K-141KAWS | Application design | Distributed Systems | Java | KubernetesMid-level Full TimeMontreal (Province of Quebec, Canada)1d ago
-
Machine Learning Engineer CAD 70K-100KAWS | Data cleaning | Django | GRPC | KubernetesBirthday off | Parental leave | Remote-first | Work anywhere up to 3 months | Work from home stipendMid-level Full TimeCanada - Remote, E. Europe - … R1d ago
-
Async Programming | Cloud Native | Concurrency | Distributed Systems | Failure recoveryCareer growth | Fully remote | International team collaborationSenior-level Full TimeCanada R2d ago
-
Embedded Systems Designer CAD 65K-80KAlgorithms | C# | C++ | CAN bus | Data StructuresCommunity involvement | Dental insurance | Disability insurance | Employee assistance program | Gym subsidy programMid-level Full TimeWinnipeg, MB, R2K 0Y2, CA2d ago
-
Anomaly Detection | Dashboards | Data Modeling | Data Pipelines | Data QualityContinuous learning | Education support | Employee discounts | Family support | Flexible time offMid-level Full TimeCanada2d ago
-
Applied AI Engineer CAD 115K-150KAWS SageMaker | Agent Orchestration | Azure ML | DVC | Deep learningAutonomy | Continuous learning culture | Equity participation | International team | Mission-driven workMid-level Full TimeMontreal, QC2d ago
-
Staff Engineer, Data & Analytics CAD 118K-162KApache Airflow | CI/CD | Cloud platform | Containerization | DBTFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level Full TimeRemote, Canada R2d ago
-
Apache Airflow | Apache Hadoop | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada2d ago
-
Apache Airflow | Apache Iceberg | Apache Spark | Data Lakehouse | Data orchestrationSenior-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada2d ago
-
ML Engineer CAD 88K-132KAgentic Workflows | Application Programming | Application Programming Interfaces | Data Pipelines | DockerEmployee assistance program | Health insurance | Paid Holidays | Paid time off | Retirement plansMid-level Full TimeToronto Office TRO, Canada2d ago
-
AWS | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon AthenaHybrid work environmentSenior-level Full TimeSt. John's - 18 Hebron Way, …2d ago
-
Senior-level Full TimeRemote - Canada R2d ago
-
Senior Data Engineer CAD 138K-168KAWS | Amazon S3 | Apache Airflow | Apache Spark | Data GovernanceCareer coaching and support | In-office culinary options | Inclusive family building benefits | Long term savings or retirement plans | Mental health wellness and fitness benefitsSenior-level Full TimeVancouver, BC R2d ago
-
Ingénieur en IA/AI Engineer CAD 118K-152KArtificial Intelligence | Automated decision making | Cloud Computing | Data Engineering | Data PipelinesBusiness coaching | Employee assistance program | Fitness reimbursement | Health insurance | Paid disabilitySenior-level Full TimeCanada - Montreal2d ago
-
Data Engineer CAD 108K-199KAzure Data | Azure Data Factory | Azure Data Lake | Azure Event | Azure Event HubsSenior-level Full TimeToronto2d ago
-
Data Scientist, AI Deployment CAD 112K-168KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewComprehensive medical, dental, & vision insurance | Employee stock purchase plans | Equal Paid Parental Leave | Flexible paid time off | Hybrid workMid-level Full TimeToronto2d ago
-
AWS | Angular | Azure | C++ | Cloud platformCorporate discounts | Development opportunities | Flexible work environment | On-site gym | Pension planEntry-level Full TimeToronto, ON, Canada2d ago