Principal Machine Learning Engineer, Evaluation
AMER - Canada - Ontario - Toronto - University Ave
CAD 128K-180K (estimate) Senior-level Full Time
Tasks
- Build evaluation tooling and automation
- Communicate evaluation findings and recommendations
- Curate process and analyze evaluation data
- Design evaluation protocols
- Document model quality issues and prioritize investigations
- Translate product requirements into evaluation criteria
- Validate ML product experiences
Perks/Benefits
Skills/Tech-stack
AWS | Automation | Azure | BIM | CAD | Cloud Computing | Data Pipelines | Machine Learning | PyTorch | Python | Ray | Regression testing | Statistical Analysis | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Engineer - ML & RL CAD 93K-116KAgent systems | Contextual bandit | Deep learning | DeepSpeed | Distributed TrainingMid-level Contract Full TimeEdmonton, Alberta, Canada9h ago
-
Senior MLOps Engineer CAD 175K-200KAccess Management | Argo | CI/CD | CircleCI | Cloud platformDental insurance | Extended long weekends | Flexible work hours | Health insurance | Holiday shutdownSenior-level Full TimeToronto, Ontario13h ago
-
AI Solutions Engineer CAD 100K-120KAI workflow | AI workflow automation | API Integration | Content Management | Content Management SystemsEmployee discounts | Group benefits | Paid time off | RRSP matchMid-level Full TimeHybrid- Toronto, ON R18h ago
-
Ansible | Backup and Recovery | Barman | Bash | Cause analysisAI assisted tooling support | Flexible location in Canada | Healthcare benefits | Inclusive work culture | Professional developmentSenior-level Full TimeCanada R18h ago
-
Summer Student - Data Engineer CAD 65K-85KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cause analysisCommunity involvement | Free tea and coffee | Training and educationMid-level Full TimeWinnipeg, MB, CA21h ago
-
Senior Technical VP - AI & Efficient Deep Learning CAD 121K-220KAI chip | AI chip architecture | Artificial Intelligence | Chip architecture | Co-designSenior-level Full TimeMarkham, Ontario, Canada1d ago
-
AWS EC2 | AWS Glue | AWS Lambda | AWS S3 | AWS Step FunctionsSenior-level Full TimeMontreal, Quebec, Canada1d ago
-
Data Engineer CAD 86K-136KAPI Management | App Service | Azure | Azure App | Azure App ServiceFlexible work environment | Health benefits | Learning and development | Paid time off | Retirement savings plansMid-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …1d ago
-
Senior Backend Engineer CAD 126K-170KAWS | Access Management | Algorithms | Automated testing | AzureDental insurance | Employee Assistance Program (EAP) | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Canada - ON R1d ago
-
Senior Engineer, Data Platform CAD 145K-185KAWS | Access Control | Amazon Redshift | Apache Airflow | Apache FlinkSenior-level Full TimeMovable Ink - Toronto1d ago
-
Intermediate AI Developer (AI First) CAD 111K-132KAPI Integration | Agile | C# | C++ | Cost OptimizationHealth and safety focus | Remote workMid-level Full TimeEdmonton, AB, Canada1d ago
-
Senior Backend Engineer, Analytics CAD 140K-180KAWS | CI/CD | Cloud platform | Code review | Distributed SystemsFinancial benefits | Medical benefits | Other benefitsSenior-level Full TimeMovable Ink - Toronto1d ago
-
Data Engineer CAD 108K-162KAirflow | Amazon Redshift | Amazon Web Services | Apache Beam | Apache KafkaCareer development | Competitive benefits package | Flex Time Off | Hybrid work from homeMid-level Full TimeWinnipeg1d ago
-
Senior AI Engineer CAD 120K-150KAgent Orchestration | Agent systems | Artificial Intelligence | Autonomous Agents | Dynamic routingBirthday off | Generous vacation package | Health days | Health spending account | Hybrid workSenior-level Full TimeToronto R1d ago
-
Senior Data Engineer CAD 112K-140KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeCanada1d ago
-
AWS | Agent systems | Anthropic | Azure | CI/CDHybrid workSenior-level Full TimeMontreal, Quebec, Canada1d ago
-
3D Geometry | 6D Pose Estimation | AWS | C plus plus | Computer VisionAutonomy | High-impact work | In-person collaboration | Learning cultureSenior-level Full TimeVancouver, British Columbia1d ago
-
Elastic AI Engineer - Canada (Remote) CAD 101K-161KAWS | Agent Orchestration | Azure | Docker | ElasticsearchEmployee donations match | Flexible work schedule | Generous vacation days | Health coverage | Parental leaveMid-level Full TimeCanada R1d ago
-
Analytics engineering | BigQuery | DBT | Dashboard Development | Data ModellingCross-functional collaboration | Documentation and enablement culture | Remote-first teamMid-level Full TimeCanada1d ago
-
Senior / Staff Engineer, Data Platform CAD 103K-140KAirflow | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingCompany-wide events | Game nights | Hybrid work | Team lunchSenior-level Full TimeMontreal R1d ago
-
Senior Data Engineer – Big Data & Analytics Platforms CAD 130K-144KApache Airflow | Apache Hive | Apache Spark | Apache Zeppelin | CloudHybrid work option | Remote work optionSenior-level Full TimeToronto, ON, Canada1d ago
-
ISP Platform AI Software and Driver Architect CAD 135K-220KArtificial Intelligence | C++ | Camera Drivers | Computer Vision | Edge AISenior-level Full TimeMARKHAM, ON, Canada2d ago
-
Senior AI Engineer CAD 90K-140KAPIs | AWS | AWS Lambda | Chatbot Development | Continuous DeliveryCareer development | Hybrid work flexibility | Networking opportunities | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada2d ago
-
Senior AI Engineer CAD 90K-140KAPIs | AWS | AWS Lambda | Amazon Web Services | Artificial IntelligenceCareer growth | Employee well-being support | Hybrid work option | Networking opportunities | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada2d ago
-
Senior Analyst, Data Platform DevOps CAD 102K-130KAWS CloudFormation | Ansible | Apache Airflow | Apache Hadoop | Apache KafkaSenior-level Full TimeEdmonton, Canada2d ago