LLM Inference Performance & Evals Engineer
Toronto, Ontario, Canada
CAD 142K-195K (estimate) Mid-level Full Time
Tasks
- Build performance eval pipelines
- Debug numerical accuracy issues
- Develop experiment automation
- Optimize low level inference performance
- Profile runtime performance
- Prototype and benchmark AI model ideas
- Schedule experiment runs
- Triage performance regressions
- Validate models on wafer scale hardware
Perks/Benefits
Skills/Tech-stack
Attention Mechanisms | C# | C++ | Compiler optimization | Debugging | Flash Attention | High Performance | High-Performance Computing | KV cache | Kernel development | LLVM | MLIR | Machine Learning | Mixture of Experts | Performance Computing | Performance Profiling | Python | Quantization | Runtime integration | Speculative decoding | Transformers | Triton
Education
N/A
Related jobs
-
AWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon S3Senior-level ContractToronto, Canada2h ago
-
Entry-level ContractWillowdale East (Newtonbrook), Canada3h ago
-
Claude | Copilot | Excel | Microsoft 365 | Microsoft PowerPointMental health support | Volunteer days | Work from home optionEntry-level Full Time InternshipCA Victoria, Canada16h ago
-
Senior Data Analytics Engineer CAD 120K-145KBI Dashboards | CI/CD | Common table expressions | DBT | Data DocumentationCollaborative team environment | Global company | Remote-friendly work environmentSenior-level Full TimeRemote - Canada R18h ago
-
Senior Data Engineer CAD 120K-144KAWS | Amazon Web Services | CI/CD | CloudFormation | Data ModelingCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeToronto, ON, Canada19h ago
-
Senior Analytics Engineer | Canada | Remote CAD 129K-155KAWS | BigQuery | DBT | Data Cataloging | Data ModelingAnnual leave policy | Global culture | In-person onboarding | Remote workSenior-level Full TimeCanada (Remote) R20h ago
-
Associate AI Engineer CAD 60K-80KAWS | Agile | Docker | ETL | GCPDental insurance | Health insurance | Hybrid work | Learning and development | Vision insuranceMid-level Full TimeToronto, Ontario R20h ago
-
Staff MLOps Engineer | Ingénieur·e MLOps Staff CAD 115K-203KApache Airflow | Automation | CI/CD | Data Drift | Data VersioningTravel for workSenior-level Full TimeMontréal, QC, Canada22h ago
-
Machine Learning Intern/Co-op (Fall, 2026) CAD 60K-60KCUDA | Distributed Training | GPU | JAX | MLIRCo-working stipend | Health and dental benefits | Inclusive culture | Lunch stipend | Parental leave top-upEntry-level InternshipCanada23h ago
-
C++ | CPU | Deep learning | GPU | Game enginesSenior-level Full TimeMontreal, QC, Canada1d ago
-
API | Distributed Systems | Documentation | JAX | LibraryDental insurance | Health insurance | Hybrid work | Mental health stipend | Professional development stipendSenior-level Full TimeCanada1d ago
-
AI Scientist - Deployment of Agentic AI CAD 103K-153KAgentic AI | Artificial Intelligence | Biomedical Informatics | Clinical data | Decision Support SystemsCorporate discounts | Development opportunities | Flexible work environment | Healthcare pension plan | Promotions within organizationExecutive-level Full TimeToronto, ON, Canada1d ago
-
Access Control | Agile | Azure Data | Azure Data Factory | Azure Data LakeHybrid work | Potential permanent employmentSenior-level ContractToronto, Canada1d ago
-
API Integration | Automation | Data Modeling | Database performance | Database performance tuningCollaborative fast-paced culture | Flexible work location | Fully remote work | High-ownership environmentSenior-level Full TimeCanada R1d ago
-
Embedded Software Engineer CAD 96K-132KARM | Bash | C# | C++ | CVSDental insurance | EAP | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeToronto, ON, Canada1d ago
-
Airflow | Apache Spark | Azure | Azure Event | Azure Event HubsBackground check requirement | Competitive employee benefits | Employee resource groups membership | Flexible work schedules | Hybrid work environmentSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada1d ago
-
Agile | Azure | Azure Machine Learning | CI/CD | Computer VisionEmployee Background Check Support | Employee resource groups membership | Flexible work schedule | Hybrid work environment | Mentorship opportunitiesSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada1d ago
-
Data Engineer II CAD 81K-115KApache Spark | Azure Functions | Azure SQL | Data Lakehouse | DatabricksCareer development | Mentoring | Training and onboardingMid-level Full TimeTD Centre - South - 79 …1d ago
-
Senior Backend Engineer CAD 140K-188KAccess Management | Algorithms | Authentication | Authorization | Automated testingDental insurance | Employee assistance program | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Canada - ON R1d ago
-
Senior Developer, Analytics Enablement and Total Fund Solutions Delivery (Temporary - 12 months) CAD 85K-130KASP.Net Core | Angular | Azure DevOps | C# | CI/CDCareer development | Group insurance plans | Hybrid work model | Paid family leave | Pension plansSenior-level Full Time TemporaryMontreal, Canada1d ago
-
Software Engineer, Data Refinery CAD 94K-106KAWS | Apache Beam | Apache Spark | Azure | Cloud DataflowSenior-level Full TimeWaterloo - 27 Gaukel, Canada1d ago
-
Backend & Applied AI/ML Engineer CAD 98K-131KApache Spark | Hugging Face | Java | Kotlin | NoSQLMedical benefits | Paid time off | Parental leave | RRSP eligibilityEntry-level Full TimeToronto, Canada1d ago
-
Senior/Principal Machine Learning Engineer CAD 188K-282KAWS | Cloud Computing | Data Processing | Deep learning | GCPFlexible work schedule | Hybrid workSenior-level Full TimeCanada, ON, Toronto1d ago
-
Backend Engineer, Data CAD 172K-258KApache Airflow | Apache Hadoop | Go | Java | LLMCompany bonus | Equity | Health benefits | Hybrid work | Remote workEntry-level Full TimeCanada1d ago
-
Staff Data Engineer CAD 180K-195KAmazon Redshift | BigQuery | CDC | DBT | Data GovernanceCompassion leave | Local meetups | Paid sick and safe time | Pension contribution | Remote-firstSenior-level Full TimeCalgary, Alberta, Canada R1d ago