Senior Software Engineer, AI Inference Systems
Tasks
- Architect scheduling and orchestration for inference deployments
- Benchmark GPU kernels and inference
- Build compiler infrastructure and DSLs
- Conduct and publish ML systems research
- Contribute features to vLLM
- Define inference benchmarking methodologies
- Develop and optimize GPU kernels
- Profile and optimize inference framework
Perks/Benefits
- N/A
Skills/Tech-stack
C# | C++ | CI/CD | CUDA | CUDA graph | Cutlass | Docker | Go | Infrastructure as Code | Kubernetes | LLVM | Linux | Linux Namespaces | Linux cgroups | ML system performance profiling | MLIR | MLPerf Inference | NCCL | Nsight Compute | Nsight Systems | Observability | Performance Profiling | PyTorch | Python | Rust | SGLang | Slurm | System Performance Profiling | Tensor cores | TorchDynamo | TorchInductor | Triton | VLLM | XLA | “as-code”
Education
Related jobs
-
Active Learning | Calibration | Causal Inference | Constrained optimization | Contextual BanditsSenior-level Full TimeHybrid- Toronto, ON R8h ago
-
Machine Learning Engineer USD 150K-250KLanguage Processing | Machine Learning | Natural Language | Natural Language Processing | PyTorchOpen source portfolio | Publications in ML venues | Startup experience | Understanding model failures in the wild | Visa sponsorshipMid-level Full TimeToronto Hybrid R12h ago
-
Sr Analytics Developer, Finance, Brokerage & Market Risk CAD 151K-189KAWS | Amazon Redshift | Amazon S3 | Apache Airflow | DBTEmployer matched savings plan | Flexible sick leave | Health benefits | Life insurance | Paid vacationSenior-level Full TimeRemote (Canada) R14h ago
-
Senior MLOps Engineer II (AI Native) USD 148K-216KAWS | Apache Airflow | Apache Ray | Apache Spark | Azure Storage401k match | Employee assistance program | Health insurance | Mental wellness program | Paid parental leaveMid-level Full TimeRemote, USA ; Remote, Canada R15h ago
-
Data Engineer, DMP CAD 87K-108KApache Airflow | Apache Spark | BigQuery | Cloud Dataflow | Data ModelingBirthday day off | Course Reimbursement Program | Free online doctor visits | Hybrid work environment | Learning academyMid-level Full TimeOakville, Canada R17h ago
-
Data Engineer CAD 100K-170KAWS | Apache Airflow | Azure | BigQuery | Cloud Computing401k | Asynchronous work culture | Autonomy | Company paid life insurance | Disability coverageMid-level Full TimeRemote - US or Canada R19h ago
-
Senior Embedded Software Developer CAD 94K-115KC# | C++ | Git | Golang | LinuxCompany paid medical, dental, and vision | Critical illness insurance | Disability insurance | Employee assistance program | Flexible leave policiesSenior-level Full TimeBurnaby, BC, Canada1d ago
-
AWS | Access Control | Alerting | Audit Logging | AzureCollaborative environment | Fully remote option in Canada | Mentoring and leadership opportunities | Opportunity to shape organization wide machine learning and generative AI infrastructure strategySenior-level Full TimeCanada R1d ago
-
AWS | AWS CloudFormation | Alerting | Amazon Kinesis | Apache FlinkCollaborative environment | Comprehensive medical benefits | Financial benefits | Remote work (Canada) | Technical ownershipMid-level Full TimeCanada R1d ago
-
AI Powered Engineering tools | AI-powered engineering | Audit Readiness | ClickHouse | Code reviewCareer growth | Distributed First Collaboration | Fully remote | High autonomy | Learning cultureSenior-level Full TimeCanada R1d ago
-
AI Assisted Development | Analytical Databases | ClickHouse | Data Engineering | Data PipelinesFully remote work | Mentorship opportunities | Significant autonomy | Technical leadership autonomySenior-level Full TimeCanada R1d ago
-
AWS | Access Control | Apache Airflow | Apache Flink | ClickHouseCollaborative work environment | Comprehensive medical benefits | Inclusive workplace | Remote work opportunity | Technical growth and learningSenior-level Full TimeCanada R1d ago
-
Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 200K-400KClaude Code | Cursor | JavaScript | OpenAI Codex | PythonSenior-level Full TimeMiami R1d ago
-
AWS | Agile | Amazon SageMaker | Automated testing | CI/CDSenior-level Full TimeAMER - Canada - Quebec - …1d ago
-
Agent Orchestration | Agent SDK | Automated testing | CI/CD | Claude Agent SDKHybrid work environmentMid-level Full TimeMontreal 700, Canada R1d ago
-
Java Spark Developer CAD 70K-95KApache Spark | CI/CD | Collections Framework | Concurrency | Core JavaCompany holidays | Disability insurance | Employee assistance program | Life insurance | Medical, dental, and vision coverageSenior-level Full TimeMontreal, CA1d ago
-
Staff Engineer - Analytics & Data Architecture USD 220K-262KClickHouse | Columnar Execution | Connection pooling | Data Architecture | Data IngestionLTD insurance | Life insurance | Meal allowance | Medical, dental coverage | OffsitesSenior-level Full TimeRemote - Canada R1d ago
-
Software Development (Embedded) Engineer CAD 96K-146KAI Assisted Development | ARM | ASPICE | AUTOSAR | Build configurationSenior-level Full TimeOttawa, ON, Canada R1d ago
-
Senior Software Engineer, AI CAD 135K-170KAPIs | Agent Orchestration | Agent workflows | Airflow | AlbertSenior-level Full TimeRemote, Canada R1d ago
-
Fullstack Software Engineer CAD 176K-226KAPI Design | Java | JavaScript | Node.js | Performance EngineeringSenior-level Full TimeCA-Ontario-Toronto R1d ago
-
AI Ops Engineer - Professional Services CAD 120K-170KAPI | Agentic Workflows | Embeddings | LLM | LangchainEmployee resource groups | Floating holidays | Wellness day | Work-life balanceSenior-level Full TimeCanada1d ago
-
APIs | AWS | Access Management | Azure | Azure DataFull-time role | Occasional travel within Alberta | Remote within CanadaSenior-level Full TimeEdmonton, Alberta; Calgary - Remote Position, … R1d ago
-
Intermediate Data Engineer CAD 65K-75KAzure Data | Azure Data Factory | Azure Functions | CI/CD | Data FactoryEmployee perks | Health/Dental/Vision | Paid time off | RRSPMid-level Full TimeVancouver, BC, V6J 4S6, CAN1d ago
-
Senior-level Full TimeToronto, None; Toronto, Ontario; Markham, Ontario1d ago
-
C++ | CI/CD | Debugging | Git | JenkinsSenior-level Full TimeToronto, Ontario1d ago