Senior Software Engineer, AI Inference Systems
Tasks
- Architect inference stacks
- Build AI inference systems
- Conduct ML systems research
- Contribute to MLPerf Inference
- Create inference benchmarking methodologies
- Develop compiler and DSL infrastructure
- Implement parallelism strategies
- Implement speculative decoding
- Integrate research into software products
- Optimize GPU kernels
- Optimize multi GPU multi node inference workloads
- Profile and benchmark inference performance
- Schedule and orchestrate containerized deployments
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | C# | C++ | CI/CD | CRI-O | CRIU | CUDA | CUDA graph | Containerd | Cutlass | Distributed Systems | Docker | Go | Google Cloud | Inductor | Infrastructure as Code | Kubernetes | LLVM | Linux | Linux Namespaces | Linux cgroups | MLIR | MLIR LLVM | Microsoft Azure | NCCL | NVIDIA Nsight | NVIDIA Nsight Compute | Nsight Compute | Nsight Systems | Nvidia NSight Systems | Observability | Parallel Programming | PyTorch | Python | Rust | SGLang | Slurm | Tensor cores | TorchDynamo | Triton | VLLM | XLA | “as-code”
Education
Roles
Related jobs
-
AI GenAI Solution Lead CAD 129K-170KAI Agents | AI orchestration | AWS | Azure | Cloud ArchitectureEducational assistance | Health insurance | Paid parental leave | Paid time off | Recognition programsSenior-level Full TimeOttawa,Ontario,Canada15h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunity | Collaborative entrepreneurial environment | Mission impact | Remote-friendly, distributed teamMid-level Full TimeToronto, Canada22h ago
-
Battery systems | Board Support | Board Support Package | Board Support Package (BSP) | C#Mid-level Full TimeToronto; Markham; Scarborough; Brampton; North York1d ago
-
Apache Iceberg | Apache Spark | CI/CD | Clustering | CompactionDental insurance | Employee stock purchase plan | Flexible spending accounts | Health care coverage | Paid time offSenior-level Full TimeRemote Canada R1d ago
-
AI/ML Research Intern CAD 52K-64KComputer Vision | Deep learning | Graph Neural Networks | Keras | Language ProcessingEntry-level InternshipMontreal1d ago
-
Agentic AI Platform Engineer (PL862) CAD 120K-170K.NET | AI Foundry | AWS Bedrock | Access Management | Agentic AICross-functional collaboration | Downtown office 2 days per week | Hybrid work modelSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Developer, Data Science CAD 85K-112KAirflow | Apache Beam | Apache Spark | BigQuery | CI/CDAccessibility accommodations during hiring | Hybrid workMid-level Full TimeToronto, ON, CA1d ago
-
AI Model Deployment | AI model | API Development | AWS | C#Dental insurance | Disability insurance | Employee assistance program | Employee savings program | Fully remote within CanadaSenior-level Full TimeCanada R1d ago
-
Director, AI & Data Science USD 200K-200KAI Foundry | AWS Bedrock | Agent Builder | Agent Orchestration | Agentic SystemsCompetitive benefits | Hybrid work | Professional developmentExecutive-level Full Time135 W 26th Street, New York, …1d ago
-
API Monitoring | Background Processing | CI/CD | Celery | DockerCollaborative cross-functional environment | High-autonomy environment | Opportunity to shape AI architecture | Remote work flexibilitySenior-level Full TimeCanada1d ago
-
API Development | Apache Airflow | Azure Data | Azure Data Factory | Azure Data LakeCareer advancement | Collaborative environment | Continuous learning | Health benefits | Innovation-focused cultureSenior-level Full TimeCanada1d ago
-
Staff Data Scientist I, Rewards Economy CAD 100K-140KContextual Bandits | Data Analysis | Deep Q-Learning | Econometrics | Machine LearningCompany-wide events | Game nights | Team lunchesSenior-level Full TimeMontreal R1d ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R1d ago
-
Lead Software Engineer - MLOps CAD 90K-140KAPIs | APM | AWS | CI/CD | Cloud NativeCareer growth opportunities | Hybrid work flexibility | Mentorship and training | Well-being focused workplace | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada2d ago
-
Machine Learning Engineer CAD 99K-149KAPI Development | Agentic Workflows | Backend Development | Data Pipelines | LLM orchestrationEmployee assistance program | Insurance coverage | Paid Holidays | Retirement plans | Vacation timeMid-level Full TimeToronto Office TRO, Canada2d ago
-
Staff Machine Learning Engineer, AI Processors CAD 131K-181KAgentic AI | C++ | Computer Vision | Edge Computing | Embedded SystemsSenior-level Full TimeMarkham, Ontario, Canada2d ago
-
Lead Software Engineer - MLOps CAD 90K-140KAPI Development | AWS | CI/CD | Cloud Native | Cloud Native ArchitectureCareer path opportunities | Employee well-being programs | Hybrid work arrangement | Training and coaching | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada2d ago
-
Entry-level Full Time661 University Avenue, Toronto, Ontario, Canada2d ago
-
AI scientist for Quantum Computing CAD 114K-170KBenchmarking | Error correction | Experimental Design | Machine Learning | Model EvaluationDental insurance | Disability coverage | Employer pension contributions | Health insurance | Life insuranceSenior-level Full TimeMontreal, Quebec, Canada2d ago
-
Data Engineer 1 CAD 85K-106KApache Spark | Automated testing | C++ | CI/CD | Data LakesCareer progression | Company pension plan | Development opportunities | Free parking | Team member offersMid-level Full TimeLangley Office - Langley BC, Canada2d ago
-
Data Engineer CAD 80K-122KAWS | AWS Glue | AWS Lambda | Access Control | Amazon DynamoDBContinuous learning opportunities | Dental insurance | Employee assistance program | Growth opportunities | Health insuranceMid-level Full Time200 Apple Mill Rd 700,Vaughan,ON, Canada2d ago
-
Site Reliability Engineer, Inference Infrastructure USD 165K-267KAmazon Web Services | C plus plus | Cloud platform | Distributed Systems | GPU401k matching | Co working Benefit | Company offsite | Education and learning stipend | Health and dental benefitsMid-level Full TimeToronto2d ago
-
Staff Software Engineer, Inference Infrastructure USD 160K-220KAmazon Web Services | Azure | C++ | Cloud platform | Distributed Systems401k | Annual company offsite | Arts and culture budget | Education and learning stipend | Health and dental benefitsSenior-level Full TimeSan Francisco2d ago
-
Researcher – AI/ML Real-Time Embedded OS CAD 100K-168KAssembly | C++ | Deep learning | FreeBSD | FreeRTOSSenior-level Full TimeOttawa, Ontario, Canada2d ago
-
Adversarial Networks | Android | C++ | Computer Vision | Convolutional Neural NetworksEntry-level Full TimeMarkham, Ontario, Canada2d ago