AI Inference Core - Infrastructure SW Engineer
US and Canada Offices
CAD 155K-210K (estimate) Senior-level Full Time
Tasks
- Build reusable abstractions for scheduling and distributed execution
- Debug issues across Python applications and distributed services
- Define APIs and data models for infrastructure systems
- Design develop test maintain Python frameworks and services
- Implement concurrency and asynchronous execution handling
- Partner with platform CI release quality and ML teams to translate requirements into software designs
- Write automated tests and documentation
Perks/Benefits
- N/A
Skills/Tech-stack
Asynchronous execution | Asyncio | Concurrency | Concurrent Futures | Containers | Coordination | Distributed Systems | Eventual Consistency | Filesystems | Idempotency | Kubernetes | Multiprocessing | Networking | Operating Systems | Python | Retries | Scheduling | State management | Threading | Timeouts
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R20h ago
-
Machine Learning Engineer CAD 110K-130KAmazon Web Services | C++ | Cloud platform | Code Quality | Computer VisionEmployee wellness programs | Free on-site gym | Hybrid work option | Modern office | On-site daycareMid-level TemporaryToronto, Ontario, CA R1d ago
-
Full-Stack AI Engineer CAD 90K-129KAuthentication | CSS | Caching | Design Systems | Design tokensD E I Initiatives | Fertility and menopause leave | Fitness allowance | Growth opportunities | Health benefits packageMid-level Full TimeToronto R1d ago
-
Backend Engineer, Multi-cloud Inference Platform USD 234K-319KAmazon Web Services | Backend Engineering | Cloud platform | Distributed Systems | GenAI401k matching | Flexible paid time off | Health insurance | Local meetups | Remote workMid-level Full TimeUnited States / Canada R1d ago
-
Cloud Inference Engineer USD 166K-273KAutoscaling | Cold Start | Cold Start Optimization | Distributed KV Cache | Distributed SystemsMid-level Full TimeUnited States / Canada R1d ago
-
AI Solutions Deployment Manager, Cloud Applied AI, Telco USD 183K-265KAgentic AI | Cloud Architecture | Cloud platform | Conversational AI | Evaluation FrameworksSenior-level Full TimeWaterloo, ON, Canada; New York, NY, …2d ago
-
ADLS | Apache Beam | Apache Hudi | DLT | Data PartitioningContinuous development support program | Employee assistance program | Employee recognition | Fertility and adoption support | Flexible paid time offSenior-level Full TimeMississauga R2d ago
-
Agent systems | Backend Development | Bias Testing | Cost Optimization | Data Science401k | Flexible paid time off | Healthcare | Home office stipend | Inclusive cultureSenior-level Full TimeCanada R2d ago
-
Mid-level Full TimeToronto, ON, CA, M5H 0B32d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Diversity and inclusion | Friendly atmosphereMid-level Full TimeToronto, Canada2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Diversity and inclusion | Friendly laid-back atmosphereMid-level Full TimeVancouver, Canada2d ago
-
Machine Learning Engineer CAD 135K-195KAutomated testing | C++ | Computer Vision | Continuous integration | Convolutional Neural NetworksDental insurance | Health insurance | Paid time off | RRSP planSenior-level Full TimeToronto, Ontario, Canada R2d ago
-
Senior AI Engineer CAD 130K-170KAuthentication | BigQuery | CAG | Function Calling | GitOpsCareer growth | Healthcare benefit packageSenior-level Full TimeBrampton, Ontario, Canada2d ago
-
Senior-level Full TimeCAN - Ontario - Toronto, Canada2d ago
-
.NET | API Security | Apache Kafka | Audit Logging | AutomationCompany events | Dental insurance | Health insurance | On-site leisure facilities | On-site parkingSenior-level Full TimeAurora; Newmarket; Vaughan; Concord; Woodbridge; Maple2d ago
-
AI Engineer, Product Analytics CAD 82K-132KA/B | A/B Testing | AWS | Azure | B testingFlexible vacation | Flexible work arrangements | Headspace app access | Hybrid work model | Mental health daysMid-level Full TimeCanada, Toronto, Ontario R2d ago
-
Consultant, Data and AI Scientist CAD 92K-104KArtificial Intelligence | Azure Databricks | Copilot Studio | Data Visualization | Data analyticsHybrid work arrangement | Paid volunteer day | Training and development support | Wellbeing supportMid-level Full TimeToronto-81 Bay, 15th Floor, Canada2d ago
-
Data Engineer CAD 80K-110KData Modeling | Data Warehousing | ETL | Microsoft Fabric | Microsoft SSISEmployee benefits | Flexible schedules | Hybrid work environmentMid-level Full TimeHalifax, NS, Canada R2d ago
-
Product Support Engineer - Google Cloud Platform CAD 158K-162KAPI Testing | Apache Airflow | BigQuery | Cloud Composer | Cloud MonitoringDocumentation support | On-call supportEntry-level Full TimeCAN - Ontario - Toronto, Canada2d ago
-
Senior Machine Learning Engineer, Economist CAD 180K-190KCausal Inference | Cloud Computing | Contextual Bandits | Econometrics | Generative AIAnnual refresh grants | Equity grant | Flexible work location | Remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R2d ago
-
Cassandra | Concurrency | Continuous integration | Data Structures | ElasticsearchDonation match program | Flexible schedules | Generous vacation days | Health coverage | Matched retirement savings planSenior-level Full TimeCanada2d ago
-
Automation & AI Engineer CAD 150K10DLC | A2P | Alembic | Anthropic | Anthropic Batch APIIn studio work option | Leadership growth opportunities | Radical transparency culture | Simplicity focused teamMid-level Full TimeKelowna, BC2d ago
-
Agentic AI / Data Engineer - DC GPU CAD 131K-170KAgent Orchestration | Context engineering | Data Quality | Data poisoning | Embedding pipelinesSenior-level Full TimeCA,ON,Home Office2d ago
-
Senior-level ContractDowntown Toronto (Richmond / Adelaide / … R2d ago
-
Access Control | Anomaly Detection | CI/CD | Classification | Data GovernanceCompetitive salary | Remote working modelSenior-level Full TimeCanada3d ago