AI Inference Core - Infrastructure SW Engineer
US and Canada Offices
CAD 155K-210K (estimate) Senior-level Full Time
Tasks
- Build reusable abstractions for scheduling and distributed execution
- Debug issues across Python applications and distributed services
- Define APIs and data models for infrastructure systems
- Design develop test maintain Python frameworks and services
- Implement concurrency and asynchronous execution handling
- Partner with platform CI release quality and ML teams to translate requirements into software designs
- Write automated tests and documentation
Perks/Benefits
- N/A
Skills/Tech-stack
Asynchronous execution | Asyncio | Concurrency | Concurrent Futures | Containers | Coordination | Distributed Systems | Eventual Consistency | Filesystems | Idempotency | Kubernetes | Multiprocessing | Networking | Operating Systems | Python | Retries | Scheduling | State management | Threading | Timeouts
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Agentic Systems | BGP | DNS | Distributed Systems | EnvoyBerlitz tutoring | Catered meals | Flexible learning support | Language tutoring | MentorshipSenior-level Full TimeMontreal, Quebec; Toronto, Ontario; Remote, Canada; … R1d ago
-
Software Engineer II – GenAI Quality Engineering CAD 104K-142KAutomation frameworks | C++ | CI/CD | Cloud services | Content validationDental insurance | Disability insurance | Health insurance | Life insurance | Paid parental leaveMid-level Full TimeLocations: Vancouver, British Columbia, Canada1d ago
-
Software Engineer II – GenAI Quality Engineering CAD 89K-123KAutomated testing | Automation frameworks | C# | C++ | CI/CDFree games | Health insurance | Hybrid work | Mental health support | Paid time offMid-level Full Time地点：Vancouver, British Columbia, Canada1d ago
-
Software Engineer II – GenAI Quality Engineering CAD 89K-123KAutomated testing | Automation frameworks | C# | C++ | CI/CDFree games | Health insurance | Hybrid work schedule | Mental health support | Paid time offMid-level Full Time地点：Vancouver, British Columbia, Canada1d ago
-
Agentic Systems | Async collaboration | Distributed Systems | GitLab | GitLab IssuesFlexible paid time off | Growth and development fund | Parental leave | Remote workSenior-level Full TimeRemote, Canada; Remote, United States R2d ago
-
Staff Software Engineer - Data Platform CAD 135K-169KApache Airflow | BigQuery | CI/CD | Cloud platform | Data CatalogDental insurance | Flexible time off | LinkedIn Learning access | Medical insurance | Paid HolidaysSenior-level Full TimeCanada (Remote) R2d ago
-
Applied AI Scientist Architect (Auth0) CAD 216K-297KData Pipelines | Deep learning | Fine Tuning | Language Models | Language ProcessingDental insurance | Health insurance | Healthcare spending | Hybrid work | Paid time offSenior-level Full TimeToronto, Ontario, Canada R2d ago
-
Ingénieur Data / Data Engineer CAD 87K-115KAgile | Apache Kafka | DevOps | Git | MongoDBOn-call support | Remote Work N/AMid-level Full TimeMontréal, Quebec, Canada2d ago
-
Software Engineer II, Model Platform CAD 90K-140KAWS | Azure | Data Pipelines | Data Structures | Distributed SystemsMid-level Full TimeRemote - Canada R2d ago
-
Staff Engineer - Experimentation Platform CAD 190K-262KA/B | A/B Testing | Amazon Web Services | Analytical Data | Analytical data modelingHybrid work schedule | Remote flexibility up to 4 weeks per yearSenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON R2d ago
-
Senior AI Developer, Agentic AI CAD 121K-178KAI Evaluation | AI Search | API Development | API Management | Agent systemsEmployee and family assistance program | Flexible work schedule | Hybrid work mode | Retirement savings plan with employer match | Share purchase opportunityExecutive-level Full TimeMontreal, Quebec, Canada R2d ago
-
Machine Learning Engineer - EA Sports FC CAD 92K-129K3D Animation | 3D transformations | Argo Workflows | Azure | C++Free games | Health insurance | Hybrid work arrangement | Mental health support | Paid time offMid-level Full Time地点：Vancouver, British Columbia, Canada2d ago
-
Machine Learning Engineer - EA Sports FC CAD 92K-129K3D Animation | 3D transformations | Argo Workflows | Azure | C++Free games | Health insurance | Hybrid work arrangement | Paid time off | Retirement savingsMid-level Full Time地点：Vancouver, British Columbia, Canada2d ago
-
Machine Learning Engineer CAD 125K-154KAWS | Agentic Systems | Azure | Databricks | Databricks Vector SearchEmployee and family assistance program | Employee share ownership plan | Health and dental benefits | Hybrid work | In-store discountSenior-level Full TimeToronto, ON, M5V 1X6, CAN2d ago
-
API Development | Backend Development | Cloud platform | Data Processing | Distributed SystemsBonus | Equity | Health benefits | Professional developmentSenior-level Full TimeWaterloo, ON, Canada; Toronto, ON, Canada2d ago
-
Generative AI (GenAI) | Prompt Engineer CAD 73K-91KAI API | Anthropic API | CI/CD | Evaluation Framework | Failure mode analysisAll IT equipment provided | Annual training allowance | Healthcare insurance | Internal growth opportunities | Onboarding programMid-level Full TimeMontreal, Quebec, Canada R2d ago
-
Prompt Engineer CAD 82K-100KAPI Integration | Anthropic | Automated testing | CI/CD | Google CloudAnnual training budget | Flexible schedule | Internal growth opportunities | Medical insurance | Paid time offSenior-level Full TimeMontreal, Quebec, Canada2d ago
-
Senior Prompt Engineer (AI Clinical Products) CAD 88K-100KAPI Integration | Anthropic API | CI/CD | Clinical workflow | Clinical workflow knowledgeEquipment provided | Flexible work schedule | Healthcare insurance | Internal growth opportunities | Onboarding programSenior-level Full TimeMontreal, Quebec, Canada R2d ago
-
Data Science & AI CAD 71K-106KApache Spark | Backtesting | Calibration | Cross-validation | Data GovernanceDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeDorval, Québec, CA, H4S 1Y9 R2d ago
-
Senior Data Engineer CAD 105K-131KAutomated testing | CI/CD | Code review | Data Governance | Data LakehouseSenior-level Full TimeVictoria, Canada2d ago
-
CUDA | DVC | Distributed Systems | FastAPI | Feature StoreEmployee resource groups | Employer Matched Savings Program | Equity compensation | Flexible sick days | Health benefitsSenior-level Full TimeCanada R2d ago
-
Senior Software Engineer, Datastores (Auth0) CAD 136K-187KAmazon DynamoDB | Amazon Web Services | CI/CD | Go | KubernetesDental insurance | Health insurance | Healthcare spending account | Paid leave | Paid time offSenior-level Full TimeToronto, Ontario, Canada R3d ago
-
Jr Data Engineer CAD 125K-150KAirflow | Apache Airflow | BigQuery | Cloud Composer | Cloud RunClear internal promotion pathways | Generative AI tools access | Hybrid work | In office days per week 3 plus | In role coachingMid-level Full TimeToronto, Ontario, Canada R3d ago
-
Case management | Command Line | Command-line Interface | Documentation | LinuxHome office setup | Remote workMid-level Full TimeFrance - Courtaboeuf - 16 Avenue … R3d ago
-
Senior Embedded Software Engineer CAD 95K-153KAgile | BSP | Board Bring-up | Bring-up | C#401K company matching | Company-Paid Holidays | Employee assistance program | Employee stock purchase program | Medical, dental, and vision plansSenior-level Full TimeCanada- Ottawa- 385 Terry Fox- Bldg …3d ago