Staff + Senior Software Engineer, Inference
Tasks
- Analyze observability data to tune performance
- Build deployment pipelines for model releases
- Build real time resilient flexible systems
- Design distributed systems for inference
- Develop request routing and load balancing
- Implement traffic management systems
- Integrate new AI accelerator platforms
- Manage multi-region deployments and geographic routing
- Maximize compute efficiency with autoscaling
- Operate production inference infrastructure
- Orchestrate production and research workloads
- Support inference for new model architectures
Perks/Benefits
Skills/Tech-stack
AWS | Autoscaling | Azure | Batching | Caching | Cloud infrastructure | Deployment Pipelines | Distributed Systems | GCP | Inference Optimization | Kubernetes | LLM Inference | LLM Inference Optimization | Load Balancing | Machine Learning | Observability | Orchestration | Request Routing | Traffic Management
Education
Related jobs
-
Staff Software Engineer, Data (AI) USD 210K-260KAI Evaluation | API | AWS | Amazon Redshift | Data EnrichmentBereavement leave | Fertility and growing family support | Flex Time Off | Health, dental, vision insurance | Life insuranceSenior-level Full TimeAmericas (USA or Canada) R17h ago
-
AI/ML Ops Engineer CAD 131K-164KAWS | Amazon Bedrock | Amazon ECS | Amazon EKS | Amazon SageMaker401k | Dental insurance | Discretionary time off | Health insurance | Life insuranceMid-level Full TimeRemote - Canada R19h ago
-
Analytics instrumentation | Automated testing | Backend APIs | CI/CD | Cloud infrastructureFoundational ownership | High autonomy | Remote workMid-level Full TimeCanada R1d ago
-
Generative AI Cloud Operations Engineer - Evinova CAD 134K-176KAWS | AWS CDK | Anthropic | Arize Phoenix | Azure Machine LearningHybrid work arrangementMid-level Full TimeCanada - Mississauga R1d ago
-
Active Learning | Calibration | Causal Inference | Constrained optimization | Contextual BanditsSenior-level Full TimeHybrid- Toronto, ON R3d ago
-
Machine Learning Engineer USD 150K-250KLanguage Processing | Machine Learning | Natural Language | Natural Language Processing | PyTorchOpen source portfolio | Publications in ML venues | Startup experience | Understanding model failures in the wild | Visa sponsorshipMid-level Full TimeToronto Hybrid R3d ago
-
Sr Analytics Developer, Finance, Brokerage & Market Risk CAD 151K-189KAWS | Amazon Redshift | Amazon S3 | Apache Airflow | DBTEmployer matched savings plan | Flexible sick leave | Health benefits | Life insurance | Paid vacationSenior-level Full TimeRemote (Canada) R3d ago
-
Senior MLOps Engineer II (AI Native) USD 148K-216KAWS | Apache Airflow | Apache Ray | Apache Spark | Azure Storage401k match | Employee assistance program | Health insurance | Mental wellness program | Paid parental leaveMid-level Full TimeRemote, USA ; Remote, Canada R3d ago
-
Data Engineer, DMP CAD 87K-108KApache Airflow | Apache Spark | BigQuery | Cloud Dataflow | Data ModelingBirthday day off | Course Reimbursement Program | Free online doctor visits | Hybrid work environment | Learning academyMid-level Full TimeOakville, Canada R3d ago
-
Data Engineer CAD 100K-170KAWS | Apache Airflow | Azure | BigQuery | Cloud Computing401k | Asynchronous work culture | Autonomy | Company paid life insurance | Disability coverageMid-level Full TimeRemote - US or Canada R3d ago
-
AWS | Access Control | Alerting | Audit Logging | AzureCollaborative environment | Fully remote option in Canada | Mentoring and leadership opportunities | Opportunity to shape organization wide machine learning and generative AI infrastructure strategySenior-level Full TimeCanada R4d ago
-
AWS | AWS CloudFormation | Alerting | Amazon Kinesis | Apache FlinkCollaborative environment | Comprehensive medical benefits | Financial benefits | Remote work (Canada) | Technical ownershipMid-level Full TimeCanada R4d ago
-
AI Powered Engineering tools | AI-powered engineering | Audit Readiness | ClickHouse | Code reviewCareer growth | Distributed First Collaboration | Fully remote | High autonomy | Learning cultureSenior-level Full TimeCanada R4d ago
-
AI Assisted Development | Analytical Databases | ClickHouse | Data Engineering | Data PipelinesFully remote work | Mentorship opportunities | Significant autonomy | Technical leadership autonomySenior-level Full TimeCanada R4d ago
-
AI-assisted debugging | Audit Logging | Backup | Cause analysis | ClickHouseAI assisted engineering practices | Cross-functional collaboration | High availability government cloud exposure | Ownership and autonomy | Professional growth through experimentationSenior-level Full TimeCanada R4d ago
-
AI Assisted Development | Backup and Recovery | ClickHouse | Cloud Compliance | Data PipelinesAsynchronous collaboration | Fully remote work | High-autonomy culture | Opportunities for experimentation and continuous learning | Ownership based engineeringSenior-level Full TimeCanada R4d ago
-
AWS | Access Control | Apache Airflow | Apache Flink | ClickHouseCollaborative work environment | Comprehensive medical benefits | Inclusive workplace | Remote work opportunity | Technical growth and learningSenior-level Full TimeCanada R4d ago
-
Agent Orchestration | Agent SDK | Automated testing | CI/CD | Claude Agent SDKHybrid work environmentMid-level Full TimeMontreal 700, Canada R4d ago
-
AWS Lambda | AWS S3 | Amazon Bedrock | Amazon Q | Amazon Q BusinessHybrid work model | Networking opportunities | Training and coaching | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada R4d ago
-
Staff Engineer - Analytics & Data Architecture USD 220K-262KClickHouse | Columnar Execution | Connection pooling | Data Architecture | Data IngestionLTD insurance | Life insurance | Meal allowance | Medical, dental coverage | OffsitesSenior-level Full TimeRemote - Canada R4d ago
-
Senior Software Engineer, AI CAD 135K-170KAPIs | Agent Orchestration | Agent workflows | Airflow | AlbertSenior-level Full TimeRemote, Canada R4d ago
-
APIs | AWS | Access Management | Azure | Azure DataFull-time role | Occasional travel within Alberta | Remote within CanadaSenior-level Full TimeEdmonton, Alberta; Calgary - Remote Position, … R4d ago
-
Senior Machine Learning Engineer CAD 150K-188KAdvertising Auctions | Airflow | Automated retraining | BigQuery | Convolutional Neural Networks401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - Ontario, Canada R4d ago
-
Software Engineer, Data Platform CAD 130K-165KAWS | Access Control | Amazon Redshift | Apache Airflow | Apache FlinkFinancial benefits | Medical benefits | Other benefits | Performance bonusMid-level Full TimeMovable Ink - Toronto (Remote) R4d ago
-
Data Engineer, Event Data CAD 130K-165KAWS | AWS CloudFormation | Alerting | Amazon Kinesis | Apache FlinkFinancial benefits | Medical benefits | Other benefitsMid-level Full TimeMovable Ink - Toronto (Remote) R4d ago