Senior Software Developer, LLM Infrastructure
Tasks
- Benchmark model quality against production requirements
- Build and maintain LLM hosting infrastructure
- Design backend systems
- Develop evaluation and benchmarking tooling
- Drive cost optimization and infrastructure efficiency
- Ensure observability for backend systems
- Implement model routing frameworks
- Provision and manage GPU infrastructure
Perks/Benefits
- Employee resource groups
- Health benefits
- Life insurance
- Vacation days
- Wellness days
- Work from outside Canada days
Skills/Tech-stack
AWS | Bedrock | FastAPI | Kafka | Kubernetes | Litellm | Postgres | Python | Ray | Redshift | Snowflake | Terraform | VLLM
Education
N/A
Related jobs
-
(Canada) Principal ML System Engineer CAD 153K-200KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote or Mississauga R6h ago
-
ML Engineer CAD 160K-180KA/B | A/B Testing | Anomaly Detection | B testing | BigQueryDental insurance | Health insurance | Hybrid work environment | Vision insuranceMid-level Full TimeVancouver R10h ago
-
Senior AI Data Engineer CAD 119K-154KAI Agents | Agent Orchestration | BigQuery | CRM | Customer DataHealth benefits | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - Canada R16h ago
-
Senior Data Engineer CAD 120K-145KAzure Fabric | CI/CD | Data Modeling | Data Transformation | Data extractionFlexible working hours | Health and wellness benefits | Learning and development | Parental leave | Retirement planningSenior-level Full TimeToronto R17h ago
-
Data Engineer CAD 90K-125KAzure | Azure Fabric | Batch Ingestion | CI/CD | DBTFlexible working hours | Health and wellness benefits | Learning and development | Parental leave program | Retirement planningMid-level Full TimeToronto R17h ago
-
Senior Data Engineer II, Finance CAD 188K-198KAirflow | Amazon Redshift | Apache Iceberg | Apache Spark | Cloud DataAnnual refresh grants | Equity grant | Remote work flexibilitySenior-level Full TimeCanada - Remote (ON, AB, BC, … R17h ago
-
C++ | CI/CD | CMake | Data Visualization | Data analyticsDental insurance | Health insurance | Hybrid work | Paid time off | Personal daysMid-level Full TimeMontréal, QC, Canada R19h ago
-
AWS | Access Management | Agile | Automated testing | AzureFull time schedule 36 25 hours per week | Occasional travel within Alberta | Remote work | Work performed within CanadaSenior-level ContractEdmonton, Canada R20h ago
-
Airflow | BigQuery | CI/CD | DBT | Data GovernanceInclusive culture | Remote-friendly environment | Significant ownershipSenior-level Full TimeCanada R1d ago
-
Senior Developer, Data Engineering CAD 94K-128KAWS | AWS CDK | AWS CloudFormation | AWS DMS | AWS GlueFlexible group benefits | Hybrid work options | Learning and development opportunities | Savings plans | Wellbeing supportSenior-level Full TimeFCC Tower, Canada R1d ago
-
Senior Developer (Data Engineering) CAD 107K-145KAWS CloudFormation | AWS DMS | AWS Data | AWS Data Pipeline | AWS GlueFlexible group benefits | Hybrid work options | Learning and development opportunities | Wellness programsSenior-level Full TimeFCC Tower, Canada R1d ago
-
Enterprise AI Engineer CAD 83K-104KAI Agents | AI Governance | API Integration | Anthropic | Artificial IntelligenceBirthday off | Dental benefits | Disability benefits | Employee assistance program | Extended health benefitsSenior-level Full TimeToronto Head Office, Canada R1d ago
-
Software Engineer - AI Developer Productivity USD 165K-330KAudit Logging | Authentication | Authorization | CI/CD | Context ManagementCompany facilitated 401k | Fertility and family building stipend | Flexible PTO | Medical dental vision insurance 100 percent | Paid parental leaveSenior-level Full TimeSan Francisco R1d ago
-
Senior AI Engineer - Grafana AI/ML | USA | Remote CAD 129K-217KAWS | Agent Frameworks | Agent workflows | Artificial Intelligence | Cloud ComputingAnnual leave | Company RSUs | Relocation N/A | Remote workSenior-level Full TimeCanada (Remote) R1d ago
-
Senior Software Engineer, Data Systems CAD 123K-187KAirflow | Amazon Redshift | Apache Kafka | Backpressure | Capacity PlanningDental coverage | Flexible work hours | Fully remote | Health insurance | Parental leave top-upsSenior-level Full TimeCanada (Remote) R1d ago
-
Ingénieur(e) IA Générative - Hébergement De Modèles LLM CAD 101K-133KC plus plus | CI/CD | Chaos Engineering | Device plugins | DockerSenior-level Full TimeMontreal,Quebec,Canada R1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R1d ago
-
Aerial Imagery | Airflow | Computer Vision | DBT | DagsterDistributed team collaboration | Fully remote | Technical ownership | Visa sponsorship not availableSenior-level Full TimeCanada R2d ago
-
ML Engineer – Generative AI & LLMs (Remote) CAD 129K-174KAWS | Agent systems | Agentic Systems | Apache Spark | AzureAccountability culture | Competitive compensation | Remote workMid-level Contract Full TimeToronto, ON, Canada R2d ago
-
Airflow | Computer Vision | Computer vision models | DBT | DagsterCanada based candidates preferred | Climate focused initiatives | Cross-functional collaboration | Fully remote work | Impact on infrastructure resilienceSenior-level Full TimeCanada R2d ago
-
AI Agents | API Integration | Access Control | Amazon Bedrock | Argo CDCollaborative culture | Equity or bonus opportunities | Professional growth opportunities | Remote work within Canada | Work on cutting edge AI and cloud projectsSenior-level Full TimeCanada R2d ago
-
AI Search | Agile | Azure AI | Azure AI Search | Azure DataAccident insurance | Health insurance | Hybrid work | Life insurance | Retirement savings plansSenior-level Full TimeFCP, Canada R2d ago
-
AI Developer II (Intermediate) CAD 94K-115KAWS Bedrock | Agentic AI | Agentic Orchestration | Amazon SageMaker | CI/CDEmployee share purchase plan | Extra paid days off | Flexible work arrangements | Hybrid work model | Pension planMid-level Full TimeMontréal, 2020 Robert-Bourassa, Canada R2d ago
-
AI Engineer CAD 145K-180KAPI Gateway | API Integration | Backend Development | Cloud Platforms | CrewAISenior-level Full TimeOntario - Remote, Canada R2d ago
-
Data Science ML/GenAI Engineer CAD 80K-120KBM25 | CI/CD | Cosine similarity | Data Analysis | Databricks401k plan with company match | Flexible work options | Medical, dental, and vision insurance | On-call compensation | Paid HolidaysMid-level Full TimeQuébec City, Quebec, Canada - Remote R2d ago