Ingénieur(e) IA Générative - Hébergement De Modèles LLM
Montreal,Quebec,Canada
CAD 101K-133K (estimate) Senior-level Full Time
Tasks
- Apply SRE and SecOps practices for reliability and security
- Build and maintain model serving services and APIs
- Create developer experience tooling with CLI SDK and templates
- Design deploy and operate GPU cluster infrastructure
- Develop agent platform runtimes and multi step workflow orchestration
- Implement secure auditable model marketplace hosting with tenant isolation
- Integrate platform with MLOps pipelines and model governance
- Lead platform architecture and implementation with Ray and NVIDIA integrations
- Optimize batching and latency for inference workloads
- Provide technical mentorship and lead design reviews
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CI/CD | CUDA | CUDA toolkit | Docker | EFK | ELK | Go | Grafana | Helm | KServe | Kubernetes | MLOps | Mixed Precision | MongoDB | Multi-tenancy | NVIDIA CUDA | NVIDIA MIG | NVIDIA NCCL | NVIDIA Triton | NVidia CUDA Toolkit | Observability | OpenAI API | OpenTelemetry | Pipeline parallelism | Prometheus | Pruning | Python | Quantization | RBAC | RDMA | Ray | SLA | SLI | SLO | SRE | SecOps | Tensor Parallelism | Torchserve
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Ingénieur(e) IA Générative - Hébergement De Modèles LLM CAD 101K-133KC plus plus | CI/CD | Chaos Engineering | Device plugins | DockerSenior-level Full TimeMontreal,Quebec,Canada R4h ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R6h ago
-
Analytics Engineer CAD 75K-122KAirflow | Alation | Amazon Redshift | BigQuery | CI/CDCompany-paid certifications | Healthcare insurance | Internal events | Internal mobility opportunities | Life insuranceMid-level Full TimeCanada14h ago
-
Airflow | Computer Vision | Computer vision models | DBT | DagsterCanada based candidates preferred | Climate focused initiatives | Cross-functional collaboration | Fully remote work | Impact on infrastructure resilienceSenior-level Full TimeCanada R18h ago
-
AI Agents | API Integration | Access Control | Amazon Bedrock | Argo CDCollaborative culture | Equity or bonus opportunities | Professional growth opportunities | Remote work within Canada | Work on cutting edge AI and cloud projectsSenior-level Full TimeCanada R20h ago
-
Senior Machine Learning Engineer CAD 170K-250KC# | C++ | Deep learning | GPU Computing | Generative AICareer development | Health and well-being benefits | Mentoring programs | Paid time off | Savings and retirement programsSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada23h ago
-
AI Search | Agile | Azure AI | Azure AI Search | Azure DataAccident insurance | Health insurance | Hybrid work | Life insurance | Retirement savings plansSenior-level Full TimeFCP, Canada R23h ago
-
Principal Machine Learning Engineer CAD 154K-232KA/B | A/B Testing | AWS | Attention Mechanisms | Automated retrainingEmployee assistance program | Health insurance | Retirement savings plan | Vacation and paid holidaysSenior-level Full TimeToronto Office TRO, Canada23h ago
-
A/B | A/B Testing | API Integration | Airflow | B testingCross-functional collaboration | Professional growth | Remote work | Self service enablementSenior-level Full TimeCanada R1d ago
-
Staff Software Engineer, Backend (Online Storage) CAD 181K-241KAWS | Capacity Planning | Connection pooling | Database Benchmarking | Disaster RecoveryDental and vision coverage | ESPP (Employee Stock Purchase Plan) | Flexible spending wallets | Health care coverage | Tech spending stipendSenior-level Full TimeRemote Canada R1d ago
-
Data Engineer USD 170K-209KAWS | Amazon Kinesis | CI/CD | Compliance Frameworks | Container OrchestrationSenior-level Full TimeUS - Remote; Canada - Remote R1d ago
-
Senior Machine Learning Engineer, Growth CAD 170K-190KAWS | Azure | CI/CD | Data Pipelines | Drift DetectionCareer growth and learning opportunities | Discount on fitness memberships | Flexible hybrid schedule | Generous vacation and PTO | Health and dental benefitsSenior-level Full TimeToronto, Ontario, Canada R1d ago
-
AWS Bedrock | Anthropic | Azure OpenAI | LLM | LangchainBabbel access | Gym access | Happy hours 5 to 7 | Health Insurance 100 percent covered | OPUS transit subsidyMid-level Full TimeMontreal, Canada1d ago
-
Mid-level Full TimeRemote, Ontario R1d ago
-
Python Developer – AI Operations CAD 90K-111KAPI Design | Agentic Workflows | Algorithms | As-a-Service | Async PythonHybrid work environmentMid-level Full TimeMontréal, Quebec R1d ago
-
Senior AI DevOps Developer [584] USD 150K-206KACP | AI Security | AWS | AgentCore) | Agentic OrchestrationCompany benefits | Learning and development opportunities | On-call rotationSenior-level Full TimeRemote (United States); Canada R1d ago
-
Staff AI Engineer CAD 170K-180KAWS Bedrock | Amazon DocumentDB | Anthropic API | Artificial Intelligence | Axe-coreDental insurance | Flex benefits | Group retirement savings plan | Health coverage | Health daysSenior-level Full TimeToronto, Ontario R1d ago
-
Senior Data Platform Developer - AI Platform CAD 104K-135KAWS | Azure | Bedrock | CrewAI | DockerElectric vehicle purchase incentive program | Flex working arrangements | Home office reimbursement | Medical and dental benefits | Online learning and networking opportunitiesSenior-level Full TimeOakville, Ontario - Canada R1d ago
-
Senior Solutions Principal CAD 126K-173KAWS | Access Control | Amazon Redshift | Apache Airflow | Apache SparkSenior-level Full TimeToronto, ON, Canada1d ago
-
Data Engineer CAD 64K-114KAgentic AI | Apache Spark | Azure Data | Azure Data Factory | Azure DatabricksDisability insurance | Extended health and dental benefits | Hybrid work | Paid time off | Perk programsMid-level Full TimeCambridge, Ontario, Canada R1d ago
-
Staff Engineer (AI & Engineering) CAD 140K-170KAI Application Development | AI application | AI orchestration | API Design | Agent workflowsSenior-level Full TimeToronto1d ago
-
Software Engineer II – GenAI Quality Engineering CAD 104K-142KAutomated testing | Automation frameworks | C# | C++ | CI/CDDisability insurance | Health, dental and vision coverage | Hybrid work model | Life insurance | Paid family leaveMid-level Full TimeLocations: Vancouver, British Columbia, Canada1d ago
-
Sr Data Engineering Developer CAD 83K-133KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Purview | Azure SynapseDental coverage | Disability coverage | Employee assistance program | Flexible work options | Health and wellness programsSenior-level Full TimeGuelph, Ontario, Canada; Toronto, Ontario, Canada; … R1d ago
-
Senior Data Engineer CAD 115K-145KAPI Integration | Azure Data | Azure Data Factory | Boomi | Cloud DataEmployee assistance program | Employee discounts | Health benefits | Life and disability insurance | On-site gymSenior-level Full TimeSaint John, NB, CA1d ago
-
Data Engineer CAD 70K-115KAPIs | Boomi | DBT | Data Governance | Data LineageCareer development | Dental coverage | Disability insurance | Employee assistance program | Employee discountsMid-level Full TimeSaint John, NB, CA1d ago