Ingénieur(e) IA Générative - Hébergement De Modèles LLM
Montreal,Quebec,Canada
R
CAD 101K-133K (estimate) Senior-level Full Time
Tasks
- Administer secure model hosting and marketplace
- Apply SRE SecOps incident management
- Apply quantization and kernel tuning
- Build Ray based platform architecture
- Deploy GPU clusters for training and inference
- Design GPU cluster infrastructure
- Develop agentic platform runtimes
- Develop model inference services and APIs
- Implement autoscaling and capacity planning
- Implement observability with metrics traces and logs
- Implement tenant isolation and access control
- Integrate MLOps pipelines CI CD
- Integrate NVIDIA CUDA Triton and NCCL
- Lead technical mentorship and design reviews
- Maintain runbooks and monitoring alerts
- Operate multi tenant ML workloads
- Optimize batching and latency
- Perform chaos testing and capacity prediction
- Provide CLI and SDK developer tools
Perks/Benefits
- N/A
Skills/Tech-stack
C plus plus | CI/CD | Chaos Engineering | Device plugins | Docker | ETL | Elasticsearch | GPU MIG | GitOps | Go | Grafana | Helm | Infrastructure as Code | Kubernetes | Kubernetes device plugins | MLOps | Mixed Precision | Model versioning | NCCL | NVIDIA CUDA | NVIDIA Triton | OpenAI | OpenTelemetry | Pipeline parallelism | Prometheus | Pruning | Python | Quantization | RBAC | Rate Limiting | Ray | SLA | SLI | SLO | SRE | SecOps | Secrets management | Tensor Parallelism | “as-code”
Education
N/A
Related jobs
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R6h ago
-
Airflow | Computer Vision | Computer vision models | DBT | DagsterCanada based candidates preferred | Climate focused initiatives | Cross-functional collaboration | Fully remote work | Impact on infrastructure resilienceSenior-level Full TimeCanada R18h ago
-
AI Agents | API Integration | Access Control | Amazon Bedrock | Argo CDCollaborative culture | Equity or bonus opportunities | Professional growth opportunities | Remote work within Canada | Work on cutting edge AI and cloud projectsSenior-level Full TimeCanada R20h ago
-
AI Search | Agile | Azure AI | Azure AI Search | Azure DataAccident insurance | Health insurance | Hybrid work | Life insurance | Retirement savings plansSenior-level Full TimeFCP, Canada R23h ago
-
A/B | A/B Testing | API Integration | Airflow | B testingCross-functional collaboration | Professional growth | Remote work | Self service enablementSenior-level Full TimeCanada R1d ago
-
Staff Software Engineer, Backend (Online Storage) CAD 181K-241KAWS | Capacity Planning | Connection pooling | Database Benchmarking | Disaster RecoveryDental and vision coverage | ESPP (Employee Stock Purchase Plan) | Flexible spending wallets | Health care coverage | Tech spending stipendSenior-level Full TimeRemote Canada R1d ago
-
Data Engineer USD 170K-209KAWS | Amazon Kinesis | CI/CD | Compliance Frameworks | Container OrchestrationSenior-level Full TimeUS - Remote; Canada - Remote R1d ago
-
Senior Machine Learning Engineer, Growth CAD 170K-190KAWS | Azure | CI/CD | Data Pipelines | Drift DetectionCareer growth and learning opportunities | Discount on fitness memberships | Flexible hybrid schedule | Generous vacation and PTO | Health and dental benefitsSenior-level Full TimeToronto, Ontario, Canada R1d ago
-
Mid-level Full TimeRemote, Ontario R1d ago
-
Python Developer – AI Operations CAD 90K-111KAPI Design | Agentic Workflows | Algorithms | As-a-Service | Async PythonHybrid work environmentMid-level Full TimeMontréal, Quebec R1d ago
-
Senior AI DevOps Developer [584] USD 150K-206KACP | AI Security | AWS | AgentCore) | Agentic OrchestrationCompany benefits | Learning and development opportunities | On-call rotationSenior-level Full TimeRemote (United States); Canada R1d ago
-
Staff AI Engineer CAD 170K-180KAWS Bedrock | Amazon DocumentDB | Anthropic API | Artificial Intelligence | Axe-coreDental insurance | Flex benefits | Group retirement savings plan | Health coverage | Health daysSenior-level Full TimeToronto, Ontario R1d ago
-
Senior Data Platform Developer - AI Platform CAD 104K-135KAWS | Azure | Bedrock | CrewAI | DockerElectric vehicle purchase incentive program | Flex working arrangements | Home office reimbursement | Medical and dental benefits | Online learning and networking opportunitiesSenior-level Full TimeOakville, Ontario - Canada R1d ago
-
Data Engineer CAD 64K-114KAgentic AI | Apache Spark | Azure Data | Azure Data Factory | Azure DatabricksDisability insurance | Extended health and dental benefits | Hybrid work | Paid time off | Perk programsMid-level Full TimeCambridge, Ontario, Canada R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cloud DataCareer advancement | Collaborative environment | Hybrid work | Innovative projects | Professional developmentSenior-level Full TimeToronto R1d ago
-
Sr Data Engineering Developer CAD 83K-133KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Purview | Azure SynapseDental coverage | Disability coverage | Employee assistance program | Flexible work options | Health and wellness programsSenior-level Full TimeGuelph, Ontario, Canada; Toronto, Ontario, Canada; … R1d ago
-
Amazon Redshift | Automated testing | Branching | CI/CD | Cloud DataCollaborative culture | Distributed international team | Equity stock options | Mentorship | OwnershipSenior-level Full TimeCanada R1d ago
-
Big Data Senior Developer, Marketing & Advertising Data (French Services) (Telework/Hybrid) CAD 80K-110KApache Airflow | Apache Spark | Azure Event | Azure Event Hubs | Azure ServiceBackground check included for hired candidates | Employee resource groups | Flexible hours | Hybrid work environment | Pair programming mentorshipSenior-level Contract Full TimeQuebec (36.25), Canada R1d ago
-
Software Engineer, Machine Learning CAD 175K-200KC++ | Coding assistants | Computer Vision | Data Lakes | Data PipelinesSenior-level Full TimeMarkham, Ontario, Canada (Hybrid) R2d ago
-
Agentic Systems | BGP | DNS | Distributed Systems | EnvoyBerlitz tutoring | Catered meals | Flexible learning support | Language tutoring | MentorshipSenior-level Full TimeMontreal, Quebec; Toronto, Ontario; Remote, Canada; … R3d ago
-
Data Engineer CAD 69K-115KAPIs | Airflow | Apache Spark | CI/CD | DVCCollaborative work environment | Comprehensive benefits | Hybrid work within British ColumbiaEntry-level Full TimeNorth Vancouver, British Columbia, Canada R3d ago
-
Staff Software Engineer - Data Platform CAD 135K-169KApache Airflow | BigQuery | CI/CD | Cloud platform | Data CatalogDental insurance | Flexible time off | LinkedIn Learning access | Medical insurance | Paid HolidaysSenior-level Full TimeCanada (Remote) R4d ago
-
Staff Analytics Engineer USD 149K-215KAmazon Redshift | CI/CD | DBT | Data Governance | Data ModelingEquitySenior-level Full TimeCanada/US R4d ago
-
Software Engineer II, Model Platform CAD 90K-140KAWS | Azure | Data Pipelines | Data Structures | Distributed SystemsMid-level Full TimeRemote - Canada R4d ago
-
Staff Engineer - Experimentation Platform CAD 190K-262KA/B | A/B Testing | Amazon Web Services | Analytical Data | Analytical data modelingHybrid work schedule | Remote flexibility up to 4 weeks per yearSenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON R4d ago