Senior Inference Engineer - AI I
Tasks
- Build and optimize containerized inference pipelines
- Deploy inference workloads on GPUs
- Develop inference optimization techniques including quantization and pruning
- Ensure deployment monitoring governance and drift detection
- Implement observability and health monitoring for inference pipelines
- Implement routing and failover for model traffic
- Integrate models into production APIs
- Optimize and scale AI inference
- Optimize inference environments to reduce latency
- Productionize AI and LLM workloads
- Profile inference performance and optimize GPU CPU bottlenecks
Perks/Benefits
- Flexible vacation
- Headspace access
- Hybrid work model
- Mental health days
- Paid volunteer days off
- Retirement savings
- Tuition reimbursement
- Volunteering opportunities
- Work from anywhere
- Work-life balance flexibility
Skills/Tech-stack
APIs | AWS | Azure | C++ | CI/CD | CUDA | Cloud Native | Cloud Native Architecture | Cloud platform | Distributed Systems | GPU Programming | Google Cloud | Google Cloud Platform | Knowledge Distillation | Kubernetes | Microservices | OCI | ONNX Runtime | OpenSearch | Pruning | PyTorch | Python | Quantization | Retrieval-Augmented Generation | TensorFlow | TensorRT | Vector Search
Education
N/A
Related jobs
-
Staff Analytics Engineer - CANADA (Remote) CAD 140K-200KAI Agents | Airflow | DBT | Data Architecture | Data ModelingRemote work | Team collaboration | Unlimited learning budgetSenior-level Full TimeCanada R18h ago
-
AWS | Agent Orchestration | Agent systems | Amazon SQS | Anthropic ClaudeHigh-growth environment | Ownership culture | Remote work | Unlimited AI token budgetSenior-level Full TimeCanada R18h ago
-
Prompt Engineer CAD 75K-115KAnthropic API | Automated Evaluation | CI/CD | LLM orchestration | Language ModelsEquipment provided | Flexible schedule | Health insurance | Internal mobility opportunities | Paid onboarding programSenior-level Full TimeMontreal, Quebec, Canada22h ago
-
Software Engineer II, Machine Learning CAD 104K-176KApache Airflow | CI/CD | Cloud platform | Code review | FastAPIComprehensive medical, dental, vision | Employee stock purchase plan | Equal Paid Parental Leave | Flexible paid time off | Hybrid workMid-level Full TimeToronto23h ago
-
Senior Prompt Engineer (AI Clinical Products) CAD 110K-130KAnthropic API | CI/CD | Failure mode analysis | GenAIOps | Generative AIHealthcare insurance | IT equipment provided | Internal mobility | Onboarding program | Paid time offSenior-level Full TimeMontreal, QUEBEC, Canada23h ago
-
Senior Analytics Engineer USD 156K-187KAmazon Redshift | BigQuery | CI/CD | Cloud Data | Cloud Data WarehouseBackground check required | Remote-friendly | Startup environmentSenior-level Full TimeUNITED STATES - Remote, CANADA - … R23h ago
-
Senior Staff Software Engineer, Data Infrastructure CAD 271K-286KAWS | Airflow | Apache Flink | Apache Iceberg | Apache KafkaAnnual equity refresh grants | Equity grant | Flex First work policy | Remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R1d ago
-
Machine Learning Engineer, Supportability CAD 150K-200KA/B | A/B Testing | Apache Spark | B testing | Data cleaningSenior-level Full TimeCanada; Toronto1d ago
-
Sr Data & Analytics Strategist (Contractor) CAD 102K-125KAnalytics Measurement | Attribution | BigQuery | Dashboarding | Data ModelingContinued education and personal development opportunities | Flexible working schedule | Remote-first work environmentSenior-level ContractCanada; Brazil1d ago
-
Senior-level Full TimeToronto, Ontario, Canada1d ago
-
Staff Software Developer, Google Cloud, Applied AI CAD 216K-221KAI Agents | Agentic Frameworks | C++ | CCaaS | CSSSenior-level Full TimeWaterloo, ON, Canada1d ago
-
Software Developer III, AI/ML GenAI, Google Workspace CAD 150K-154KAlgorithms | Audio Processing | C++ | Computer Vision | Data ProcessingSenior-level Full TimeWaterloo, ON, Canada1d ago
-
Data Migration Engineer (Dell EMC / Petabyte Scale) CAD 103K-168KAutomation | Backup and Recovery | Bash | Data Domain | Data MigrationMid-level Full TimeToronto, ON, Canada1d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringPart-time project work | Project-based employment | Remote workMid-level FreelanceCanada - Remote R1d ago
-
Senior AI/ML Engineering Specialist, Responsible AI CAD 89K-149KAI Act | AI RMF | AIF360 | Adversarial Testing | Amazon SageMakerSenior-level Full TimeMississauga, ON, CAN - 2300 Meadowvale …1d ago
-
C# | MATLAB | NumPy | Pandas | PythonPaid per project | Part-time hours | Project based workSenior-level Full TimeCanada - Remote R1d ago
-
Senior Machine Learning and AI Engineer CAD 107K-157KAPIs | AWS | Agile | CDC | Distributed SystemsSenior-level Full TimeAMER - Canada - Ontario - …1d ago
-
Lead AI Engineer CAD 115K-120KAPI Development | AWS Bedrock | Cloud deployment | LLM Evaluation | LangchainCoaching opportunities | Dental insurance | Flexible hybrid policy | Health insurance | Higher education certification policySenior-level Full TimeMDC – Montreal, Canada1d ago
-
Data Engineer CAD 110K-125KApache Kafka | Azure | CI/CD | Data Governance | Data ModelingCoaching opportunities | Flexible workplace arrangements | Higher education certification policy | Hybrid work policy | Learning and development programsMid-level Full TimeMississauga, ON, Canada1d ago
-
Senior Associate, Data Platform Engineer - Snowflake CAD 113K-135KAPI Integration | AWS | CCPA | CI/CD | DBTSenior-level Full TimeToronto1d ago
-
Senior Analytics Engineer CAD 125K-135KAutomated testing | BigQuery | CI/CD | Containerization | DBTAutonomy | Dental insurance | Disability insurance | Equity | Flexible work cultureSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Data Developer CAD 85K-107K.NET | Agile methodology | Amazon Web Services | Apache Flume | Apache IcebergSenior-level Full TimeQuebec City, QC, Canada1d ago
-
.NET | Agile | Amazon Web Services | Apache Flume | Apache KafkaEntry-level Full TimeQuébec City, QC, Canada1d ago
-
Data Analyst, Growth CAD 191K-191KA/B | A/B Testing | Airflow | B testing | DBTFlexible working hours | Fully remote | Globally distributed teamSenior-level Full TimeCanada R1d ago
-
Amazon Redshift | Amazon S3 | Amazon Web Services | Apache Airflow | DBTContract employment | Remote workSenior-level Full TimeToronto, Ontario1d ago