Staff Software Engineer, Inference Infrastructure
Tasks
- Build and maintain highly available distributed systems
- Deploy manage and troubleshoot Kubernetes workloads
- Design and build low latency high throughput inference APIs
- Develop deploy and operate AI model serving platform
- Interface with customers for customized deployments
- Manage compute storage network resources and costs
- Optimize NLP models for production deployment
- Troubleshoot Linux based computing environments
Perks/Benefits
- 401k
- Annual company offsite
- Arts and culture budget
- Education and learning stipend
- Health and dental benefits
- Home office stipend
- Mental health budget
- Paid vacation
- Parental leave top-up
- Pension scheme
- RRSP matching
- Travel budget to other offices
- Wellness budget
- Workspace improvement credit
Skills/Tech-stack
Amazon Web Services | Azure | C++ | Cloud platform | Distributed Systems | GPU | Golang | Google Cloud | Google Cloud Platform | High Availability | Hybrid Cloud | Kubernetes | Linux | Multi-cloud | TPU | Web Services
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeUS - Remote; Canada - Remote R6h ago
-
Senior-level Full TimeMountain View, CA8h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA8h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R18h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States20h ago
-
Software Engineer - X Data USD 125K-400KApache Flink | Apache Kafka | Apache Spark | BigQuery | Cause analysis401k retirement plan | Dental insurance | Discounts | Health insurance | Life insuranceMid-level Full TimePalo Alto, CA1d ago
-
Embedded Software Engineer Intern (Fall 2026) USD 108K-108KADC | Antenna Testing | C# | C++ | CANHousing stipend | Overtime pay | Paid sick time | Relocation supportEntry-level InternshipSouth San Francisco, California, USA1d ago
-
Site Reliability Engineer, Inference Infrastructure USD 165K-267KAmazon Web Services | C plus plus | Cloud platform | Distributed Systems | GPU401k matching | Co working Benefit | Company offsite | Education and learning stipend | Health and dental benefitsMid-level Full TimeToronto1d ago
-
AI Engineer – Decision & Optimization Systems USD 80K-210KAMPL | C++ | CPLEX | Constraint Satisfaction | Go401k | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
AI Software Engineer USD 80K-210KAWS Kinesis | Apache Airflow | Apache Kafka | C# | C++401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
Applied AI Engineer USD 204K-352KBackend Development | Cloud infrastructure | Deep learning | Docker | Fine TuningAnnual membership | Centralized coffee stipend | Flexible PTO | Health and wellness stipend | Health, dental, and vision insuranceSenior-level Full TimeNew York, NY (HQ)1d ago
-
ML Research Engineer - Hardware Codesign USD 185K-455KC++ | CUDA | Floating point | Floating point numerics | Functional simulationHybrid work schedule | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
Staff AI Engineer USD 140K-210KAPI Development | AWS | Access Management | Bedrock AgentCore | CI/CD401k | All-hands meetings | Dental insurance | Employee equity program | Health insuranceSenior-level Full TimeNew York City1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | AMD Xilinx toolchain | AMD/Xilinx SoC | BashHybrid work options | Remote work optionsSenior-level Full TimeNew Haven, CT1d ago
-
Senior Quantum Applications Engineer - QEC USD 120K-258KCUDA-Q | Decoder algorithms | Docker | End to End | End-to-End TestingSenior-level Full TimeNew Haven, CT1d ago
-
Staff AI engineer USD 170K-250KAI Evaluation | AWS | Agent Orchestration | Caching | Distributed SystemsFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Adversarial Networks | Android | C++ | Computer Vision | Convolutional Neural NetworksEntry-level Full TimeMarkham, Ontario, Canada1d ago
-
C++ | Deep learning | Imitation Learning | Machine Learning | PlanningHealth insurance | Life insurance | Long-term care insurance | Long-term disability insurance | Paid time offSenior-level Full TimeFoster City, CA1d ago
-
Senior AI Engineer USD 125K-145KAPI Management | AWS | Azure | Azure DevOps | C#401k plan | Career advancement | Dental insurance | Dependent care | Flexible spending accountSenior-level Full TimeCleveland, OH, United States1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Big Data Engineer / Sr. Level - GCP USD 88K-174KAPI Development | API Versioning | Apigee | Avro | Big DataContract-to-hireSenior-level Full TimeNashville, TN, United States1d ago
-
Apple Neural Engine | C++ | Computer Vision | CoreFoundation | CoreMLMid-level Full TimeSunnyvale1d ago
-
Software Engineer, Machine Learning RecSys USD 147K-208KArtificial Intelligence | BERT | Bias Mitigation | C# | C++Mid-level Full TimeSunnyvale, CA | Bellevue, WA | …2d ago
-
C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learningSenior-level Full TimeBurlingame, CA2d ago
-
Software Engineer Leadership, Machine Learning RecSys USD 170K-244KAgent Orchestration | Artificial Intelligence | BERT | Bias Mitigation | C#Senior-level Full TimeSunnyvale, CA2d ago