Site Reliability Engineer, Inference Infrastructure
Tasks
- Automate observability and resilience
- Build self service systems to automate service management and deployment
- Collaborate with internal developers and influence infrastructure roadmap
- Design distributed systems for low latency high throughput production workloads
- Develop Kubernetes operators for language model deployments
- Enable developers to troubleshoot and resolve incidents
- Ensure SLO compliance through on call rotation
- Share knowledge through reviews and engineering best practices
Perks/Benefits
- 401k matching
- Co working Benefit
- Company offsite
- Education and learning stipend
- Health and dental benefits
- Home office stipend
- Mental health budget
- Paid vacation
- Parental leave top-up
- Pension scheme
- RRSP matching
- Travel budget
- Workspace improvement credit
Skills/Tech-stack
Amazon Web Services | C plus plus | Cloud platform | Distributed Systems | GPU | Golang | Google Cloud | Google Cloud Platform | High Availability | High Throughput | Kubernetes | Linux | Low Latency | Microsoft Azure | Multi-cloud | Observability | SLO | TPU | Web Services
Education
N/A
Related jobs
-
Senior-level Full TimeUS - Remote; Canada - Remote R6h ago
-
Senior-level Full TimeMountain View, CA8h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA8h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R18h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States20h ago
-
Software Engineer - X Data USD 125K-400KApache Flink | Apache Kafka | Apache Spark | BigQuery | Cause analysis401k retirement plan | Dental insurance | Discounts | Health insurance | Life insuranceMid-level Full TimePalo Alto, CA1d ago
-
Embedded Software Engineer Intern (Fall 2026) USD 108K-108KADC | Antenna Testing | C# | C++ | CANHousing stipend | Overtime pay | Paid sick time | Relocation supportEntry-level InternshipSouth San Francisco, California, USA1d ago
-
Staff Software Engineer, Inference Infrastructure USD 160K-220KAmazon Web Services | Azure | C++ | Cloud platform | Distributed Systems401k | Annual company offsite | Arts and culture budget | Education and learning stipend | Health and dental benefitsSenior-level Full TimeSan Francisco1d ago
-
Applied AI Engineer USD 204K-352KBackend Development | Cloud infrastructure | Deep learning | Docker | Fine TuningAnnual membership | Centralized coffee stipend | Flexible PTO | Health and wellness stipend | Health, dental, and vision insuranceSenior-level Full TimeNew York, NY (HQ)1d ago
-
Staff AI Engineer USD 140K-210KAPI Development | AWS | Access Management | Bedrock AgentCore | CI/CD401k | All-hands meetings | Dental insurance | Employee equity program | Health insuranceSenior-level Full TimeNew York City1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | AMD Xilinx toolchain | AMD/Xilinx SoC | BashHybrid work options | Remote work optionsSenior-level Full TimeNew Haven, CT1d ago
-
Senior Quantum Applications Engineer - QEC USD 120K-258KCUDA-Q | Decoder algorithms | Docker | End to End | End-to-End TestingSenior-level Full TimeNew Haven, CT1d ago
-
Staff AI engineer USD 170K-250KAI Evaluation | AWS | Agent Orchestration | Caching | Distributed SystemsFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Big Data Engineer / Sr. Level - GCP USD 88K-174KAPI Development | API Versioning | Apigee | Avro | Big DataContract-to-hireSenior-level Full TimeNashville, TN, United States1d ago
-
Apple Neural Engine | C plus plus | Computer Vision | CoreFoundation | CoreMLMid-level Full TimeSeattle1d ago
-
C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learningSenior-level Full TimeBurlingame, CA2d ago
-
Senior Staff Software Engineer, Knowledge Catalog For AI USD 262K-365KBig Data | C++ | Computer Vision | Data Governance | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Asynchronous programming | BigQuery | C++ | Concurrency | Data ProcessingSenior-level Full TimeKirkland, WA, USA2d ago
-
Staff Software Engineer, Infrastructure, Google Cloud AI USD 207K-301KCompute Technologies | Data Structures | Data Structures and Algorithms | Distributed Systems | Network ArchitectureSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Data Engineer USD 132K-165KAWS | Azure | Cassandra | Data Governance | Data Lakes401k match | Dental insurance | Employee assistance program | Life insurance | Medical insuranceSenior-level Full TimePlano, TX, US2d ago
-
Data Platform Engineer, Infrastructure USD 70K-300KAWS | Alerting | Audit Logging | CI/CD | Capacity PlanningFlexible hours | Onsite work | Work-life balanceMid-level Full TimeIrvine, CA2d ago
-
AWS | Azure | CI/CD | Cloud Native | Distributed SystemsCareer development support | Flexible working models | Health and wellbeing benefits | Hybrid work | MentoringEntry-level InternshipSan Ramon, CA, US, 945 832d ago
-
Amazon Web Services | Cloud Architecture | Computer Vision | Cost Management | Data Analysis401k matching | Adoption reimbursement | Dental insurance | Employee assistance program | Flexible spending accountsMid-level Full TimeArlington, Virginia, USA2d ago
-
Senior Applied AI Engineer USD 139K-201KAPI Development | Agent workflows | Debugging | Document processing | Information RetrievalSenior-level Full TimePlaya Vista, California, United States2d ago