Site Reliability Engineer, Inference Infrastructure
Tasks
- Automate observability and resilience
- Build self service systems to automate service management and deployment
- Collaborate with internal developers and influence infrastructure roadmap
- Design distributed systems for low latency high throughput production workloads
- Develop Kubernetes operators for language model deployments
- Enable developers to troubleshoot and resolve incidents
- Ensure SLO compliance through on call rotation
- Share knowledge through reviews and engineering best practices
Perks/Benefits
- 401k matching
- Co working Benefit
- Company offsite
- Education and learning stipend
- Health and dental benefits
- Home office stipend
- Mental health budget
- Paid vacation
- Parental leave top-up
- Pension scheme
- RRSP matching
- Travel budget
- Workspace improvement credit
Skills/Tech-stack
Amazon Web Services | C plus plus | Cloud platform | Distributed Systems | GPU | Golang | Google Cloud | Google Cloud Platform | High Availability | High Throughput | Kubernetes | Linux | Low Latency | Microsoft Azure | Multi-cloud | Observability | SLO | TPU | Web Services
Education
N/A
Related jobs
-
Senior-level Full TimeMcLean, VA; McLean, VIRGINIA; McLean, VIRGINIA; …4h ago
-
Senior-level Full TimeMcLean, VIRGINIA4h ago
-
Data Engineer (Expert) WA07 USD 133K-238KData Mapping | Data Modeling | Data Quality | Data Testing | ETLSenior-level Full TimeChantilly, Virginia4h ago
-
Data Engineer (Subject Matter Expert) WA28 USD 133K-238KApache NiFi | CSS | Data Modeling | Data Quality | ETLSenior-level Full TimeChantilly, VA4h ago
-
Data Engineer (Expert) WA12 USD 133K-238KApache NiFi | Data Mapping | Data Modeling | Data Quality | Data TestingSenior-level Full TimeMcLean, VIRGINIA4h ago
-
Data Engineer (Subject Matter Expert) CK16 USD 133K-238KApache NiFi | C# | C++ | Cloud Computing | Data MappingCompetitive benefits packageSenior-level Full TimeMcLean, VIRGINIA4h ago
-
System Engineer- Storage (Expert) TI28 USD 100K-150KActive Directory | Auditing | Backup and Recovery | Bash | Capacity PlanningSenior-level Full TimeMcLean, VIRGINIA4h ago
-
Mid-level Full TimeMcLean, VIRGINIA4h ago
-
Software Engineer 3 – AI/ML USD 113K-279KAWS | Artificial Intelligence | Azure | Docker | ElasticsearchAgile environment collaboration | Partial teleworkSenior-level Full TimeAnnapolis Junction, MD4h ago
-
C++ | Compiler design | Computer Architecture | Linux | Machine LearningHealth insurance | Hybrid work model | Life insurance | Paid time off | Retirement savings matchSenior-level Full TimeRemote, Canada R5h ago
-
Agile | Cloud Storage | Google Cloud | Google Cloud Storage | GraphQLMid-level Full TimeSan Francisco, California; Remote, Canada, US, … R5h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R5h ago
-
AI | AWS | Apache Kafka | Azure | C#Collaborative culture | Fully remote | Leadership opportunitySenior-level Full TimeRemote, Toronto R5h ago
-
Senior-level Full TimeRemote, Canada; Remote, Canada; Toronto, Ontario; … R5h ago
-
AWS | Automated testing | Azure | CI/CD | Cloud platformHigh ownership culture | Startup experienceSenior-level Full TimeOttawa, Ontario5h ago
-
Caching | Data Processing | Data Streaming | Data synchronization | Distributed SystemsSenior-level Full TimeRemote, Canada or US; Remote, Canada; … R5h ago
-
APIs | Data Governance | Data Migration | Data Modeling | Data WarehousingSenior-level Full TimeOntario, Canada5h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R5h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Kitchener/Waterloo, Ontario; Remote, Canada … R5h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Toronto, Ontario; Toronto, Ontario; …5h ago
-
API Design | Alerting | Browser Automation | Data Modeling | Database SchemaEquity package | Professional growth opportunities | Unlimited growthSenior-level Full TimeBay Area, California5h ago
-
AWS Data | AWS Data Lakes | Amazon Web Services | Apache Spark | Data AnalysisFlexible work schedule | Hybrid work modelSenior-level Full TimeToronto, Ontario; Remote, Canada; Toronto, Ontario; … R5h ago
-
AI frameworks | API Development | AWS | AWS GenAI | Agentic SystemsSenior-level Full TimeRemote, Canada; Remote, Canada; Remote, Canada; … R5h ago
-
API Design | Distributed Systems | LLM | Python | RAGEarly-stage environment | Enterprise customer impact | High autonomySenior-level Full TimeRemote, Canada or US; Remote, Canada; … R5h ago
-
Mid-level Full TimeBethesda, Maryland; Bethesda, Maryland; Bethesda, Maryland; …5h ago