Staff Software Engineer, Inference Cloud
Headquarters/Sunnyvale Office
USD 190K-260K (estimate) Senior-level Full Time
Tasks
- Architect active active rapid failover systems
- Build admission control quota management rate limiting
- Build service discovery
- Conduct design and code reviews
- Create caching batching and traffic management
- Debug production incidents
- Define SLO driven reliability practices
- Design distributed multi region traffic architecture
- Develop load balancing
- Implement differentiated quality of service
- Implement graceful degradation
- Implement request routing
- Lead observability incident response and capacity planning
- Mentor senior engineers
- Own inference cloud platform architecture
- Write production backend code
Perks/Benefits
Skills/Tech-stack
Active/Active | Admission control | Alerting | Batching | C++ | Caching | Compute Orchestration | Container platforms | Distributed Systems | Distributed systems architecture | Failover | Go | Incident Response | Load Balancing | Logging | Metrics | Multi-region | Multi-region systems | Networking | Observability | Python | Quality of Service | Quota Management | Rate Limiting | Request Routing | SLO | Service Discovery | Systems Architecture | Tracing | Traffic Management
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
.NET | AI Assisted Development | AI-Assisted Development Tools | API Integration | Automation401k | Employee discounts | Paid time offSenior-level Full TimeBrooklyn, NY, US18h ago
-
API Gateway | AWS | AWS Step Functions | Agile | Airflow401k match | Career development | Dental insurance | Employee referral bonuses | Health insuranceSenior-level Full TimeFort Meade, MD; Annapolis Junction, MD; …20h ago
-
Data Scientist - Mentorship and Training USD 49K-290KAPI Security | Apache Spark | Certificates | Code review | CondaReferral bonus | Training and mentoringSenior-level Full TimeMcLean, VA21h ago
-
Agile | Amazon Web Services | Apache Hive | Apache Spark | Apache ZeppelinMid-level ContractPortland, United States23h ago
-
Apache Flink | Apache Hive | Apache Kafka | Apache Spark | Apache ZookeeperSenior-level ContractPortland, United States23h ago
-
Amazon DynamoDB | Apache Hive | Java | NoSQL | Object-OrientedSenior-level ContractBeaverton, United States23h ago
-
Security Data Engineer USD 128K-214KAI | API Integration | API scaling | Anomaly Detection | Automated MonitoringDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-VA-Herndon23h ago
-
Data Engineer USD 94K-157KAWS | Air-gapped | Air-gapped environments | Bash | CRISP-DMHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Arlington, USA-Remote Work23h ago
-
Cyber Data Engineer II USD 116K-193KCybersecurity | Gap assessment | Incident Response | Network Architecture | Policy DevelopmentOnsite work 5 days per week | Top secret clearance requiredSenior-level Full TimeTempe, Arizona, United States23h ago
-
Palantir MSS Developer / Engineer USD 84K-140KData Engineering | Data Modeling | Data Pipelines | Data Visualization | ELTMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …23h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Apache Spark | Artificial Intelligence | Data Modeling | Data PipelinesDiscretionary annual incentive program | Mentorship | Professional development | Travel opportunitySenior-level Full TimeRosslyn, Virginia, United States23h ago
-
A/B | A/B Testing | B testing | Deep learning | Information RetrievalEntry-level Full TimeSeattle, Washington, United States1d ago
-
AWS | Accuracy | Apache Flink | Azure | Bias MitigationSenior-level Full TimeLos Angeles, California, United States1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States1d ago
-
Software Engineer III, Storage Infrastructure USD 147K-210KC++ | Code Reviews | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeNew York, NY, USA1d ago
-
Software Engineer, Search, AI/ML USD 147K-210KC++ | Data Governance | Data Governance Framework | Data Management | Data PrivacyMid-level Full TimeCambridge, MA, USA1d ago
-
C++ | Cloud Storage | Compute Technologies | Data Structures | Data Structures and AlgorithmsBonus | Equity | Health insurance | Paid time offSenior-level Full TimeNew York, NY, USA1d ago
-
Software Engineer, AI/ML, Google Research USD 147K-210KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Language ProcessingMid-level Full TimeMountain View, CA, USA1d ago
-
Accessibility | Artificial Intelligence | Code review | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer III, Computer Vision, Pixel Camera USD 147K-210KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan Diego, CA, USA1d ago
-
Software Engineer III, Infrastructure, Infra Bigtable USD 147K-210KAsynchronous processing | Back-end | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1d ago
-
Senior Software Engineer, Infrastructure, Infra Bigtable USD 174K-252KAsynchronous processing | Backend Services | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1d ago
-
C++ | Cloud Computing | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer III, Generative AI, Workspace Drive USD 147K-210KCode review | Computer Vision | Data Optimization | Data Preparation | DebuggingSenior-level Full TimeBoulder, CO, USA1d ago
-
Senior Software Engineer, Map Ads Machine Learning USD 174K-252KAds serving | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1d ago