Staff Backend Software Engineer- (AI Platform)
Tasks
- Build scalable reliable foundation model serving systems
- Collaborate with product platform and research teams
- Design and implement backend systems and APIs
- Develop token based rate limiters and optimizers
- Ensure operational excellence through testing and readiness
- Lead technical design reviews and mentor engineers
- Optimize performance throughput and latency for GPU workloads
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Algorithms | Autoscaling | Data Structures | Distributed Systems | GPU Inference | High Throughput | High-Throughput Systems | Low Latency | Low-Latency Systems | Operational excellence | Performance optimization | Rate Limiting | System design | Testing
Education
N/A
Regions
Countries
States
Related jobs
-
Artificial Intelligence | Data Analysis | Data Structures | Data structures algorithms | Human-in-the-loopSenior-level Full TimeMountain View, CA, USA3h ago
-
Staff Software Engineer, Embedded Systems/Firmware, Platforms Infrastructure Engineering USD 207K-300KAlgorithms | Data Structures | Distributed Computing | Embedded Systems | Embedded operating systemsSenior-level Full TimeSunnyvale, CA, USA3h ago
-
C++ | Data Structures | Data Structures and Algorithms | Embedded Linux | Software ArchitectureSenior-level Full TimeMountain View, CA, USA3h ago
-
Data Processing | Data Storage | Data Structures | Data Structures and Algorithms | Distributed SystemsSenior-level Full TimeMountain View, CA, USA3h ago
-
Lead Data Engineer USD 316K-506KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakesLearning and development programs | Mentorship | Remote workSenior-level Full TimeChicago, Illinois, USA R15h ago
-
Supercomputing Intern - Summer 2027 USD 40K-140KAlgorithms | C# | C++ | CI/CD | Data StructuresDaily meals | Direct mentorship | Housing supportEntry-level InternshipSan Jose16h ago
-
Supercomputing Intern - Fall 2026 USD 40K-140KC# | C++ | CI/CD | Co-design | Data StructuresDaily Dinner | Daily lunch | Direct mentorship | Housing support | Relocation supportEntry-level InternshipSan Jose16h ago
-
Inference Intern - Summer 2027 USD 64K-142KAccelerator architectures | C++ | Compilers | Debugging | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose16h ago
-
Inference Intern - Spring 2027 USD 60K-142KC++ | Compilers | Consensus Protocols | Consistency models | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose16h ago
-
Principal Agentic AI Engineer USD 274K-338KAgent Orchestration | Auditability | Benchmarking | Confidence scoring | Distributed SystemsContinuing education support | Dental insurance | Flexible vacation policy | Health insurance | Paid parental leaveSenior-level Full Timesan francisconew york R16h ago
-
Software Engineer, Enterprise AI Platform USD 230K-385KAPI Design | Agent systems | Applied AI | Auditability | AuthenticationMid-level Full TimeSan Francisco17h ago
-
C++ | Distributed Systems | Fault Tolerance | Golang | InferenceBonus program | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA; San Francisco, …19h ago
-
Staff Machine Learning Engineer, Voice AI USD 220K-280KAudio codecs | Audio signal processing | Batching | CUDA | Deep learningHealth insurance | Startup equitySenior-level Full TimeSan Francisco20h ago
-
Senior Data Engineer USD 179K-255KAWS | AWS DMS | Agile | Amazon DynamoDB | Amazon EC2401k | Accident insurance | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeAustin, Texas22h ago
-
Entry-level Full TimeCary, NC, United States23h ago
-
Software Engineer II - Model Platform USD 149K-214KAWS | Azure | Cloud Computing | Data Pipelines | Distributed SystemsMid-level Full TimeRemote - USA R1d ago
-
Data Analysis | Distributed Systems | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeSan Jose, California, United States1d ago
-
Automation | Canary Deployment | Capacity Planning | Cause analysis | Change ManagementSenior-level Full TimeSeattle, Washington, United States1d ago
-
Computer Vision | Data Preparation | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1d ago
-
Staff Software Engineer, AI/ML, App Ads Quality USD 207K-300KCross-Functional Collaboration | Cross-functional | Data Processing | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago
-
Agentic AI | Computer Vision | Continuous integration | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA1d ago
-
Senior Software Engineer, AI Powered GRC Automation USD 174K-252KContinuous controls monitoring | Controls monitoring | Data Mining | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1d ago
-
Staff Software Engineer, NotebookLM, Generative AI, Labs USD 207K-300KAlerting | Computer Vision | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KAlgorithms | C++ | Data Analysis | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago
-
AI/ML Engineer USD 117K-171KA/B | A/B Testing | API Development | AWS | B testingDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US1d ago