Staff Backend Software Engineer- (AI Platform)
Tasks
- Build scalable reliable foundation model serving systems
- Collaborate with product platform and research teams
- Design and implement backend systems and APIs
- Develop token based rate limiters and optimizers
- Ensure operational excellence through testing and readiness
- Lead technical design reviews and mentor engineers
- Optimize performance throughput and latency for GPU workloads
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Algorithms | Autoscaling | Data Structures | Distributed Systems | GPU Inference | High Throughput | High-Throughput Systems | Low Latency | Low-Latency Systems | Operational excellence | Performance optimization | Rate Limiting | System design | Testing
Education
N/A
Regions
Countries
States
Related jobs
-
Artificial Intelligence | Data Analysis | Data Structures | Data structures algorithms | Human-in-the-loopSenior-level Full TimeMountain View, CA, USA4h ago
-
Staff Software Engineer, Embedded Systems/Firmware, Platforms Infrastructure Engineering USD 207K-300KAlgorithms | Data Structures | Distributed Computing | Embedded Systems | Embedded operating systemsSenior-level Full TimeSunnyvale, CA, USA4h ago
-
C++ | Data Structures | Data Structures and Algorithms | Embedded Linux | Software ArchitectureSenior-level Full TimeMountain View, CA, USA4h ago
-
Data Processing | Data Storage | Data Structures | Data Structures and Algorithms | Distributed SystemsSenior-level Full TimeMountain View, CA, USA4h ago
-
Applied AI ML Lead - LLM SUITE ENGINEERING USD 176K-215KAPI Design | AWS | Agentic AI | Caching | Cloud NativeBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeWilmington, DE, United States12h ago
-
Associate AI Engineer USD 80K-134KAPI Development | Azure | Cloud Platforms | Data Preparation | DocumentationFlexible work environment | Hybrid work arrangement | Inclusion programs | Paid time off | Wellness benefitsMid-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …15h ago
-
Data Engineer USD 85K-141KAPI Gateways | CI/CD | Cloud Databases | Data Governance | Data Lakes401k retirement plan | Adoption Assistance | Flexible spending accounts | Health savings account | Parental leaveMid-level Full TimeClient Office: Aberdeen, MD, United States15h ago
-
Lead Data Engineer USD 316K-506KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakesLearning and development programs | Mentorship | Remote workSenior-level Full TimeChicago, Illinois, USA R16h ago
-
Supercomputing Intern - Summer 2027 USD 40K-140KAlgorithms | C# | C++ | CI/CD | Data StructuresDaily meals | Direct mentorship | Housing supportEntry-level InternshipSan Jose17h ago
-
Supercomputing Intern - Fall 2026 USD 40K-140KC# | C++ | CI/CD | Co-design | Data StructuresDaily Dinner | Daily lunch | Direct mentorship | Housing support | Relocation supportEntry-level InternshipSan Jose17h ago
-
Inference Intern - Summer 2027 USD 64K-142KAccelerator architectures | C++ | Compilers | Debugging | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose17h ago
-
Inference Intern - Spring 2027 USD 60K-142KC++ | Compilers | Consensus Protocols | Consistency models | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose17h ago
-
Principal Agentic AI Engineer USD 274K-338KAgent Orchestration | Auditability | Benchmarking | Confidence scoring | Distributed SystemsContinuing education support | Dental insurance | Flexible vacation policy | Health insurance | Paid parental leaveSenior-level Full Timesan francisconew york R17h ago
-
Software Engineer, Enterprise AI Platform USD 230K-385KAPI Design | Agent systems | Applied AI | Auditability | AuthenticationMid-level Full TimeSan Francisco18h ago
-
C++ | Distributed Systems | Fault Tolerance | Golang | InferenceBonus program | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA; San Francisco, …20h ago
-
Staff Machine Learning Engineer, Voice AI USD 220K-280KAudio codecs | Audio signal processing | Batching | CUDA | Deep learningHealth insurance | Startup equitySenior-level Full TimeSan Francisco21h ago
-
Senior Data Engineer USD 179K-255KAWS | AWS DMS | Agile | Amazon DynamoDB | Amazon EC2401k | Accident insurance | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeAustin, Texas23h ago
-
Entry-level Full TimeCary, NC, United States1d ago
-
Software Engineer II - Model Platform USD 149K-214KAWS | Azure | Cloud Computing | Data Pipelines | Distributed SystemsMid-level Full TimeRemote - USA R1d ago
-
Data Analysis | Distributed Systems | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeSan Jose, California, United States1d ago
-
Automation | Canary Deployment | Capacity Planning | Cause analysis | Change ManagementSenior-level Full TimeSeattle, Washington, United States1d ago
-
Computer Vision | Data Preparation | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1d ago
-
Staff Software Engineer, AI/ML, App Ads Quality USD 207K-300KCross-Functional Collaboration | Cross-functional | Data Processing | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago
-
Agentic AI | Computer Vision | Continuous integration | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA1d ago
-
Senior Software Engineer, AI Powered GRC Automation USD 174K-252KContinuous controls monitoring | Controls monitoring | Data Mining | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1d ago