Staff Backend Software Engineer- (AI Platform)
Tasks
- Build scalable reliable high throughput low latency inference systems
- Collaborate cross functionally to translate customer needs into performant systems
- Create token based rate limiters and optimizers
- Define technical roadmap and long term architecture for serving workloads
- Design core systems and APIs for foundation model serving
- Establish code quality testing and operational readiness best practices
- Implement serving components using vLLM and SGLang
- Mentor engineers through design reviews and technical guidance
- Optimize performance throughput autoscaling and operational efficiency for GPU serving
- Represent team in technical discussions and influence AI platform strategy
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Algorithms | Autoscaling | Data Structures | Distributed Systems | GPU Computing | High Throughput | Low Latency | Operational excellence | Performance optimization | Rate Limiting | System design | Testing
Education
N/A
Regions
Countries
States
Related jobs
-
CDN | Cloud infrastructure | Dashboards | Data Modeling | Data PipelinesEntry-level Full TimeSeattle, Washington, United States9h ago
-
AI Software Engineer USD 260K-260KAI Search | API Integration | Agent Orchestration | Azure AI | Azure AI SearchCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysSenior-level Full TimeTexas-Dallas-5323 Harry Hines Blvd9h ago
-
Compression | Data Engineering | Data Pipelines | Distributed Systems | High AvailabilitySenior-level Full TimeSan Jose, California, United States9h ago
-
AI/LLM Network Software Development Engineer USD 207K-368KAI communication | AI communication frameworks | Communication frameworks | Distributed Systems | High PerformanceEntry-level Full TimeSeattle, Washington, United States9h ago
-
Software Engineer, MTIA SW Tooling Engineer USD 141K-208KC++ | CUDA | CUDA GDB | Cuda Memcheck | DWARFSenior-level Full TimeBellevue, WA | Menlo Park, CA …10h ago
-
Agent systems | Artificial Intelligence | Data Curation | Data Generation | Data PipelinesSenior-level Full TimeMenlo Park, CA10h ago
-
Computer Vision | Data Analysis | Data Preparation | Debugging | Information RetrievalSenior-level Full TimeMountain View, CA, USA10h ago
-
Bottleneck identification | C# | C++ | Code review | DebuggingSenior-level Full TimeSan Jose, CA, USA10h ago
-
Software Engineer, Model Inference, DeepMind USD 207K-300KCUDA | Caching | Distributed Systems | GPUs | Hardware accelerationSenior-level Full TimeLondon, UK; Mountain View, CA, USA10h ago
-
Software Engineer, AI/ML, Workspace USD 147K-210KData Processing | Debugging | Distributed Computing | Experimentation | Information RetrievalMid-level Full TimeSunnyvale, CA, USA; New York, NY, …10h ago
-
Senior Software Engineer, AI/ML GenAI, Core USD 174K-252KC++ | Code review | Computer Vision | Data Processing | DebuggingSenior-level Full TimeNew York, NY, USA10h ago
-
Senior Software Engineer, AI/ML, Creative Intelligence USD 174K-252KAd optimization | Algorithms | C++ | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA10h ago
-
Senior Software Engineer, Embedded Systems/Firmware, XR USD 174K-252KAlgorithms | C# | C++ | Code review | Data StructuresSenior-level Full TimeSan Jose, CA, USA; Kirkland, WA, …10h ago
-
Artificial Intelligence | C# | C++ | Code review | Control SystemsMid-level Full TimeMountain View, CA, USA10h ago
-
Acoustics | Algorithms | Android | Audio Software | C++Senior-level Full TimeMountain View, CA, USA10h ago
-
Algorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA10h ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R17h ago
-
Staff Data Engineer USD 145K-180KAgile | Algorithms | Automation | Cloud Architecture | Data ComplianceCompany 401k match | Family-forming benefits | Financial Planning Sessions | Flexible time off | Free snacks and refreshmentsSenior-level Full TimeAustin, Texas, United States18h ago
-
Machine Learning Engineer, API Multicloud USD 295K-445KAPIs | AWS | Data Pipelines | Data Structures | Data structures algorithmsSenior-level Full TimeSan Francisco18h ago
-
Senior Machine Learning Engineer, Ads ML Platform USD 216K-303KAnomaly Detection | Data Governance | Data Infrastructure | Data Lineage | Data Storage401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible remote workSenior-level Full TimeRemote - United States R21h ago
-
AI/ML Computer Science Research and Development Engineer USD 121K-231KAdversarial Machine Learning | Benchmarking | Computer Vision | Convolutional Neural Networks | Data PreprocessingSenior-level Full TimePenn State University Park, United States R21h ago
-
C# | C++ | Debugging | Embedded Systems | Guidance Navigation and ControlCompany-Paid Holidays | Health insurance | Life and disability insurance | Paid time off | Relocation assistanceMid-level Full TimeAZCH02, United States21h ago
-
Senior HPC and Quantum Systems Engineer USD 184K-287KAPIs | AWS Braket | C plus plus | CUDA-Q | CalibrationSenior-level Full TimeUS, MA, Westford R21h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R22h ago
-
Analytics Engineer - X USD 180K-440KA/B | A/B Testing | Apache Flink | Apache Hadoop | Apache Kafka401k retirement plan | Dental insurance | Disability insurance | Employee discounts | Health insuranceMid-level Full TimePalo Alto, California22h ago