Staff Backend Software Engineer- (AI Platform)
Tasks
- Build scalable reliable foundation model serving systems
- Collaborate with product platform and research teams
- Design and implement backend systems and APIs
- Develop token based rate limiters and optimizers
- Ensure operational excellence through testing and readiness
- Lead technical design reviews and mentor engineers
- Optimize performance throughput and latency for GPU workloads
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Algorithms | Autoscaling | Data Structures | Distributed Systems | GPU Inference | High Throughput | High-Throughput Systems | Low Latency | Low-Latency Systems | Operational excellence | Performance optimization | Rate Limiting | System design | Testing
Education
N/A
Regions
Countries
States
Related jobs
-
Entry-level Full TimeMenlo Park, CA1h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Computer Vision | Data Processing | Data StorageSenior-level Full TimeKirkland, WA, USA1h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Backup and Recovery | BigQuery | C++ | Consistency models | Copy-on-writeSenior-level Full TimeKirkland, WA, USA1h ago
-
Software Engineer, Machine Health USD 147K-211KAnalysis and Design | C++ | Data Processing | Data analytics | Distributed SystemsMid-level Full TimeSunnyvale, CA, USA1h ago
-
Networking AI Technical Lead USD 207K-300KAI | Algorithms | C++ | Compute Technologies | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA1h ago
-
Staff Software Engineer, BigQuery Managed Storage USD 207K-300KApache Iceberg | Data Lakes | Data Structures | Data Structures and Algorithms | Distributed ComputingSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA1h ago
-
Software Engineer III, AI/ML, Health and Home USD 147K-211KData Analysis | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior Software Engineer, Full Stack, Gen AI Formats USD 174K-252KArtificial Intelligence | C++ | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA2h ago
-
Staff Software Engineer, TPU Performance USD 207K-300KAlgorithm Design | Benchmarking | Compiler | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Native | Cloud Native Architecture | Cloud platformSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Senior Software Engineer, Managed Kafka USD 174K-252KApache Kafka | Cloud platform | Distributed Systems | Go | Google CloudSenior-level Full TimeNew York, NY, USA; Raleigh, NC, …2h ago
-
Senior Software Engineer, AI/ML, Retail Ads, Fullstack USD 174K-252KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA2h ago
-
Algorithms | Data Structures | Deep learning | Embeddings | Information RetrievalSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior Software Engineer, AI Infra, Ads Safety USD 174K-252KBenchmarking | C++ | Data Processing | Data Storage | Data platformSenior-level Full TimeLos Angeles, CA, USA2h ago
-
Senior Software Engineer, Data Platform & AI Enablement USD 158K-260KAI infrastructure | Checkpointing | Distributed Systems | Exactly once | Exactly-once semanticsSenior-level Full TimeUS - San Francisco6h ago
-
Staff Backend Software Engineer- (AI Platform) USD 166K-225KAPI Design | Algorithms | Autoscaling | Caching | Data StructuresSenior-level Full TimeSan Francisco, California8h ago
-
Staff Backend Software Engineer- (AI Platform) USD 192K-260KAPI Design | APIs | Algorithms | Autoscaling | CachingSenior-level Full TimeSan Francisco, California8h ago
-
Staff Backend Software Engineer- (AI Platform) USD 166K-225KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPUSenior-level Full TimeSan Francisco, California8h ago
-
Senior-level Full TimeNew York City or Chicago11h ago
-
Principal Data Engineer - League Studios USD 209K-293KApache Airflow | Apache Spark | Batch Processing | DBT | Data Governance401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA12h ago
-
AI Search | AWS Bedrock | Agent systems | Amazon SageMaker | Anthropic401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Sr. Solutions Engineer - GSI's and FinTech Data USD 152K-209KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data EngineeringTravel opportunitiesSenior-level Full TimeGeorgia; Illinois; Massachusetts; New Jersey; New …13h ago
-
AI/Machine Learning Engineer Intern USD 55K-86KAPIs | Artificial Intelligence | Benchmarking | Evaluation | LLM APIsFun events | Leadership speaker series | Mentorship | Professional network | Training and developmentEntry-level InternshipUnited States - Remote R16h ago
-
Senior Machine Learning Engineer USD 180K-300KAPI Development | Data Pipelines | DeepSpeed | Diffusers | Hugging Face401k | Biannual retreats | Health insurance | Meeting Light Culture | Occasional in person collaborationSenior-level Full TimeSan Francisco Bay Area17h ago