Staff Backend Software Engineer- (AI Platform)
Tasks
- Build routing caching observability and autoscaling components
- Collaborate with product platform and research teams to deliver serving systems
- Design and implement core systems and APIs for model serving
- Drive architectural decisions for CPU and GPU inference performance
- Establish best practices for code quality, testing, and operational readiness
- Improve latency availability and cost effectiveness
- Mentor engineers through design reviews and technical guidance
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | Algorithms | Autoscaling | Caching | Data Structures | Distributed Systems | Docker | High Throughput | Inference | Low Latency | Machine Learning | Model Serving | Observability | Performance Tuning | Routing | System design
Education
N/A
Regions
Countries
States
Related jobs
-
AI Research Engineer USD 177K-251KBenchmarks | Data Pipelines | Data Versioning | Evaluation | Fine TuningCross-functional collaboration | End-to-end ownership | High autonomyMid-level Full TimeBellevue, WA | Menlo Park, CA …1h ago
-
Data Engineer USD 185K-196KApache Spark | Artificial Intelligence | CSS | Data Governance | Data ModelingMid-level Full TimeMenlo Park, CA1h ago
-
Operations Platform Engineer USD 153K-200KAPI Design | Alerting | Anomaly Detection | Backpressure | BufferingSenior-level Full TimeRedmond, WA1h ago
-
Entry-level Full TimeMenlo Park, CA1h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Computer Vision | Data Processing | Data StorageSenior-level Full TimeKirkland, WA, USA1h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Software Engineer, TPU Inference, AI/ML USD 147K-211KCloud Computing | Compilers | GPU | GPU Programming | InferenceMid-level Full TimeKirkland, WA, USA1h ago
-
Backup and Recovery | BigQuery | C++ | Consistency models | Copy-on-writeSenior-level Full TimeKirkland, WA, USA1h ago
-
Software Engineer, Machine Health USD 147K-211KAnalysis and Design | C++ | Data Processing | Data analytics | Distributed SystemsMid-level Full TimeSunnyvale, CA, USA1h ago
-
Networking AI Technical Lead USD 207K-300KAI | Algorithms | C++ | Compute Technologies | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA1h ago
-
Staff Software Engineer, BigQuery Managed Storage USD 207K-300KApache Iceberg | Data Lakes | Data Structures | Data Structures and Algorithms | Distributed ComputingSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA1h ago
-
Software Engineer III, AI/ML, Health and Home USD 147K-211KData Analysis | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA1h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud AI USD 147K-211KC++ | Data Processing | Debugging | Generative AI | Language ModelsSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, Full Stack, Gen AI Formats USD 174K-252KArtificial Intelligence | C++ | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1h ago
-
Staff Software Engineer, TPU Performance USD 207K-300KAlgorithm Design | Benchmarking | Compiler | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Native | Cloud Native Architecture | Cloud platformSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, Managed Kafka USD 174K-252KApache Kafka | Cloud platform | Distributed Systems | Go | Google CloudSenior-level Full TimeNew York, NY, USA; Raleigh, NC, …1h ago
-
Senior Software Engineer, AI/ML, Retail Ads, Fullstack USD 174K-252KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA1h ago
-
Algorithms | Data Structures | Deep learning | Embeddings | Information RetrievalSenior-level Full TimeMountain View, CA, USA1h ago
-
Senior Software Engineer, AI Infra, Ads Safety USD 174K-252KBenchmarking | C++ | Data Processing | Data Storage | Data platformSenior-level Full TimeLos Angeles, CA, USA1h ago
-
AWS | Azure | CI/CD | Data Engineering | DockerCross-functional collaboration | Documentation support | Flexible teamwork environment | MentorshipEntry-level InternshipIrvine, CA, US4h ago
-
Senior Software Engineer, Data Platform & AI Enablement USD 158K-260KAI infrastructure | Checkpointing | Distributed Systems | Exactly once | Exactly-once semanticsSenior-level Full TimeUS - San Francisco6h ago
-
Staff Backend Software Engineer- (AI Platform) USD 192K-260KAPI Development | Algorithms | Autoscaling | Data Structures | Distributed SystemsSenior-level Full TimeSan Francisco, California8h ago
-
Staff Backend Software Engineer- (AI Platform) USD 192K-260KAPI Design | APIs | Algorithms | Autoscaling | CachingSenior-level Full TimeSan Francisco, California8h ago
-
Staff Backend Software Engineer- (AI Platform) USD 166K-225KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPUSenior-level Full TimeSan Francisco, California8h ago