Staff Backend Software Engineer- (AI Platform)
Tasks
- Build scalable reliable foundation model serving systems
- Collaborate with product platform and research teams
- Design and implement backend systems and APIs
- Develop token based rate limiters and optimizers
- Ensure operational excellence through testing and readiness
- Lead technical design reviews and mentor engineers
- Optimize performance throughput and latency for GPU workloads
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Algorithms | Autoscaling | Data Structures | Distributed Systems | GPU Inference | High Throughput | High-Throughput Systems | Low Latency | Low-Latency Systems | Operational excellence | Performance optimization | Rate Limiting | System design | Testing
Education
N/A
Regions
Countries
States
Related jobs
-
Mid-level Full TimeKing George, VA, United States6h ago
-
Senior Software Engineer, Generative AI, Ads Safety USD 174K-252KAI Agents | Algorithms | C++ | Computer Vision | Context learningSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Artificial Intelligence | Cloud Architecture | Cloud Computing | Data PrivacySenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA11h ago
-
Senior Software Engineer, Google.org, Data Analytics USD 174K-252KArtificial Intelligence | Data Structures | Data Structures and Algorithms | Distributed Systems | Integration TestingSenior-level Full TimeSeattle, WA, USA11h ago
-
Software Engineer III, Storage for Analytics USD 147K-211KC++ | Data analytics | Databases | Distributed Systems | ExperimentationSenior-level Full TimeKirkland, WA, USA11h ago
-
Software Engineer, ML Fleet Intelligence USD 207K-300KAnomaly Detection | Artificial Intelligence | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | File systemsSenior-level Full TimeSeattle, WA, USA11h ago
-
Data Analyst, Payments Performance USD 124K-187KCode review | Data Visualization | Data analytics | Git | Python401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsSenior-level Full TimeSeattle, WA19h ago
-
Analytics Engineer USD 124K-187KCode review | Data Visualization | Git | Python | SQL401k plan | Company bonus | Dental benefits | Equity | Medical benefitsSenior-level Full TimeSeattle, WA19h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | Data AnalysisCommuter benefits | Generous time off | Healthcare benefits | Income protection | Mental health resourcesSenior-level Full TimeCosta Mesa, California, United States20h ago
-
Software Engineer USD 100K-150KAmazon Simple Queue Service | Amazon Web Services | Bedrock | Data Pipelines | Distributed Systems401k retirement plan | Dental insurance | Health insurance | Unlimited vacation | Vision insuranceSenior-level Full TimeLos Angeles, CA, US22h ago
-
Principal Engineer, Data & ML Platform USD 120K-180KAPIs | Automated testing | Batch Processing | Cloud platform | Data ModelingSenior-level Full TimeScottsdale, AZ22h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R22h ago
-
AI Inference | AI Training | AI systems | AI systems design | AMD GPUsDomestic travel | International travel | Remote workSenior-level Full TimeRemote Employee US, NH, US R22h ago
-
Agent Frameworks | Deterministic systems | Distributed Systems | GraphQL | LLMDirect collaboration with executive leadership | High-ownership environment | Hybrid schedule | Relocation assistance | Remote flexibilitySenior-level Full TimeRemote; San Francisco, CA; United States R22h ago
-
Senior Assistant Vice President USD 164K-220KAWS | Agent Orchestration | AgentOps | Asynchronous programming | AuditabilitySenior-level Full TimeUnited States22h ago
-
Machine Learning Engineer, PhD Intern USD 123K-161KAWS | Azure | Code review | Data Analysis | ExperimentationIn office work 5 days per week | Mentorship | Structured intern programming | Team eventsEntry-level InternshipSan Francisco, CA23h ago
-
Senior AI Engineer USD 143K-215KAPI Integration | Agent systems | Authentication | Authorization | Autogen401k | Annual learning stipend | Health/Dental/Vision | Paid time offSenior-level Full TimeGreater Boston, MA; Los Angeles, CA; …1d ago
-
Software Engineer, Data Platform USD 105K-132KAPI | AWS | CI/CD | Code review | DBT401k | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R1d ago
-
Principal Software Engineer - Storage Cache USD 295K-345KActive/Active | Alertmanager | C++ | Chaos Engineering | Container OrchestrationEquity compensationSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Senior Software Engineer, Data Platform USD 125K-156KAPI Development | AWS | Automation | CI/CD | Data Engineering401k benefits | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R1d ago
-
Action Policy Learning | C++ | Data collection | Domain Randomization | Edge inference401k retirement plan | Dental insurance | Employee referral bonuses | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R1d ago
-
Senior Software Engineer, Compute Infrastructure USD 164K-205KAWS | Azure | C++ | Distributed Systems | DockerSenior-level Full TimeSan Francisco, California1d ago
-
Senior Software Engineer - Robotics USD 134K-184KAgent coordination | Agile | Algorithms | C++ | CI/CDRemote work flexibilitySenior-level Full TimeWoburn, MA R1d ago
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R1d ago