Staff Backend Software Engineer- (AI Platform)
Tasks
- Build scalable reliable inference systems
- Define technical roadmap and long term architecture
- Design core APIs for model serving
- Develop routing caching observability systems
- Establish code quality testing best practices
- Implement model container builds and deployment workflows
- Improve latency availability and cost efficiency
- Mentor engineers through design reviews
- Optimize performance throughput autoscaling CPU GPU
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | APIs | Algorithms | Autoscaling | Caching | Data Structures | Deployment Workflows | Distributed Systems | High Throughput | Inference | Low Latency | Model Serving | Observability | Routing | Scheduling | System design
Education
N/A
Regions
Countries
States
Related jobs
-
Mid-level Full TimeKing George, VA, United States7h ago
-
Senior Software Engineer, Generative AI, Ads Safety USD 174K-252KAI Agents | Algorithms | C++ | Computer Vision | Context learningSenior-level Full TimeMountain View, CA, USA12h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Artificial Intelligence | Cloud Architecture | Cloud Computing | Data PrivacySenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA12h ago
-
Senior Software Engineer, Google.org, Data Analytics USD 174K-252KArtificial Intelligence | Data Structures | Data Structures and Algorithms | Distributed Systems | Integration TestingSenior-level Full TimeSeattle, WA, USA12h ago
-
Software Engineer III, Storage for Analytics USD 147K-211KC++ | Data analytics | Databases | Distributed Systems | ExperimentationSenior-level Full TimeKirkland, WA, USA12h ago
-
Software Engineer, ML Fleet Intelligence USD 207K-300KAnomaly Detection | Artificial Intelligence | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Forward Deployed Engineer II, Applied AI, Cloud USD 127K-183KAPIs | Agent systems | Agentic Workflows | Conversational AI | DebuggingTravel 50% timeSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …12h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | File systemsSenior-level Full TimeSeattle, WA, USA12h ago
-
Software Engineer USD 100K-150KAmazon Simple Queue Service | Amazon Web Services | Bedrock | Data Pipelines | Distributed Systems401k retirement plan | Dental insurance | Health insurance | Unlimited vacation | Vision insuranceSenior-level Full TimeLos Angeles, CA, US22h ago
-
Data Engineer / Azure Fabric Engineer Consultant USD 119K-193KAI Search | Access Control | Automated Monitoring | Azure AI | Azure AI SearchSenior-level Full TimeMason, OH, US22h ago
-
Mid-level Full TimeScottsdale, AZ23h ago
-
Principal Engineer, Data & ML Platform USD 120K-180KAPIs | Automated testing | Batch Processing | Cloud platform | Data ModelingSenior-level Full TimeScottsdale, AZ23h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R23h ago
-
Agent Frameworks | Deterministic systems | Distributed Systems | GraphQL | LLMDirect collaboration with executive leadership | High-ownership environment | Hybrid schedule | Relocation assistance | Remote flexibilitySenior-level Full TimeRemote; San Francisco, CA; United States R23h ago
-
Engineer 2, Data & Analytics USD 83K-138KAPI Design | Amazon Redshift | Amazon S3 | Application Programming | Application Programming InterfaceExecutive-level Full TimePA - Philadelphia, 1701 John F …23h ago
-
Senior Assistant Vice President USD 164K-220KAWS | Agent Orchestration | AgentOps | Asynchronous programming | AuditabilitySenior-level Full TimeUnited States23h ago
-
Senior ML/AI Engineer USD 130K-160KAgent Frameworks | Artificial Intelligence | Evaluation | Fine Tuning | Inference401k match | Company housing | Company technology package | Dental insurance | Flexible vacationSenior-level Full TimeSan Francisco1d ago
-
Senior AI Engineer USD 143K-215KAPI Integration | Agent systems | Authentication | Authorization | Autogen401k | Annual learning stipend | Health/Dental/Vision | Paid time offSenior-level Full TimeGreater Boston, MA; Los Angeles, CA; …1d ago
-
Software Engineer, Data Platform USD 105K-132KAPI | AWS | CI/CD | Code review | DBT401k | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R1d ago
-
Principal Software Engineer - Storage Cache USD 295K-345KActive/Active | Alertmanager | C++ | Chaos Engineering | Container OrchestrationEquity compensationSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Senior Software Engineer, Data Platform USD 125K-156KAPI Development | AWS | Automation | CI/CD | Data Engineering401k benefits | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R1d ago
-
Senior Software Engineer, Compute Infrastructure USD 164K-205KAWS | Azure | C++ | Distributed Systems | DockerSenior-level Full TimeSan Francisco, California1d ago
-
Amazon Web Services | Cloud platform | Data Validation | Data pipeline | Debugging401k matching | Flexible spending accounts | Paid parental leave | Paid sick days | Paid vacationMid-level Full TimeNew York, NY; Washington, DC1d ago
-
Senior Software Engineer - Robotics USD 134K-184KAgent coordination | Agile | Algorithms | C++ | CI/CDRemote work flexibilitySenior-level Full TimeWoburn, MA R1d ago
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R1d ago