Staff Backend Software Engineer- (AI Platform)
Tasks
- Build routing caching observability and autoscaling components
- Collaborate with product platform and research teams to deliver serving systems
- Design and implement core systems and APIs for model serving
- Drive architectural decisions for CPU and GPU inference performance
- Establish best practices for code quality, testing, and operational readiness
- Improve latency availability and cost effectiveness
- Mentor engineers through design reviews and technical guidance
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | Algorithms | Autoscaling | Caching | Data Structures | Distributed Systems | Docker | High Throughput | Inference | Low Latency | Machine Learning | Model Serving | Observability | Performance Tuning | Routing | System design
Education
N/A
Regions
Countries
States
Related jobs
-
Data Architect USD 135K-165KAPI Integration | API Keys | API Management | Amazon Kinesis | Amazon Web ServicesHighly cleared team support | Security-focused environmentSenior-level Full TimeOther, VA8h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States10h ago
-
Mid-level Full TimeAuburn Hills, MI, United States10h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence10h ago
-
Senior-level Full TimeDallas, Texas, United States11h ago
-
As-a-Service | C++ | Cloud Functions | Cloud platform | Compute TechnologiesSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …12h ago
-
Software Engineer III, Infrastructure, Cloud Storage USD 147K-211KC++ | Cloud Storage | Compute Technologies | Continuous integration | Data StorageSenior-level Full TimeSeattle, WA, USA12h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA12h ago
-
Research Scientist, Biomedical AI, DeepMind USD 147K-211KArtificial Intelligence | Benchmarking | Computational pipeline | Data Analysis | EvaluationMid-level Full TimeMountain View, CA, USA12h ago
-
C# | C++ | Co-design | Compiler technology | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA12h ago
-
ALB | ALB/NLB | AWS | AWS CDK | AWS CloudSenior-level Full TimeDallas, Texas, United States20h ago
-
API Integration | Agent systems | Asynchronous processing | Chunking | Cost OptimizationCompetitive salary based on experience | High-impact role | Opportunity to scale AI systems | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R23h ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R23h ago
-
Mid-level ContractPhoenix, AZ23h ago
-
Lead AI Engineer (Gen AI Platform Services) USD 215K-245KAWS | AWS Ultraclusters | Azure | C# | C++Senior-level Full TimeSan Jose, CA, United States23h ago
-
Lead Software Engineer – Robotics Platform USD 224K-431KC++ | CUDA | Distributed tracing | Embedded Systems | Isaac SimEquity | Health and wellness benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara, United States23h ago
-
Agile | CSS | Cloud Computing | DBT | Data LakesRelocation eligibleMid-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …23h ago
-
Agile | CSS | DBT | Data Lakes | Data Modeling401k match | Dental insurance | Employee assistance program | Employee scholar program | Flexible spending accountsSenior-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …23h ago
-
Staff Data Engineer USD 106K-284KAWS | Alerting | Amazon SNS | Apache Kafka | Argo CDMedical, dental, and vision coverage | Paid time off | Retirement savings options | Wellness programsSenior-level Full TimeWork At Home-Texas, United States23h ago
-
TAMIDS Senior AI Engineer / Lead AI Engineer USD 50K-55KArtificial Intelligence | Backend Development | Data Governance | Data Pipelines | Database ManagementSenior-level Full TimeCollege Station, TX, United States23h ago
-
Lead AI Software Engineer- AI Enablement USD 140K-231KAI Agents | AWS | AWS CDK | Agile Scrum | Amazon BedrockSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States23h ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R23h ago
-
AWS | Agent Frameworks | Agent Orchestration | Amazon Kinesis | Amazon SageMaker401k plan | Dental insurance | Long-term disability | Medical insurance | Paid time offMid-level Full TimeCharlotte, 1120 S Tryon St., Corp, …23h ago
-
Principal ML Ops Engineer USD 117K-201KAWS | Access Control | Amazon SageMaker | Auditability | Azure401k retirement plan | Holiday pay | Paid vacation | Parental leave | Pension planSenior-level Full TimeUS076 FL Jacksonville - 7500 Centurion …23h ago