Staff Backend Software Engineer- (AI Platform)
Tasks
- Build scalable reliable inference systems
- Define technical roadmap and long term architecture
- Design core APIs for model serving
- Develop routing caching observability systems
- Establish code quality testing best practices
- Implement model container builds and deployment workflows
- Improve latency availability and cost efficiency
- Mentor engineers through design reviews
- Optimize performance throughput autoscaling CPU GPU
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | APIs | Algorithms | Autoscaling | Caching | Data Structures | Deployment Workflows | Distributed Systems | High Throughput | Inference | Low Latency | Model Serving | Observability | Routing | Scheduling | System design
Education
N/A
Regions
Countries
States
Related jobs
-
AWS | Alteryx | Amazon SageMaker | Azure | Azure DataMid-level Full TimeNew York, NY, United States3h ago
-
Artificial Intelligence | Data Analysis | Data Structures | Data structures algorithms | Human-in-the-loopSenior-level Full TimeMountain View, CA, USA4h ago
-
Staff Software Engineer, Embedded Systems/Firmware, Platforms Infrastructure Engineering USD 207K-300KAlgorithms | Data Structures | Distributed Computing | Embedded Systems | Embedded operating systemsSenior-level Full TimeSunnyvale, CA, USA4h ago
-
C++ | Data Structures | Data Structures and Algorithms | Embedded Linux | Software ArchitectureSenior-level Full TimeMountain View, CA, USA4h ago
-
Data Processing | Data Storage | Data Structures | Data Structures and Algorithms | Distributed SystemsSenior-level Full TimeMountain View, CA, USA4h ago
-
Applied AI ML Lead - LLM SUITE ENGINEERING USD 176K-215KAPI Design | AWS | Agentic AI | Caching | Cloud NativeBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeWilmington, DE, United States12h ago
-
Senior AI Engineer USD 107K-199KAKS | API Design | Alerts | Anomaly Detection | Apache SparkHybrid work environment | Inclusion support | Learning opportunities | Well-being supportSenior-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …15h ago
-
Associate AI Engineer USD 80K-134KAPI Development | Azure | Cloud Platforms | Data Preparation | DocumentationFlexible work environment | Hybrid work arrangement | Inclusion programs | Paid time off | Wellness benefitsMid-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …15h ago
-
Entry-level Full TimeUnited States - Remote R15h ago
-
CI/CD | Docker | Drift Detection | Embeddings | Experiment trackingMentorship | Remote workSenior-level Full TimeUnited States - Remote R15h ago
-
Data Engineer USD 85K-141KAPI Gateways | CI/CD | Cloud Databases | Data Governance | Data Lakes401k retirement plan | Adoption Assistance | Flexible spending accounts | Health savings account | Parental leaveMid-level Full TimeClient Office: Aberdeen, MD, United States15h ago
-
AI Engineer, Generative AI Agents USD 130K-188KAWS | Agile | Amazon Bedrock | Context engineering | Cost OptimizationOn-site work requiredSenior-level Full TimeDenver, CO16h ago
-
Lead Data Engineer USD 316K-506KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakesLearning and development programs | Mentorship | Remote workSenior-level Full TimeChicago, Illinois, USA R16h ago
-
Supercomputing Intern - Summer 2027 USD 40K-140KAlgorithms | C# | C++ | CI/CD | Data StructuresDaily meals | Direct mentorship | Housing supportEntry-level InternshipSan Jose17h ago
-
Supercomputing Intern - Fall 2026 USD 40K-140KC# | C++ | CI/CD | Co-design | Data StructuresDaily Dinner | Daily lunch | Direct mentorship | Housing support | Relocation supportEntry-level InternshipSan Jose17h ago
-
Inference Intern - Summer 2027 USD 64K-142KAccelerator architectures | C++ | Compilers | Debugging | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose17h ago
-
Inference Intern - Spring 2027 USD 60K-142KC++ | Compilers | Consensus Protocols | Consistency models | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose17h ago
-
Principal Agentic AI Engineer USD 274K-338KAgent Orchestration | Auditability | Benchmarking | Confidence scoring | Distributed SystemsContinuing education support | Dental insurance | Flexible vacation policy | Health insurance | Paid parental leaveSenior-level Full Timesan francisconew york R17h ago
-
Software Engineer, Enterprise AI Platform USD 230K-385KAPI Design | Agent systems | Applied AI | Auditability | AuthenticationMid-level Full TimeSan Francisco18h ago
-
C++ | Distributed Systems | Fault Tolerance | Golang | InferenceBonus program | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA; San Francisco, …20h ago
-
Staff Machine Learning Engineer, Voice AI USD 220K-280KAudio codecs | Audio signal processing | Batching | CUDA | Deep learningHealth insurance | Startup equitySenior-level Full TimeSan Francisco21h ago
-
Senior Data Engineer USD 179K-255KAWS | AWS DMS | Agile | Amazon DynamoDB | Amazon EC2401k | Accident insurance | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeAustin, Texas23h ago
-
Entry-level Full TimeCary, NC, United States1d ago
-
Software Engineer II - Model Platform USD 149K-214KAWS | Azure | Cloud Computing | Data Pipelines | Distributed SystemsMid-level Full TimeRemote - USA R1d ago
-
Availability Engineering | Canary Deployment | Capacity Planning | Cause analysis | Change ManagementSenior-level Full TimeSeattle, Washington, United States1d ago