Senior Staff Engineer, GDC AI Inference Platform
Sunnyvale, CA, USA; Kirkland, WA, USA
USD 262K-365K Senior-level Full Time
Tasks
- Architect LLM serving infrastructure
- Build multi agent orchestration platforms
- Collaborate with research SRE product and platform teams
- Define AI infrastructure roadmap for LLM serving and Agentic AI
- Implement secure isolated execution environments
- Integrate tools and enable state persistence
- Optimize resource utilization and reliability
- Resolve high impact ambiguous systems issues
Perks/Benefits
Skills/Tech-stack
Agent coordination | C++ | Cloud infrastructure | Containerization | Data Structures | Data Structures and Algorithms | Distributed Systems | Docker | Execution environments | Go | High Throughput | High Throughput Inference Engines | High-throughput inference | Inference Engines | Java | Kotlin | Kubernetes | LLM serving | Machine Learning | Multi-Agent | Multi-Agent Coordination | Python | Secure Execution Environments | Secure execution | Software Architecture | Speculative decoding | State management | Technical leadership | Tool integration
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Mid-level Full TimeNew York, NY, US4h ago
-
Applied AI/ML [Multiple Positions Available] USD 165K-195KAI Governance | AI governance framework | AWS | Azure | BM25Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States5h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton5h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton5h ago
-
Software Engineer, Machine Learning, Travel Ads USD 147K-211KA/B | A/B Testing | Adbrain | B testing | C++Mid-level Full TimeMountain View, CA, USA7h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA7h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA7h ago
-
BMC | C# | C++ | Cross-Functional Collaboration | Cross-functionalSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Algorithms | C++ | Cloud Storage | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …7h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935511h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US13h ago
-
PIIM Analytics Engineer USD 105K-160KAI/ML | APIs | Access Control | Azure Databricks | Code AutomationFull time office or project telework | Relocation assistanceMid-level Full TimeHouston, TX, US13h ago
-
Senior-level Full TimeSeattle, Washington, United States; USA - …14h ago
-
Senior Robotics Systems Engineer USD 121K-165KActuator integration | Cause analysis | Circuit design | Debugging | Device Drivers401k plan | Dental insurance | Fully stocked kitchen | Green card support | Health insuranceSenior-level Full TimeMilpitas, CA14h ago
-
Principal AI Engineering Architect USD 224K-308KAWS | Data Processing | Docker | Google Cloud | High AvailabilityAdoption and surrogacy reimbursement | Cancer Care Program | Employee Assistance Program (EAP) | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R14h ago
-
Staff Robotics Engineer, Maritime USD 254K-336KC++ | Collision Avoidance | Computer Vision | Computer Vision Algorithms | Machine LearningHealth benefits | Mentorship | Recovery BenefitsSenior-level Full TimeQuincy, Massachusetts, United States15h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KC++ | Cameras | Computer Vision | Gazebo | LidarHealth insurance | Mentorship | Travel opportunitiesSenior-level Full TimeQuincy, Massachusetts, United States15h ago
-
Machine Learning Operations Engineer USD 140K-240KAWS | Alerting | Cloud GPU | Compression | Data Quality401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ16h ago
-
Applied AI Engineer - AI Neobank App (US) USD 110K-148KAPI Integration | Agentic Workflows | Evaluation | LLM APIs | Language ProcessingRemote workMid-level Full TimeUnited States16h ago
-
Machine Learning Engineer, GPU Kernel and Runtime USD 213K-263KCUDA | Deep learning | GPU Computing | Kernel optimization | Machine LearningSenior-level Full TimeMountain View, California17h ago
-
Distributed Systems | Fault Tolerance | GPU Computing | JAX | Low LatencyBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, California17h ago
-
Sr. Validation & Tools Engineer - Embedded Firmware USD 160K-190KAppium | Bug tracking | C plus plus | C# | CAN401k match | Dental insurance | FSA | Family building benefits | Fertility benefitsSenior-level Full TimePalo Alto17h ago