Principal Software Engineer - CoreAI Model Inference & Serving
Redmond, WA, US; Mountain View, CA, US
USD 139K-304K Senior-level Full Time
Tasks
- Build large scale AI services
- Build smart routing for LLM requests
- Design core serving systems
- Distribute inference requests
- Drive AI system innovation
- Improve observability and performance
- Improve reliability and scalability
- Lead architecture and code reviews
- Mentor engineers
Perks/Benefits
- N/A
Skills/Tech-stack
C# | C++ | Distributed Systems | Java | Load Distribution | Observability | Performance Engineering | Request Routing | Scalability | System Reliability
Education
Regions
Countries
States
Related jobs
-
Embedded Linux Software Engineer USD 120K-161KBuild systems | C# | C++ | Device Drivers | Embedded SystemsSenior-level Full TimePhiladelphia, United States7h ago
-
223: Hardware Engineer Sr/Lead - Embedded (USA) USD 120K-192K802.11 a/b/g/n/ac | 802.15.4 | Automated testing | BOM | Battery ManagementFlexible work arrangements | Life insurance | Medical insurance | Paid time off | Performance bonusesSenior-level Full TimeWoodridge, Estados Unidos8h ago
-
Data Operations Engineer USD 119K-198KAnalytics | Apache Airflow | Apache Atlas | Apache Flink | Apache IcebergSenior-level Full TimeAustin, Texas, United States; San Jose, …9h ago
-
Senior-level Full TimeAustin, Texas, United States; San Jose, …9h ago
-
Data Foundations Engineer USD 119K-198KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid work schedule | On-call rotationSenior-level Full TimeAustin, Texas, United States; San Jose, …9h ago
-
Data Foundations Engineer USD 119K-198KAPI Instrumentation | AWS | Apache Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeAustin, Texas, United States; San Jose, …9h ago
-
Embedded Software Engineer, Connectivity/Wireless USD 147K-208KAndroid | Android Wi-Fi | Android networking | Audio | BluetoothSenior-level Full TimeSunnyvale, CA | Redmond, WA | …9h ago
-
Research Engineer - Contextual AI USD 141K-208KC++ | Computer Vision | Computer Vision Algorithms | DSP | Device to CloudSenior-level Full TimeRedmond, WA | Burlingame, CA9h ago
-
Research Engineer - Computer Vision and Robotics USD 143K-208K3D Reconstruction | C# | C++ | Computational imaging | Computer VisionConference Publications | Patent publications | Work authorization supportMid-level Full TimeRedmond, WA9h ago
-
Research Engineer - Perception and Machine Learning USD 170K-251KBenchmarking | C++ | Computer Vision | Data Pipelines | Deep learningSenior-level Full TimeRedmond, WA9h ago
-
Partner Engineer, Generative AI USD 173K-247KAWS | Azure | C++ | Conversational AI | Data TransformationSenior-level Full TimeMenlo Park, CA9h ago
-
C++ | Constrained optimization | Controls theory | Differentiable Programming | Differential EquationsSenior-level Full TimeRedmond, WA9h ago
-
AI Production Engineer USD 119K-180KAWS | Automation | Azure | C++ | CDNGlobal travel | On-call rotationSenior-level Full TimeMenlo Park, CA9h ago
-
Mid-level Full TimeNew York, NY10h ago
-
Embedded Software Engineer, Firmware USD 177K-251KBluetooth | Bring-up | C# | C++ | Camera PipelinesSenior-level Full TimeSunnyvale, CA | Redmond, WA | …10h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud USD 183K-265KAccelerators | C plus plus | Cloud Architecture | Cost Optimization | Data PipelinesCustomer facing collaboration | Regional technical enablement | Travel opportunitiesSenior-level Full TimeAddison, TX, USA; Washington D.C., DC, …10h ago
-
Staff Software Engineer, Data Cloud Memorystore USD 207K-300KAs-a-Service | C++ | Cache as a Service | Cross-Functional Collaboration | Cross-functionalSenior-level Full TimeKirkland, WA, USA10h ago
-
Software Engineer, Responsible AI USD 147K-211KAPI Design | C++ | Low Latency | Low-Latency Systems | Reliability EngineeringMid-level Full TimeSunnyvale, CA, USA10h ago
-
Senior Software Engineer, AI/ML, Google Workspace USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeNew York, NY, USA10h ago
-
Staff Software Engineer, Google Cloud Storage USD 207K-300KC++ | Cloud Storage | Continuous integration | Data Protection | Distributed SystemsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA10h ago
-
Software Engineer, BigQuery Managed Storage USD 147K-211KBigQuery | Change Data Capture | Cloud infrastructure | Cloud platform | Data CaptureMid-level Full TimeKirkland, WA, USA10h ago
-
Cloud Automation Engineer USD 80K-143KAPI | AWS | Azure | CI/CD | Cloud SDKRecognition | Time away from work | Volunteer days | Wellness initiativesMid-level Full TimeUnited States R11h ago
-
Staff Security and AI Engineer USD 239K-270KAI Security | Access Control | Agentic Workflows | Auditability | Automated testing401k match | Child care support | Donation matching | Fertility care support | Fitness and wellness subscription accessSenior-level Full TimeSan Francisco, CA (Hybrid) R18h ago
-
Senior Software Engineer - Optimizations and Operations USD 137K-251KAerospike | Agile | C# | C++ | Cloud Computing401k plan | Disability coverage | Employee stock purchase plan | Healthcare benefits | Life insuranceSenior-level Full TimeBellevue; Boulder; New York; Seattle19h ago
-
Staff Software Engineer, Quality and Release Platform USD 207K-279KArgo CD | Automation | CI/CD | Code Quality | GitHub Actions401k matching | Healthcare | Home office stipend | Paid parental leave | Unlimited vacationSenior-level Full TimeUS - Remote R19h ago