Staff Software Engineer, Inference Cloud
Tasks
- Build core cloud systems for AI inference
- Define admission control quota rate limiting and service tiers
- Design multi region traffic architecture
- Drive latency throughput and resilience improvements
- Implement active active systems with failover
- Lead production incident response and observability
- Mentor senior engineers with design feedback
- Own inference cloud platform architecture
- Partner cross function teams to translate requirements into designs
- Plan capacity and drive post incident improvements
- Write and review production platform code
Perks/Benefits
- N/A
Skills/Tech-stack
Active/Active | Admission control | Alerting | Batching | C++ | Caching | Capacity Planning | Container Orchestration | Container platforms | Distributed Systems | Failover | Go | Incident Response | Load Balancing | Logging | Metrics | Multi-region | Multi-region architecture | Networking | Observability | Python | Quota Management | Rate Limiting | Request Routing | SLO | Service Discovery | Tracing | Traffic Management
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Computer Vision AI & ML Engineer USD 100K-300K3D Geometry | 3D Scene | 3D Scene Understanding | Computer Vision | Data AugmentationEntry-level Full TimeSan Mateo, CA5h ago
-
Software Engineer, Storage USD 140K-265KAlerting | Autoscaling | C++ | Cloud Native | Databases401k contribution | Dental insurance | Education stipend | Healthy lunches | Home office improvement stipendMid-level Full TimeMountain View, CA9h ago
-
Software Engineer II, Machine Learning USD 145K-175KAWS | Airflow | CI/CD | Data Preparation | Experimentation401k employer match | Commuter subsidy | Concierge medical membership | Dental insurance | Fitness membership subsidyMid-level Full TimePalo Alto, California9h ago
-
Staff Data Engineer, Finance USD 170K-230KAWS | Asset-based lending | DBT | Data Ingestion | Data Modeling401k matching | Dental insurance | Employee assistance program | Employee recognition | Employee referral programSenior-level Full TimeSeattle, Washington, United States10h ago
-
Senior Data Engineer USD 165K-216KAWS | Apache Airflow | BI Integration | CI/CD | Cloud Computing401k match | Company events | Dental insurance | Employee discount | Free swagSenior-level Full TimeBeverly Hills12h ago
-
Data Engineer USD 81K-97KAWS | AWS Lambda | Apache Airflow | CI/CD | DBT401k | Flexible spending accounts | Health/vision/dental insurance | Hybrid work model | Paid disability benefitsMid-level Full TimeChicago - RAPP R13h ago
-
Senior Software Engineer USD 107K-150KAWS | Agile | Datadog | GitHub | GitHub ActionsOn-call rotation | Remote workSenior-level Full TimeCosta Mesa, CA, United States R13h ago
-
Quantitative Developer USD 135K-150KAPI Integration | C# | Compliance | Financial Data | Java401k match | Educational reimbursement | Gym subsidy | Health benefits | PTOMid-level Full TimeRemote - US R13h ago
-
Embedded Software Engineer II - (C++) Realtime Platform USD 150K-225KARM | ARM TrustZone | ASPICE | Automotive Ethernet | Bazel401k match | Adoption surrogacy support program | Backup child and elder care support | Commuter benefits | Daily meals and snacksMid-level Full TimePittsburgh, PA, Palo Alto, CA, Detroit, …13h ago
-
Senior-level Full TimeChantilly, VA14h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeExposure to real-world projects | Learning and development opportunities | MentorshipEntry-level InternshipBoston, MA, United States14h ago
-
Early-Career Network Engineer (RAN Optimization) USD 85K-130K4G | 5G | Automation | C Band | CBRS401k match | Dental insurance | Disability insurance | Educational assistance | Financial wellness programsMid-level Full TimePlano,Texas,United States R14h ago
-
Senior Embedded Software Engineer USD 146K-196KARM Cortex | C# | Digital Signal | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | FSA | Flexible scheduleSenior-level Full TimeCamarillo, CA, United States14h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R14h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R15h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R15h ago
-
Sr. Software Engineer (Computational Geometry) USD 140K-200KC++ | CAD/CAM | CNC machining | Computational Geometry | Geometric analysisImpact on aerospace production | Mentorship opportunities | Startup environmentSenior-level Full TimeHuntington Beach16h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States16h ago
-
kdb+ Contractor (Capital Markets) USD 150K-200KAWS | Azure | Electronic Trading | GCP | Kdb PlusContract opportunities | On site work 5 days per week | Permanent opportunitiesSenior-level ContractNew York, NY, United States17h ago
-
Senior kdb+ Engineer USD 150K-200KAI Tooling | AWS | Azure | Capital Markets | Electronic TradingFlexible holiday allowance | Healthcare and wellbeing | Hybrid working | Leadership development | Paid certificationsSenior-level Full TimeNew York, NY, United States17h ago
-
Platform and Integrations Engineer USD 100K-200KAnthropic | GraphQL | Next.js | Node.js | OpenAIIn-person work | Medical/Dental/Vision | Significant equity upsideEntry-level Full TimeSan Francisco, CA, US17h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R17h ago
-
AI/ML Engineer USD 170K-220KBenchmarking | Cloud Computing | Containerization | Debugging | Distributed Systems401k match | Education & training benefits | Healthcare dental vision coverage | Paid Holidays | Paid time offSenior-level Full TimeRome, NY R17h ago
-
Capacity Planning | Capital project management | Continuous Improvement | Data collection | Food safety401k employer match | Bonuses | Dental insurance | Health insurance | Paid time offMid-level Full TimeWillmar, MN, United States18h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York18h ago