Staff Software Engineer, Inference Cloud
Tasks
- Build core cloud systems for AI inference
- Define admission control quota rate limiting and service tiers
- Design multi region traffic architecture
- Drive latency throughput and resilience improvements
- Implement active active systems with failover
- Lead production incident response and observability
- Mentor senior engineers with design feedback
- Own inference cloud platform architecture
- Partner cross function teams to translate requirements into designs
- Plan capacity and drive post incident improvements
- Write and review production platform code
Perks/Benefits
- N/A
Skills/Tech-stack
Active/Active | Admission control | Alerting | Batching | C++ | Caching | Capacity Planning | Container Orchestration | Container platforms | Distributed Systems | Failover | Go | Incident Response | Load Balancing | Logging | Metrics | Multi-region | Multi-region architecture | Networking | Observability | Python | Quota Management | Rate Limiting | Request Routing | SLO | Service Discovery | Tracing | Traffic Management
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Computer Vision AI & ML Engineer USD 100K-300K3D Geometry | 3D Scene | 3D Scene Understanding | Computer Vision | Data AugmentationEntry-level Full TimeSan Mateo, CA6h ago
-
Enterprise AI Platform Engineer USD 130K-150KAPI Gateway | AWS | AWS IAM | Audit Logging | Azure401k | Dental insurance | Flexible PTO | Growth opportunities | Medical insuranceSenior-level Full TimeAustin, TX9h ago
-
Software Engineer, Storage USD 140K-265KAlerting | Autoscaling | C++ | Cloud Native | Databases401k contribution | Dental insurance | Education stipend | Healthy lunches | Home office improvement stipendMid-level Full TimeMountain View, CA9h ago
-
Software Engineer II, Machine Learning USD 145K-175KAWS | Airflow | CI/CD | Data Preparation | Experimentation401k employer match | Commuter subsidy | Concierge medical membership | Dental insurance | Fitness membership subsidyMid-level Full TimePalo Alto, California10h ago
-
AI Architect - Business Applications USD 138K-225KA/B | A/B Testing | API | B testing | ExperimentationHybrid work optionSenior-level Full TimeBellevue, WA, United States10h ago
-
Staff Data Engineer, Finance USD 170K-230KAWS | Asset-based lending | DBT | Data Ingestion | Data Modeling401k matching | Dental insurance | Employee assistance program | Employee recognition | Employee referral programSenior-level Full TimeSeattle, Washington, United States11h ago
-
Senior Data Engineer USD 165K-216KAWS | Apache Airflow | BI Integration | CI/CD | Cloud Computing401k match | Company events | Dental insurance | Employee discount | Free swagSenior-level Full TimeBeverly Hills12h ago
-
Staff Machine Learning Engineer USD 200K-220KAWS | Alerting | Auto Scaling | Automated retraining | CI/CD401k match | Dental insurance | Disability insurance | EAP support | Life insuranceSenior-level Full TimeWaltham, MA13h ago
-
Staff Machine Learning Engineer USD 200K-220KAWS | Artificial Intelligence | Automated retraining | CI/CD | Cloud Computing401k match | Bonding Leave | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeNorth Bethesda, MD13h ago
-
Data Engineer USD 81K-97KAWS | AWS Lambda | Apache Airflow | CI/CD | DBT401k | Flexible spending accounts | Health/vision/dental insurance | Hybrid work model | Paid disability benefitsMid-level Full TimeChicago - RAPP R13h ago
-
AWS | Anomaly Detection | Databricks | Docker | Explainability401k | Dental insurance | Equity compensation | Healthcare | Paid time offSenior-level Full TimeSan Francisco (Remote) R13h ago
-
Alerting | Automation | Classifier evaluation | Dashboards | Data InfrastructureHybrid work model | Resilience supportSenior-level Full TimeSan Francisco14h ago
-
Senior Software Engineer USD 107K-150KAWS | Agile | Datadog | GitHub | GitHub ActionsOn-call rotation | Remote workSenior-level Full TimeCosta Mesa, CA, United States R14h ago
-
Senior AI Product Engineer, Frameworks USD 166K-225KAgentic Workflows | Anthropic API | Chunked HTTP | Context Management | Data Processing401k plan | Healthcare concierge services | Hybrid work model | In office Tuesday through Thursday | Life and disability insuranceSenior-level Full TimeHybrid - San Francisco R14h ago
-
Algorithms | Data Governance | Data Structures | Databases | Distributed SystemsSenior-level Full TimeBellevue, Washington; Seattle, Washington14h ago
-
Algorithms | Cost Optimization | Data Governance | Data Structures | Database systemsSenior-level Full TimeMountain View, California; San Francisco, California14h ago
-
Quantitative Developer USD 135K-150KAPI Integration | C# | Compliance | Financial Data | Java401k match | Educational reimbursement | Gym subsidy | Health benefits | PTOMid-level Full TimeRemote - US R14h ago
-
Embedded Software Engineer II - (C++) Realtime Platform USD 150K-225KARM | ARM TrustZone | ASPICE | Automotive Ethernet | Bazel401k match | Adoption surrogacy support program | Backup child and elder care support | Commuter benefits | Daily meals and snacksMid-level Full TimePittsburgh, PA, Palo Alto, CA, Detroit, …14h ago
-
Senior-level Full TimeChantilly, VA14h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeExposure to real-world projects | Learning and development opportunities | MentorshipEntry-level InternshipBoston, MA, United States14h ago
-
Early-Career Network Engineer (RAN Optimization) USD 85K-130K4G | 5G | Automation | C Band | CBRS401k match | Dental insurance | Disability insurance | Educational assistance | Financial wellness programsMid-level Full TimePlano,Texas,United States R14h ago
-
Senior Embedded Software Engineer USD 146K-196KARM Cortex | C# | Digital Signal | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | FSA | Flexible scheduleSenior-level Full TimeCamarillo, CA, United States14h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R14h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R16h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R16h ago