Member of Technical Staff (Software Engineer, Inference & Training Platform)
Tasks
- Build scheduling and placement logic
- Build self serve compute platform
- Implement autoscaling
- Implement fault tolerance
- Implement observability
- Manage multi cluster Kubernetes across providers
- Operate GPU fleet
- Own Kubernetes for GPU orchestration
- Set platform technical direction across teams
- Support training jobs and inference services
- Write Kubernetes operators and CRDs
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | C++ | CRD | CUDA | Cluster management | Custom Resource Definitions | Distributed Systems | Fault Tolerance | GPU provisioning | GPU scheduling | Go | Grafana | HPC scheduling | High Availability | Infiniband | Kubernetes | Multi-Cluster | Multi-Cluster Management | NVIDIA GPU | Networking | Observability | Prometheus | RDMA | Resource allocation | RoCE | Rust | SGLang | Scheduling | Slurm | TensorRT-LLM | Triton | VLLM | Weights and Biases
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
ASE | Apptainer | Binding Site Identification | CI/CD | CheminformaticsHealth insurance | Paid time off | Remote work flexibility | Retirement contributionsSenior-level Full TimeSan Jose, California, US, 951344h ago
-
Senior Software Engineer - Machine Learning USD 152K-186KApache Flink | Apache Storm | Deep learning | Generative AI | Go401k match | Dental insurance | Equity awards | Health plan | Life insuranceSenior-level Full TimeChicago, IL 60607, United States7h ago
-
Staff Software Engineer, Foundation Model API USD 190K-265KCloud Native | Cloud-native infrastructure | Deployment Pipelines | Distributed Systems | GPU OrchestrationSenior-level Full TimeSan Francisco, California7h ago
-
Algorithm Developer, Battlespace Awareness USD 111K-147KAgile | C++ | Classification | Clustering | Data AssociationMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …8h ago
-
Alerting | Cloud Computing | Compute Optimization | Data Quality | Distributed Training401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ9h ago
-
Machine Learning Engineer II USD 75K-85KAPI Development | AWS | Algorithms | Azure | Big Data401k match | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeSaint Charles, MO, United States11h ago
-
Software Engineer, Platform USD 180K-225KAWS Step Functions | Amazon Web Services | Authentication and Authorization | CI/CD | CircleCICommuter stipend | Generous PTO | Health, dental and vision coverage | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY12h ago
-
Airflow | Amazon Web Services | Apache Flink | Apache Spark | Cloud platformRemote work | US time zone flexibilityEntry-level Full TimeColumbia - Maryland13h ago
-
AWS | Airflow | Crawling | Cypher | Data VisualizationRemote work | US only work authorization without sponsorshipMid-level Full TimeColumbia - Maryland13h ago
-
Object Storage Product Engineer USD 204K-280KAPIs | Distributed Systems | Go | Key-Value Datastore | Key-value401k plan | Commuter benefits | Continuous learning benefits | Employer paid dental coverage | Employer paid vision coverageSenior-level Full TimeRemote: United States R13h ago
-
Senior-level Full TimeNew York13h ago
-
Software Engineer 1 - AI/ML/Terraform/C++/AWS/GPU USD 130K-270KAI | Amazon Web Services | C++ | GPU | Golang401k | Accidental death and dismemberment | Dental insurance | Health savings account | Life insuranceSenior-level Full TimeAnnapolis Junction, MD13h ago
-
Machine Learning Infrastructure Tech Lead USD 200K-300KBatching | Benchmarking | CUDA | Distributed Systems | GPU UtilizationCommuter reimbursement | Daily lunch | Dental insurance | Health and wellness budget | Health insuranceSenior-level Full TimeSan Francisco Office13h ago
-
Principal AI Engineer USD 200K-220KAWS | Agent Orchestration | Authentication | Authorization | CI/CDCareer advancement | Employee recognition | LinkedIn Learning Platform | Open PTO | Paid parental leaveSenior-level Full TimeRemote US R14h ago
-
Engineer Embedded System Engineering USD 87K-116K8D | A3 | Blink Codes | Bus Traces | Bus analyzer401k plan | Employee assistance program | Paid sick leave | Paid vacation time | Tuition reimbursementEntry-level Full TimeIrvine, CA, United States15h ago
-
Staff Software Engineer, Cloud Data Storage USD 212K-286KAWS | Caching | Cassandra | ClickHouse | Cloud platform401k plan | Disability insurance | Health Dental Vision Premium Coverage | In-home office setup | Internet stipendSenior-level Full TimeUnited States - Remote Opportunity R15h ago
-
Senior AI Platform Engineer Contract USD 125K-180KABAC | API Development | Access Control | Agent workflows | Audit LoggingContract opportunitySenior-level Full TimeSan Francisco, CA15h ago
-
Forward Deployed AI Product Engineer USD 156K-200KAI Agents | AI guardrails | APIs | AWS | AzureCustomer embedded role | On-site client work | Ownership and autonomy | Remote-first | Travel requiredSenior-level Full TimeUS-Remote R16h ago
-
Site Reliability Engineer, Pragma USD 175K-230KAPI Integration | API documentation | AWS | Alerting | Automation401k match | Employee stock purchase plan | Free meals | Hybrid work environment | Medical, dental, and vision benefitsMid-level Full TimeNew York, New York, United States17h ago
-
Amazon SQS | Cadence | Control Plane | Drift Detection | Event StreamingEquity | Health insuranceSenior-level Full TimeSan Francisco17h ago
-
Staff Embedded ML Engineer, Edge AI USD 185K-244KARM NEON | Bandwidth Optimization | C# | C++ | Cache optimizationEmployee Resource Groups (ERGs) | Free home security system | Hybrid work model | Professional monitoring | Wellness and lifestyle benefitsSenior-level Full TimeBoston, MA18h ago
-
Data Engineer USD 100K-115KAWS Glue | AWS Lambda | Access Control | Amazon Athena | Amazon RedshiftMid-level Full TimeChicago, Illinois, United States18h ago
-
Senior Robotics Platform Engineer (Robotics/Infra) USD 121K-190KAnsible | Behavior Trees | Container Deployment | DDS | DiagnosticsSenior-level Full TimeOpen to Remote (USA); Pittsburgh, PA R18h ago
-
AI Software Engineer USD 170K-253KAgent Development | Auth | CI/CD | Canary Releases | Evaluation FrameworksEmployee stock purchase plan | Health insurance | Leave options | Life insurance | Paid time offSenior-level Full TimeHome - United States Tier 2 …19h ago
-
Senior Electrical Engineer, Data Centers USD 160K-190K800 Vdc | Architecture Review | BESS integration | DC power | DC power distribution401k match | Company holidays | Dental insurance | Equal opportunity | Medical insuranceSenior-level Full TimeHouston, Texas, United States20h ago