Staff Software Engineer, Machine Learning Inference Platform
Pittsburgh, PA or Remote
R
USD 175K-250K (estimate) Senior-level Full Time
Tasks
- Build multi tenant control plane
- Build multi tenant inference serving
- Build observability and SLOs
- Define platform architecture
- Develop api layers
- Develop developer SDKs
- Implement metering and rate limiting
- Optimize inference performance
- Partner on model onboarding and integration
- Perform capacity planning
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | CUDA kernels | Concurrency | Distributed Systems | GRPC | Go | Infiniband | KV cache | Low Latency | Low Latency Networking | Model Parallelism | Multi-tenancy | NCCL | NVIDIA Triton | NVLink | Performance Profiling | PyTorch | Python | REST | Rate Limiting | RoCE | Rust | SLOs | TensorRT | VLLM | WebSockets
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
C++ | Cloud Computing | Code Reviews | Deployment Automation | Distributed Systems401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R7h ago
-
Senior Machine Learning Engineer, Reinforcement Learning USD 150K-250KDomain Randomization | Embedded Systems | Gazebo | Isaac-Gym | Mujoco401k retirement plan | Dental insurance | Employee referral bonus | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R12h ago
-
Senior Data Platform Engineer USD 140K-220KApache Hudi | Apache Spark | CI/CD | Delta Lake | Distributed StorageSenior-level Full TimePittsburgh, PA or Remote R12h ago
-
Staff Software Engineer, Data Platform USD 170K-240KAPI Design | Backend Services | Frontend Development | JavaScript | Node.js401k match | Dental insurance | Equity stock options | Health insurance | Learning GrantSenior-level Full TimeRemote - USA R13h ago
-
Data Science Engineer (Shreveport, LA) USD 37K-40KData Historian | Data Visualization | Data analytics | Excel | Machine Learning401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeAtlanta, GA, United States R15h ago
-
C++ | CUDA | Data parallelism | GRPC | GoSenior-level Full TimePittsburgh, PA or Remote R16h ago
-
Staff Machine Learning Engineer, Underwriting and Credit USD 276K-415KA/B | A/B Testing | AWS | Airflow | B testingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of … R17h ago
-
Principal Research Data Engineer USD 142K-185KAirflow | Analytical processing | ArcGIS | Avro | CI/CDDental | Health care | PTO | Retirement | Sick leaveSenior-level Full TimeSt. Louis, Missouri, US R1d ago
-
Machine Learning Engineer (Active Secret Clearance) USD 160K-190KAgile | Asynchronous programming | CI/CD | Data Engineering | Docker401k plan | FSA | Fully remote work | HSA | Hybrid onsite optionMid-level Full TimeRemote; Tacoma, WA R1d ago
-
Cloud Storage | Compute Orchestration | Computer Vision | Data Lineage | Data PipelinesEnd-to-end responsibility | Fast-paced startup environment | High autonomy | Onsite work | OwnershipMid-level Full TimeSan Mateo, CA; Onsite R1d ago
-
Principal Optimization Engineer USD 117K-234KCONOPT | Cloud Computing | Convergence analysis | Discrete Optimization | Fluid modelingHealth care benefits | Hybrid remote option | Paid Holidays | Paid sick days | Paid vacationSenior-level Full TimeCAG10: ALC HQ, 1025 Cobb Place … R1d ago
-
APIs | Agile | Azure | Azure Data | Azure Data FactoryPeriodic travel | Remote work permittedSenior-level Full Time6314 Remote/Teleworker US, United States R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Data Privacy | Device deployment | Embedded SystemsCareer growth | Equal opportunity employer | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KBenchmarking | C plus plus | Core ML | Device security | Edge inferenceSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerators | Computer Vision | Data Quality | Data quality monitoringHealth benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KComputer Vision | Data Quality | Data labeling | Data quality monitoring | Deep learningCareer growth | Equal opportunity employer | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityCareer growth | Equal opportunity employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Modeling | Data QualityMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code reviewMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionBenefits provided | Career growth potential | Equal opportunity employment | Long term multi year engagement | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code reviewMid-level Full TimeUnited States - Remote R1d ago