Software Engineer - Training/Inference (C++)
Tasks
- Benchmark and accelerate inference engines
- Build high concurrency inference serving systems
- Create CI CD infrastructure for endpoint deployment
- Deploy and update inference engines
- Design distributed model serving systems
- Develop debugging and profiling tools
- Optimize model inference latency and throughput
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Discounts
- Health insurance
- Life insurance
- Vision insurance
Skills/Tech-stack
Auto Scaling | C++ | CI/CD | CUDA | Code generation | Continuous batching | GPU | GPU Kernels | Load Balancing | Low Precision | Low-precision numerics | Quantization | Rust | SGLang | Speculative decoding | TensorRT-LLM | Triton | VLLM
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Member of Technical Staff - Simulation Engineer USD 180K-300KBenchmarking | C++ | Calibration | Data Generation | Distributed SystemsOn-site work in San FranciscoSenior-level Full TimeSan Francisco Bay Area8h ago
-
Senior Software Engineer II, Storage (File & Block) USD 165K-242KBlock Storage | CSI | ClickHouse | Data durability | Distributed Storage401k match | Flexible PTO | Flexible spending account | Health savings account | Medical, dental, and vision insuranceSenior-level Full TimeSunnyvale, California10h ago
-
Senior Software Engineer II, Storage (File & Block) USD 165K-242KBlock Storage | CRD | CSI | ClickHouse | Control Plane401k employer match | Catered lunch | Childcare support | Flexible PTO | Flexible spending accountSenior-level Full TimeNew York, NY10h ago
-
Staff Software Engineer, Storage USD 188K-275KC++ | CSI | Ceph | Crash Consistency | Distributed Systems401k match | Dental insurance | Flexible PTO | Health insurance | Life insuranceSenior-level Full TimeNew York, NY10h ago
-
Staff Software Engineer, Storage USD 188K-275KC++ | CRDs | CSI | Ceph | Crash Consistency401k employer match | Employee stock purchase program ESPP | Flexible PTO | Flexible spending account | Health savings accountSenior-level Full TimeSunnyvale, California10h ago
-
Staff Software Engineer, Storage USD 188K-275KBlock Storage | C++ | CSI | Caching | Ceph401k employer match | Casual work environment | Catered lunch | Employee stock purchase program ESPP | Flexible PTOSenior-level Full TimeBellevue, Washington10h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KC++ | CSI | ClickHouse | Database | Debugging401k match | Childcare support | Dental insurance | Disability insurance | Employee stock purchase programSenior-level Full TimeNewYork, NY10h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KC++ | CSI | ClickHouse | CockroachDB | Consistency401k employer match | Catered lunch | Childcare support | Company paid life insurance | Employee stock purchase programSenior-level Full TimeBellevue, Washington10h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KBlock Storage | C++ | CSI | ClickHouse | Distributed Systems401k match | Disability insurance | Flexible PTO | Health insurance | Life insuranceSenior-level Full TimeSunnyvale, California10h ago
-
Senior AI/ML Engineer - Agentic AI USD 148K-306KAPI Design | AWQ | Agent systems | Annotation Workflows | Application developmentSenior-level Full TimePalo Alto, CA, US, 9430414h ago
-
Senior Staff AI Engineer USD 135K-178KAPI Development | AWS | Airflow | Anthropic | AutogenDiversity and inclusion | Employee mentoring | Inclusive culture | Remote work optionsSenior-level Full TimeOakland, CA; Remote (United States) R1d ago
-
Senior Embedded Software Engineer, EW USD 191K-253K*nix | Built-in Test | Configuration Management | Deterministic builds | DirectXSenior-level Full TimeCosta Mesa, California, United States1d ago
-
Senior-level Full TimePalo Alto1d ago
-
Space Operations Engineer (Embedded Software) USD 119K-160KAPI | ARM | C# | C++ | Communication ProtocolsMid-level Full TimeSan Francisco, CA1d ago
-
Applied Data Solutions Program (Internships) USD 40K-44KApache Spark | C++ | Data Modeling | Data Structures | Development LifecycleCollaborative team environment | Mentorship | TrainingEntry-level InternshipAustin; Cupertino1d ago
-
Applied Data Solutions Program (Internships) USD 40K-44KApache Spark | Batch Processing | C++ | Data Modeling | JavaCollaboration | Mentorship | TrainingEntry-level InternshipAustin; Cupertino1d ago
-
Senior Software Engineer, Robotics Platform USD 143K-230KC# | C++ | CUDA | DDS | ElectronicsHigh ownership team | On-site work schedule | Production systems experience | Robot fleet impact | Startup environmentSenior-level Full TimeSan Francisco1d ago
-
Mechatronic/Robotics Engineer or Systems Integration Engineer - Camera and Sensor Calibration USD 132K-200KARVR | Automation | Bash | C++ | CalibrationCollaborative team environment | Onsite work full timeMid-level Full TimeMountain View, CA1d ago
-
Build Automation | C# | C++ | Code review | Design Patterns401k matching | Adoption reimbursement | Dental insurance | Employee assistance program | Flexible spending accountsMid-level Full TimeAustin, Texas, USA1d ago
-
Computer Scientist V - Senior Software Systems Engineer USD 140K-190KAgile | Artificial Intelligence | C# | C++ | Cloud Platforms401k match | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeEdwards AFB, CA, United States1d ago
-
Senior-level Full TimeOrlando, FL, United States1d ago
-
Senior-level Full TimeAtlanta, Georgia2d ago
-
Agent Development | Agent Orchestration | Air-gapped | Air-gapped systems | Cloud ComputingOn-site work | Travel opportunitySenior-level Full TimeWashington D.C., DC, USA; Fort Meade, …2d ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-23552d ago
-
Senior Machine Learning Engineer, ML Efficiency USD 216K-303KBenchmarking | Cost Optimization | Distributed Training | GPU Training | Knowledge DistillationCaregiving support | Employer 401k match | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R2d ago