Software Engineer - Training/Inference (C++)
Tasks
- Benchmark and accelerate inference engines
- Build high concurrency inference serving systems
- Create CI CD infrastructure for endpoint deployment
- Deploy and update inference engines
- Design distributed model serving systems
- Develop debugging and profiling tools
- Optimize model inference latency and throughput
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Discounts
- Health insurance
- Life insurance
- Vision insurance
Skills/Tech-stack
Auto Scaling | C++ | CI/CD | CUDA | Code generation | Continuous batching | GPU | GPU Kernels | Load Balancing | Low Precision | Low-precision numerics | Quantization | Rust | SGLang | Speculative decoding | TensorRT-LLM | Triton | VLLM
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
A/AI Machine Learning Engineering Sr - E3 USD 110K-204KC++ | Computer Vision | Continuous Deployment | Continuous integration | Data Science401k match | Education assistance | Flexible work arrangements and schedules | Holidays | Medical, dental & vision coverageSenior-level Full TimeMoorestown, NJ, US6h ago
-
Software Engineer, Embedded Systems USD 197K-270KAAC | AC3 | API Design | AV1 | Adaptive streamingCommuter benefits | Disability benefits | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R7h ago
-
Embedded Security Engineer (Starlink) USD 130K-175KC++ | Cryptography | Distributed Systems | Go | Hardware Security ModuleSenior-level Full TimeBastrop, TX7h ago
-
Embedded Security Engineer (Starlink) USD 130K-160KApplied cryptography | C++ | Distributed Systems | Golang | Hardware Security Module401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disabilitySenior-level Full TimeHawthorne, CA7h ago
-
Embedded Security Engineer (Starlink) USD 130K-165KC++ | Cryptography | Distributed Systems | Golang | Hardware Security Module401k retirement plan | Company shuttles | Comprehensive medical/vision/dental | Disability insurance | Employee stock purchase planSenior-level Full TimeRedmond, WA7h ago
-
Senior-level Full TimeDurham, NC9h ago
-
Entry-level Full TimeCape Canaveral, FL11h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Pipelines | Fine TuningDiscretionary paid time off | Emotional and mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R11h ago
-
Senior Staff Data Science Engineer USD 142K-219KApache Spark | Azure ML | Batch inference | CI/CD | Data PipelinesDisability insurance | Employee assistance program | Flexible spending accounts | Health savings accounts | Life insuranceSenior-level Full TimeMilpitas, CA, United States11h ago
-
Software Engineer, Embedded Linux USD 115K-200KC++ | Compilers | Cross-compilation | Data link | Data link layerSenior-level Full TimeSan Diego, California11h ago
-
Machine Learning Engineer - Mid-Level USD 160K-210KC++ | Computer Vision | Deep learning | Geospatial Exploitation | Image classificationAnnual bonus plan | Health benefits | Paid time off | Retirement savings | Wellness programMid-level Full TimeEl Segundo, CA14h ago
-
Senior Staff Software Engineer - AI/ML - Veza USD 171K-300KAPI Integration | Agent Orchestration | Agent systems | Algorithms | C++401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeMinneapolis, Minnesota, United States R14h ago
-
Director of Robot Applications and Behavior USD 210K-271KApplication development | C++ | CI/CD | Cloud Computing | Command and controlMedical/Dental/Vision | Paid parental leave | Unlimited PTOExecutive-level Full TimePhiladelphia, PA15h ago
-
Senior Staff Machine Learning Engineer - Agentic AI USD 201K-352KAPI Development | Agent Orchestration | Agent systems | C++ | Compliance401(k) plan match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, CALIFORNIA, United States R15h ago
-
Mid-level Full TimeSan Francisco15h ago
-
Machine Learning Engineer - Associate USD 120K-170KC++ | Computer Vision | Deep Neural Networks | Deep learning | Geospatial DataHealth benefits | Paid time off | Retirement savings | Wellness programMid-level Full TimeEl Segundo, CA16h ago
-
Senior Engineer I, Product Intelligence USD 138K-206KA/B | A/B Testing | Artificial Intelligence | B testing | C++Senior-level Full TimeUS > Arizona > Phoenix17h ago
-
Embedded Systems & LIDAR Software Engineer USD 87K-108KAutomated testing | C# | C++ | CAN bus | CI/CDCareer development | Dental insurance | Employee assistance program | Fitness reimbursement | Flexible paid time offSenior-level Full TimeKiln, MS17h ago
-
Senior Database Engineer USD 140K-160KAWS | Aurora | CI/CD | Database security | Flyway401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractFoster City, California, USA R18h ago
-
Controls and Robot Learning Engineer GBP 100KC++ | Computed Torque | Control Systems | Direct Kinematics | Embedded SystemsMid-level Full TimeSan Francisco, CA R18h ago
-
Software Engineer 1 - (Python, LLMs, UI/UX) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k matching | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland19h ago
-
AWS | CI/CD | DBT | Data Security Manager | Dataiku DSSSenior-level Full TimeCincinnati, Ohio, United States19h ago
-
Senior Consultant – Semantic Data & AI Engineering USD 146K-183KAPI Development | AWS | Agile | Amazon Neptune | Automated testing401k match | Commuter benefits | Dependent care | FSA | HSASenior-level Full TimeUS - New York R19h ago
-
Principal Consultant – Semantic Data & AI Engineering USD 146K-183KAPI Development | AWS | Agile | Automated testing | Azure401k match | Commuter benefits | Dependent care | FSA | HSASenior-level Full TimeUS - New York R19h ago
-
Software Engineer - Applied AI USD 170K-225KCI/CD | Context engineering | Evaluation | Go | GraphQL401k | Commuter stipend | Educational stipend | Health insurance | NYC Office AccessMid-level Full TimeRemote/Hybrid R19h ago