Software Engineer - Training/Inference (C++)
Tasks
- Benchmark and accelerate inference engines
- Build high concurrency inference serving systems
- Create CI CD infrastructure for endpoint deployment
- Deploy and update inference engines
- Design distributed model serving systems
- Develop debugging and profiling tools
- Optimize model inference latency and throughput
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Discounts
- Health insurance
- Life insurance
- Vision insurance
Skills/Tech-stack
Auto Scaling | C++ | CI/CD | CUDA | Code generation | Continuous batching | GPU | GPU Kernels | Load Balancing | Low Precision | Low-precision numerics | Quantization | Rust | SGLang | Speculative decoding | TensorRT-LLM | Triton | VLLM
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Sr. Embedded Software Specialist USD 96K-190KC# | C++ | Code Composer | Configuration Management | Data StructuresFlexible work environment | Health insurance | Mentoring | Paid vacation | Pension planSenior-level Full TimeTallahassee, FL, US, FL 323105h ago
-
Sr. Embedded Engineer USD 100K-126KC# | C++ | Communication Buses | Configuration Management | DebuggingHealthy work-life balance | Inclusive work environment | Mentoring | Paid vacation | Pension plansSenior-level Full TimeTallahassee, FL, US, FL 323105h ago
-
Robotics Software Engineer, Sensor Integration USD 191K-253KAgent systems | C++ | Computer Vision | Distributed Systems | Embedded SystemsEmployee assistance programs | Health benefits | Recovery Benefits | Travel opportunitiesMid-level Full TimeCosta Mesa, California, United States9h ago
-
Senior Software Engineer - Backend & Machine Learning USD 180K-250KAWS | Amazon Web Services | Argo | Blue-Green Deployment | Blue/greenSenior-level Full TimeNew York, New York, United States11h ago
-
Senior-level Full TimeUS-WA-Bellevue12h ago
-
Senior ML Ops Engineer USD 210K-300KAWS | Airflow | Amazon SageMaker | Aurora | Bedrock401k matching | Catered meals | Dental and vision coverage | Desk setup stipend | Paid health coverageSenior-level Full TimeNYC Office14h ago
-
Entry-level Full TimeHurlburt Field, FL16h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Radar Signal Processing | Adaptive radar | C++ | Communications Systems | Electronic WarfareTop Secret Security ClearanceSenior-level Full TimeAtlanta, GA16h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Signal Processing | C++ | Communications Systems | Electronic Warfare | Embedded SystemsFlexible location | Relocation assistance | Top-Secret Clearance supportSenior-level Full TimeWoburn, MA16h ago
-
Research Engineer, Post-Training Inference USD 200K-290K24 7 Availability | CUDA | Fine Tuning | GPU | GoMid-level Full TimeSan Francisco17h ago
-
Machine Learning Engineer, Enterprise Brain USD 200K-300KC++ | Data Quality | Data quality monitoring | Evaluation & benchmarking | Fine Tuning401k contribution | Company events | Education stipend | Health, dental, vision coverage | Healthy lunchesMid-level Full TimeMountain View, CA17h ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CloudWatch401k plan | Healthcare benefits | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R17h ago
-
Autonomy | C++ | DDS | Data Ingestion | Debugging401k | Healthcare coverage | PTO | Paid Holidays | Phone stipendMid-level Full TimeSan Carlos - Hybrid R17h ago
-
Autonomy | C++ | CPU GPU | CPU/GPU Optimization | DDS401k | Healthcare | Hybrid work | Paid Holidays | Paid time offSenior-level Full TimeSan Carlos - Hybrid R17h ago
-
Senior Machine Learning Engineer, Health USD 150K-210KAPIs | AWS | Batch Processing | CI/CD | Data PipelinesSenior-level Full TimeBoston, MA19h ago
-
Software Engineer, Bulk/Interactive Inference USD 170K-216KC++ | Distributed Systems | Inference Optimization | Machine Learning | Machine Learning PipelinesAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid work environmentMid-level Full TimeMountain View, CA, USA19h ago
-
Senior DataOps Engineer USD 130K-258KAgent Jobs | App Service | App Service Environments | App Services | Azure AutomationSenior-level Full TimeRemote R19h ago
-
Embedded Software Engineer– Technical Lead USD 150K-175KARM | ARMv7 | ARMv8 | Agile | Bring-up401k match | Health insurance | Minimal travel | Paid time offSenior-level Full TimeWaltham, MA, United States20h ago
-
Senior-level Full TimePalo Alto, CA20h ago
-
Senior Data Engineer (P1692) USD 98K-169KAKS | Agile | Apache Spark | Azure | Azure Event401 K | Dental insurance | Health insurance | Health savings account | Maternity leaveSenior-level Full TimeCincinnati, OH; Chicago, IL20h ago
-
Senior Machine Learning Engineer USD 190K-250KAWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS LambdaSenior-level Full TimeNYC Headquarters21h ago
-
Machine Learning Engineer - Computational Drug Discovery USD 100K-130KAI Agents | AWS | CI/CD | Cheminformatics | LLMEquity | Flexible work | Health insurance | Paid time off | Professional developmentEntry-level Full TimeWatertown, MA21h ago
-
Deep Learning Engineer USD 160K-175K3D Modeling | Artificial neural networks | C++ | Computer Graphics | Computer Vision401k | Dental insurance | Employee discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States21h ago
-
A/B | A/B Testing | B testing | Continual Learning | Data SetSenior-level Full TimeSeattle, Washington, United States23h ago
-
Senior-level Full TimeBala Cynwyd (Philadelphia Area), PA, United …1d ago