Software Engineer - Training/Inference (C++)
Tasks
- Benchmark and accelerate inference engines
- Build high concurrency inference serving systems
- Create CI CD infrastructure for endpoint deployment
- Deploy and update inference engines
- Design distributed model serving systems
- Develop debugging and profiling tools
- Optimize model inference latency and throughput
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Discounts
- Health insurance
- Life insurance
- Vision insurance
Skills/Tech-stack
Auto Scaling | C++ | CI/CD | CUDA | Code generation | Continuous batching | GPU | GPU Kernels | Load Balancing | Low Precision | Low-precision numerics | Quantization | Rust | SGLang | Speculative decoding | TensorRT-LLM | Triton | VLLM
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Sr. Embedded Software Specialist USD 96K-190KC# | C++ | Code Composer | Configuration Management | Data StructuresFlexible work environment | Health insurance | Mentoring | Paid vacation | Pension planSenior-level Full TimeTallahassee, FL, US, FL 323104h ago
-
Sr. Embedded Engineer USD 100K-126KC# | C++ | Communication Buses | Configuration Management | DebuggingHealthy work-life balance | Inclusive work environment | Mentoring | Paid vacation | Pension plansSenior-level Full TimeTallahassee, FL, US, FL 323104h ago
-
Robotics Software Engineer, Sensor Integration USD 191K-253KAgent systems | C++ | Computer Vision | Distributed Systems | Embedded SystemsEmployee assistance programs | Health benefits | Recovery Benefits | Travel opportunitiesMid-level Full TimeCosta Mesa, California, United States8h ago
-
Senior Software Engineer - Backend & Machine Learning USD 180K-250KAWS | Amazon Web Services | Argo | Blue-Green Deployment | Blue/greenSenior-level Full TimeNew York, New York, United States10h ago
-
Senior-level Full TimeUS-WA-Bellevue11h ago
-
Senior ML Ops Engineer USD 210K-300KAWS | Airflow | Amazon SageMaker | Aurora | Bedrock401k matching | Catered meals | Dental and vision coverage | Desk setup stipend | Paid health coverageSenior-level Full TimeNYC Office13h ago
-
Entry-level Full TimeHurlburt Field, FL15h ago
-
Research Engineer, Post-Training Inference USD 200K-290K24 7 Availability | CUDA | Fine Tuning | GPU | GoMid-level Full TimeSan Francisco16h ago
-
Machine Learning Engineer, Enterprise Brain USD 200K-300KC++ | Data Quality | Data quality monitoring | Evaluation & benchmarking | Fine Tuning401k contribution | Company events | Education stipend | Health, dental, vision coverage | Healthy lunchesMid-level Full TimeMountain View, CA16h ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CloudWatch401k plan | Healthcare benefits | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R16h ago
-
Autonomy | C++ | DDS | Data Ingestion | Debugging401k | Healthcare coverage | PTO | Paid Holidays | Phone stipendMid-level Full TimeSan Carlos - Hybrid R16h ago
-
Autonomy | C++ | CPU GPU | CPU/GPU Optimization | DDS401k | Healthcare | Hybrid work | Paid Holidays | Paid time offSenior-level Full TimeSan Carlos - Hybrid R16h ago
-
Senior Machine Learning Engineer, Health USD 150K-210KAPIs | AWS | Batch Processing | CI/CD | Data PipelinesSenior-level Full TimeBoston, MA18h ago
-
Software Engineer, Bulk/Interactive Inference USD 170K-216KC++ | Distributed Systems | Inference Optimization | Machine Learning | Machine Learning PipelinesAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid work environmentMid-level Full TimeMountain View, CA, USA18h ago
-
Senior DataOps Engineer USD 130K-258KAgent Jobs | App Service | App Service Environments | App Services | Azure AutomationSenior-level Full TimeRemote R18h ago
-
Embedded Software Engineer– Technical Lead USD 150K-175KARM | ARMv7 | ARMv8 | Agile | Bring-up401k match | Health insurance | Minimal travel | Paid time offSenior-level Full TimeWaltham, MA, United States19h ago
-
Senior-level Full TimePalo Alto, CA19h ago
-
Senior Data Engineer (P1692) USD 98K-169KAKS | Agile | Apache Spark | Azure | Azure Event401 K | Dental insurance | Health insurance | Health savings account | Maternity leaveSenior-level Full TimeCincinnati, OH; Chicago, IL19h ago
-
Senior Machine Learning Engineer USD 190K-250KAWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS LambdaSenior-level Full TimeNYC Headquarters20h ago
-
Machine Learning Engineer - Computational Drug Discovery USD 100K-130KAI Agents | AWS | CI/CD | Cheminformatics | LLMEquity | Flexible work | Health insurance | Paid time off | Professional developmentEntry-level Full TimeWatertown, MA20h ago
-
Deep Learning Engineer USD 160K-175K3D Modeling | Artificial neural networks | C++ | Computer Graphics | Computer Vision401k | Dental insurance | Employee discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States20h ago
-
A/B | A/B Testing | B testing | Continual Learning | Data SetSenior-level Full TimeSeattle, Washington, United States22h ago
-
Senior-level Full TimeBala Cynwyd (Philadelphia Area), PA, United …1d ago
-
Principal Embedded Software Engineer II USD 143K-193KAPI Design | ARM | Board Support | Board Support Package | C#Company stock options | Dental insurance | Disability insurance | FSA | HSASenior-level Full TimeWestminster, CO1d ago
-
Senior Data Engineer USD 115K-150KAWS | AWS Glue | Airflow | Amazon Redshift | Amazon S3401k contribution | Health insurance | Life insuranceSenior-level Full TimeWashington, DC1d ago