Research Engineer, Post-Training Inference
Tasks
- Add features to inference engines for large scale post training experiments
- Build integrations between model shaping and inference platforms
- Design and build systems for customizing open source models
- Ensure service stability and robustness
- Optimize inference engine for reinforcement learning workloads
- Participate in on-call rotation
Perks/Benefits
- N/A
Skills/Tech-stack
24 7 Availability | CUDA | Fine Tuning | GPU | Go | Inference engine | Kernels | Kubernetes | Language Models | Large Language Models | LoRA | Machine Learning | Multi-LoRa | Python | Reinforcement Learning | SGLang | TensorRT-LLM | Triton | VLLM
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R10d ago
-
Senior-level Full TimeCosta Mesa, California, United States10h ago
-
Robotics Software Engineer, Sensor Integration USD 191K-253KAgent systems | C++ | Computer Vision | Distributed Systems | Embedded SystemsEmployee assistance programs | Health benefits | Recovery Benefits | Travel opportunitiesMid-level Full TimeCosta Mesa, California, United States10h ago
-
Software Engineer - Business Analytics USD 100K-125KAPI Integration | Cloud Computing | Data Modeling | Data Visualization | Database401k matching | Equity package | Global Entry | Health and wellness stipend | Health, dental, vision insuranceEntry-level Full TimeSan Diego11h ago
-
Senior Software Engineer - Backend & Machine Learning USD 180K-250KAWS | Amazon Web Services | Argo | Blue-Green Deployment | Blue/greenSenior-level Full TimeNew York, New York, United States11h ago
-
Senior-level Full TimeUS-WA-Bellevue12h ago
-
Senior-level Full TimeMansfield, MA (Remote) R12h ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R13h ago
-
Software Engineer - Training/Inference (C++) USD 180K-440KAuto Scaling | C++ | CI/CD | CUDA | Code generation401k plan | Dental insurance | Disability insurance | Discounts | Health insuranceSenior-level Full TimePalo Alto, CA14h ago
-
Mid-level Full TimeMountain View, California, United States14h ago
-
AWS | Airflow | Apache Flink | Apache Spark | CrawlingCareer growth | Competitive pay | Remote workMid-level Full TimeColumbia - Maryland14h ago
-
Airflow | Amazon Neptune | Apache Cassandra | Apache Flink | Apache SparkRemote work | US time zones supportMid-level Full TimeColumbia - Maryland14h ago
-
Senior ML Ops Engineer USD 210K-300KAWS | Airflow | Amazon SageMaker | Aurora | Bedrock401k matching | Catered meals | Dental and vision coverage | Desk setup stipend | Paid health coverageSenior-level Full TimeNYC Office15h ago
-
AI Integration Engineer USD 125K-188KAWS | AWS Lambda | Algorithms | Amazon S3 | Artificial Intelligence401k matching | Commuter benefits | Dental insurance | Free snacks | Health insuranceMid-level Full TimeWashington D.C.16h ago
-
Staff Software Engineer, Data Platform (FedRamp) USD 194K-267KApache Beam | Apache Flink | Apache Hadoop | Apache Spark | Data Observability401k | Dental insurance | Flexible spending account | Health insurance | Paid leaveSenior-level Full TimeSan Francisco, California16h ago
-
Data Engineer USD 125K-188KAWS | Apache Spark | Data Governance | Data Modeling | Data Validation401k company match | Commuter transportation benefit | Dental insurance | Free snacks | Medical insuranceEntry-level Full TimeWashington D.C.16h ago
-
Entry-level Full TimeHurlburt Field, FL16h ago
-
GTM AI Engineer USD 105K-130KAPI Integrations | Application development | Data Requirements | LLM Application Development | LLM application401k match | Equity | Flexible time off | Hybrid work modelMid-level Full TimeRaleigh, NC R17h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R17h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Signal Processing | C plus plus | C# | Communications Systems | Electronic WarfareSenior-level Full TimeDayton, OH17h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Radar Signal Processing | Adaptive radar | C++ | Communications Systems | Electronic WarfareTop Secret Security ClearanceSenior-level Full TimeAtlanta, GA17h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Signal Processing | C++ | Communications Systems | Electronic Warfare | Embedded SystemsFlexible location | Relocation assistance | Top-Secret Clearance supportSenior-level Full TimeWoburn, MA17h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Signal Processing | C plus plus | C# | Communications Systems | Electronic WarfareHealth insurance | Paid time off | Relocation assistance | Top Secret Clearance FundingSenior-level Full TimeArlington, VA17h ago
-
Principal AI Engineer, Special Programs USD 220K-350KAPI Development | API Orchestration | AWS | Agentic Systems | Azure401k retirement plan | Disability insurance | Employee stock purchase plan | Life insurance | Medical, dental & vision coverageSenior-level Full TimeWashington, DC17h ago
-
Principal AI Engineer, Special Programs USD 220K-350KAI Governance | AI Safety | API Development | API Orchestration | AWS401k | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimePalo Alto, CA17h ago