Large Language Model Inference System Engineer Graduate (Applied Machine Learning) - 2027 Start
San Jose, California, United States
USD 128K-256K Entry-level Full Time
Tasks
- Build disaggregated multi role inference systems
- Design heterogeneous inference pipelines
- Develop machine learning inference systems
- Enable elastic computing for inference
- Implement distributed KV cache systems
- Improve inference stability
- Optimize large model inference performance
- Reduce large model inference cost
- Support multi tenant co located inference
Perks/Benefits
- N/A
Skills/Tech-stack
Cost Optimization | Distributed Systems | Elastic computing | Heterogeneous computing | KV cache | Language Models | Large Language Models | Machine Learning | Model Inference | Multi-tenancy | Performance optimization
Regions
Countries
States
Cities
Related jobs
-
Lead Principal AI Software Engineer USD 169K-355KAccess Control | AgentOps | Audit Logging | Autogen | Batching401k matching | Disability insurance | Employee stock purchase plan | Flexible spending accounts | Life insuranceSenior-level Full TimeNashville, TN, United States4h ago
-
Large Language Model Training System Engineer Graduate (Applied Machine Learning) - 2027 Start USD 128K-256KData Engineering | Distributed Training | Fine Tuning | Language Models | Large Language ModelsEntry-level Full TimeSan Jose, California, United States4h ago
-
Machine Learning System Scheduling Engineer Graduate (Applied Machine Learning) - 2027 Start USD 128K-256KCPU Computing | Cloud Storage | GPU Computing | Machine Learning | Multi-tenancyEntry-level Full TimeSan Jose, California, United States4h ago
-
Circuit breaking | Deep learning | Distributed Systems | Language Models | Language ProcessingEntry-level Full TimeSan Jose, California, United States4h ago
-
AIOps | APIs | Anomaly Detection | Automation | Cause analysisEntry-level Full TimeSan Jose, California, United States4h ago
-
Automated testing | Benchmarking | Data Pipelines | Human Feedback | LLM InferenceEntry-level Full TimeSan Jose, California, United States4h ago
-
Recommendation Architecture AI/ML Infrastructure Engineer Graduate (Data-Arch-TikTok Live) - 2027 Start USD 116K-177KAlgorithms | C++ | CUDA | Computer Systems | Continuous batchingEntry-level Full TimeSan Jose, California, United States5h ago
-
Software Engineer, Databases (Technical Leadership) USD 161K-261KAI Automation | Automated Performance Tuning | Consensus Protocols | Data Integrity | Database InternalsSenior-level Full TimeBellevue, WA | Menlo Park, CA6h ago
-
Machine Learning SoC Architect USD 173K-249KAI accelerators | ASIC Performance Modeling | C# | C++ | Computer ArchitectureSenior-level Full TimeSunnyvale, CA | Austin, TX | …6h ago
-
Staff Software Engineering, GenAI Applications, YouTube USD 207K-300KDeep learning | Dense retrieval | Embedding | Hybrid retrieval | Language ModelsSenior-level Full TimeSan Bruno, CA, USA6h ago
-
Senior Software Engineer, AI/ML GenAI, Search USD 174K-252KC++ | Data Processing | Debugging | Distributed Systems | Information RetrievalSenior-level Full TimeMountain View, CA, USA6h ago
-
Research Engineer, Gemini Retrieval, DeepMind USD 174K-252KC plus plus | Information Retrieval | JAX | Language Models | Language ProcessingMid-level Full TimeMountain View, CA, USA; San Francisco, …6h ago
-
Staff Machine Learning Engineer, Tools and Framework AI USD 175K-300KApplied Machine Learning | C++ | Java | Machine Learning | Machine Learning InfrastructureSenior-level Full TimeCupertino14h ago
-
Xcode Intelligence Foundation Engineer USD 143K-264KAPI Design | Apple SDK | Compiler design | Generative AI | Information RetrievalCross-functional collaboration | Professional growthMid-level Full TimeCupertino14h ago
-
Machine Learning Engineer USD 90K-210KAWS | Airflow | Azure | Computer Vision | Docker401k match | Dental insurance | Health insurance | Life insurance | Open leave policySenior-level Full TimeCambridge, MA, Arlington, VA, Seattle, WA14h ago
-
Bayesian Data Scientist USD 90K-210KAlgorithm Development | Bayesian statistics | Big Data | C# | C++10 paid holidays | 401k match | Dental insurance | Health insurance | Life insuranceMid-level Full TimeCambridge, MA, Arlington, VA14h ago
-
Applied AI and ML Lead - Generative AI USD 177K-215KAPI | Bias Testing | Continuous integration | Data Contracts | Data PipelinesBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimeJersey City, NJ, United States15h ago
-
Senior Machine Learning & Autonomy Engineering USD 123K-188KAdaptive filtering | Data Pipelines | Digital Signal | Digital Signal Processing | MATLAB401k with company matching | 9/80 work schedule | Dental insurance | Medical insurance | Paid holiday shutdownSenior-level Full Time7535 Metropolitan Drive, San Diego , …17h ago
-
Sr. Software Engineer - Azure Storage USD 119K-234KAutomation | Azure | Azure Storage | C# | Code RefactoringRemote work flexibilitySenior-level Full TimeUnited States R17h ago
-
AI Agents | Agent Orchestration | Code Execution | Enterprise systems | GolangFlexible work environment | Remote flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States R17h ago
-
Staff Machine Learning Engineer, Agentic App Platform USD 166K-291KAPI Design | Cloud Computing | Concurrency | Debugging | Distributed Systems401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States R18h ago
-
Display Algorithm Engineer / Machine Learning Engineer USD 166K-296KColor imaging | Image Processing | Machine Learning | PyTorch | PythonSenior-level Full TimeSan Francisco Bay Area18h ago
-
Display Algorithm Engineer / Machine Learning Engineer USD 166K-296KColor imaging | Image Processing | Machine Learning | PyTorch | PythonSenior-level Full TimeSan Francisco Bay Area18h ago
-
Senior AI Engineer (NYC) USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Fine TuningHealth and wellness programs | Hybrid work flexibility | Mentorship | Paid time offSenior-level Full TimeNew York, NY, United States R18h ago
-
Software Engineer, Data Platform Team USD 152K-179KAI | Apache Airflow | BI | Data Quality | DatabricksMid-level Full TimeRemote - USA R18h ago