Machine Learning Engineer - Inference
San Jose, California, United States
USD 162K-387K Mid-level Full Time
Tasks
- Analyze bottlenecks and instability and implement solutions
- Build monitoring tools for online inference servers
- Collaborate with product teams to meet model requirements
- Design distributed inference infrastructure for ranking models
- Triaging system inefficiency and bottlenecks
Perks/Benefits
- 401k savings plan match
- Life insurance
- Medical, dental, and vision insurance
- Paid Holidays
- Paid parental leave
- Paid personal time
- Paid sick days
- Short-term and long-term disability coverage
- Wellbeing benefits
Skills/Tech-stack
Distributed Systems | GPU Acceleration | High Performance | High-Performance Computing | JAX | MXNet | Monitoring | Online Inference | Performance Computing | PyTorch | RDMA | TensorFlow | TensorRT | TorchScript
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Research Engineer / Scientist -AI for Databases USD 207K-368KAWS | Architecture Search | Artificial Intelligence | Automated Model Tuning | C++401k match | Dental insurance | Disability coverage | Health insurance | Life insuranceSenior-level Full TimeSeattle, Washington, United States R6h ago
-
Machine Learning System Scheduling Engineer Graduate (Applied Machine Learning) - 2027 Start USD 128K-256KAlgorithms | CUDA | Cloud Storage | Computer Science | ContainerizationEntry-level Full TimeSan Jose, California, United States6h ago
-
AI/LLM Network Software Development Engineer Graduate (High Speed Network) - 2027 Start (PhD) USD 162K-316KAI network | AI network optimization | C# | C++ | Computer Networking401k with company match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States6h ago
-
Student Researcher (AI Foundation Models Infrastructure - Seed Infra) - 2026 Start (PhD) USD 162K-162KC++ | CUDA | Compiler optimization | Distributed Computing | Machine LearningHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level Full TimeSeattle, Washington, United States6h ago
-
ARM Cortex | ARM Cortex M4 | AV1 | AVC | C++401-k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Diego, California, United States6h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KAI Agents | Batch Processing | Cloud infrastructure | Columnar Storage | Data Governance401k savings plan | Disability coverage | Health insurance | Life insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States6h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Intern (AML-Ark-US) - 2027 Summer USD 86K-86KAlgorithms | Big Data | Cloud infrastructure | Columnar Storage | Data GovernanceHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level InternshipSeattle, Washington, United States6h ago
-
Research Engineer, Data Lake Infrastructure & Data Analytics Graduate (AML-Ark-US) - 2027 Start (PhD) USD 153K-300KBatch Processing | Columnar Storage | Data Governance | Data Lake | Data ProcessingEntry-level Full TimeSeattle, Washington, United States6h ago
-
AUC Optimization | Apache Flink | Apache Hadoop | Apache Spark | Big Data401k savings plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States6h ago
-
Algorithms | CUDA | Computer Architecture | Data Structures | Deep Learning Training401k match | Life insurance | Long-term disability | Medical/Dental/Vision insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States6h ago
-
Machine Learning Engineer USD 170K-250KAzure ML | Azure ML Endpoints | Azure Machine Learning | Bayesian Methods | Boosted TreesSenior-level Full TimeAustin, Texas | Fremont, California | …6h ago
-
AWS | Azure | Azure ML | C++ | CUDAEntry-level Full TimeSeattle, Washington, United States6h ago
-
Research Engineer / Scientist -AI for Databases USD 153K-300KArchitecture Search | Artificial Intelligence | Automated Database Tuning | C++ | Database Internals401k match | Life insurance | Long-Term Disability coverage | Medical/Dental/Vision insurance | Paid HolidaysMid-level Full TimeSeattle, Washington, United States R6h ago
-
Machine Learning Engineer, AI Coding Tools USD 162K-387KC++ | CUDA | CUDA Deployment Optimization | Deep learning | Deployment optimization401k savings plan | Dental insurance | Life insurance | Medical insurance | Paid HolidaysMid-level Full TimeSan Jose, California, United States6h ago
-
Software Development Engineer - Cloud Native Databases USD 153K-300KC++ | Database monitoring | Database replication | Distributed Systems | Distributed TransactionsMid-level Full TimeSan Jose, California, United States6h ago
-
Research Scientist - Driven Agent Self-Evolution - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 202K-368KDeep learning | JAX | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSan Jose, California, United States6h ago
-
C++ | Computer Vision | Deep learning | End to End | End to End Machine Learning Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSan Jose, California, United States6h ago
-
Production Engineer - Applied Machine Learning USD 162K-387KAlerting | Auto Scaling | Auto rollback | C++ | CI/CD401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSan Jose, California, United States7h ago
-
Alignment for Large Language Models | C++ | Deep learning | Fine Tuning | GoHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level InternshipSan Jose, California, United States7h ago
-
C++ | Container Runtime | Distributed Systems | Distributed tracing | DockerSenior-level Full TimeSeattle, Washington, United States7h ago
-
C++ | Cloud infrastructure | Distributed Systems | Docker | GoSenior-level Full TimeSeattle, Washington, United States7h ago
-
Machine Learning Engineer - AI Compiler Optimization USD 184K-287KCo-design | Code generation | GPU compilation | Hardware-Software Co-design | Hardware/softwareSenior-level Full TimeSan Jose, California, United States7h ago
-
Machine Learning Engineer - Orchestration USD 162K-250KApache Flink | Apache Mesos | Auto Scaling | Celery | Deep learningMid-level Full TimeSan Jose, California, United States7h ago
-
Software Engineer- Metadata Storage USD 162K-387KC# | C++ | DPDK | Etcd | Go401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSan Jose, California, United States7h ago
-
Tech Lead - Data Infrastructure Site Reliability USD 254K-480KAutomation | Batch Processing | Big Data | Cause analysis | Cloud infrastructure401k match | Life insurance | Life insurance coverage | Medical, dental, and vision insurance | Paid HolidaysSenior-level Full TimeSan Jose, California, United States7h ago