Research Engineer / Scientist - Storage for LLM
Seattle, Washington, United States
R
USD 153K-300K Mid-level Full Time
Tasks
- Build custom GPU aware caching layers
- Collaborate with inference and serving teams
- Design and implement distributed KV cache system
- Develop cache consistency and synchronization protocols
- Evaluate and extend open source KV stores
- Implement memory aware sharding eviction and replication
- Integrate cache with token streaming pipelines
- Monitor system performance and iterate on caching algorithms
- Optimize low-latency access and eviction policies
Perks/Benefits
- 401k matching
- Life insurance
- Long-term disability
- Medical, dental, and vision insurance
- Paid Holidays
- Paid parental leave
- Paid personal time
- Paid sick days
- Short-term disability
- Wellbeing benefits
Skills/Tech-stack
Batching | C++ | CUDA | CUDA Networking | CUDA aware Networking | CUDA programming | Cache aware scheduling | Caching | Distributed Systems | Eviction Policy | GDR | GDS | GPU communication | GPU-to-GPU | GPU-to-GPU communication | GRPC | Go | HBM | High Performance | High-Performance Computing | Inference Server | Infiniband | KV cache | Language Models | Large Language Models | Low Latency | Low-Latency Systems | Memory Management | NCCL | NUMA | NVIDIA GPUs | NVLink | Performance Computing | Prefetching | RDMA | RPC | Rust | TensorRT | Transformer | Triton Inference | Triton Inference Server
Education
Roles
Engineer | Research Engineer | Research Scientist | Scientist | Systems Engineer
Related jobs
-
Senior Research Engineer / Scientist - Storage for LLM USD 207K-368KAutoregressive decoding | Batched decoding | C++ | CUDA | CUDA aware Networking401k savings plan with company match | Conference attendance | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeSeattle, Washington, United States R3h ago
-
Research Engineer / Scientist -AI for Databases USD 162K-387KAWS | Architecture Search | Artificial Intelligence | Automated Database Tuning | Azure401k match | Conference attendance | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeSan Jose, California, United States R3h ago
-
C# | C++ | Computer Graphics | Computer Vision | Data PipelinesEquity compensation | Health benefits | Onsite work schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R9h ago
-
Senior Machine Learning Engineer, Content Platform USD 141K-360KApache Spark | Cloud Computing | Generative AI | Language Models | Large Language ModelsDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R12h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-435KDistributed Systems | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts R12h ago
-
AI Agents | AI monitoring | API Integration | Amazon Web Services | Anthropic401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States R13h ago
-
Machine Learning Engineer, Ads USD 165K-230KA/B | A/B Testing | B testing | Bidding | Conversion PredictionDirect impact | Hybrid work model | International team collaboration | Professional growth opportunities | Remote work flexibilityMid-level Full TimeSan Francisco Bay Area, USA R13h ago
-
AWS | Cloud infrastructure | Compute | Data Curation | Distributed Systems401k match | Daily lunches and snacks | Health insurance covered | Hybrid work schedule | Learning and development stipendSenior-level Full TimeRedwood City R18h ago
-
Sr. Software Engineer - Azure Storage USD 119K-234KAutomation | Azure | C# | C++ | Cloud StorageRemote workSenior-level Full TimeUnited States R18h ago
-
Staff Robotics Engineer USD 190K-235KAI Agents | AI Libraries | C++ | Critical Systems | FDIRComprehensive employee benefits | Equity | On call rotation for continuous campaignsSenior-level Full TimeRichmond, CA R18h ago
-
Sr. Staff Machine Learning Systems Engineer USD 240K-265KAdversarial Testing | Calibration | Data Engineering | Data Ingestion | Data Pipelines401k employer matching | Company holidays | Comprehensive health benefits | Employee stock purchase program | Offsite team retreatsSenior-level Full TimeUS Remote R19h ago
-
Staff Backend AI Engineer, Remote USD 164K-219KAWS | AWS Cloud | AWS Cloud Development Kit | AWS Lambda | AWS cloud development401k matching | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R19h ago
-
Junior AI Engineer (Open to remote) USD 110K-135KAPIs | Agent SDK | Agentic coding | Arize | Google ADK401k | Commuter benefits | Dental insurance | Educational assistance | Medical insuranceExecutive-level Full TimeNew York, United States R19h ago
-
Principal Machine Learning Engineer, Geometric Vision USD 407K-460K3D Computer Vision | 3D representations | Auto-labeling | C++ | CalibrationSenior-level Full TimeSunnyvale R20h ago
-
Media Software Engineer, Speech (Senior-Staff Levels) USD 180K-270KAndroid | Asynchronous I/O | Audio streaming | C# | C++401k retirement savings plan | Company holidays | Complimentary lunch and snacks | Fertility support | Lifestyle spending accountSenior-level Full TimeSunnyvale R21h ago
-
Machine Learning Engineer, Detection and Tracking USD 160K-210KByteTrack | DETR | Data Augmentation | DeepSORT | Faster R-CNNFlexible paid time off | Hybrid work | Medical insurance | Paid Holidays | Remote workMid-level Full TimeWashington, DC R21h ago
-
ARINC 429 | ARINC 653 | ARP4754 | Bamboo | Bitbucket401k match | Disability coverage | Educational assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimePhoenix, AZ, United States R21h ago
-
Sr. Machine Learning Engineer - Machine Learning USD 178K-213KAPI Design | CI/CD | CUDA | Custom Kernels | Dependency management401k plan | Annual performance bonus | Commuter support | Company-provided laptop | Flexible paid time offSenior-level Full TimeRemote; Watertown, Massachusetts, United States R23h ago
-
Software Engineer 2 - (Python, LLM, Machine Learning) USD 201K-246KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland R1d ago
-
Senior Machine Learning Scientist USD 159K-255KC# | C++ | Computer Vision | Deep learning | Generative AIDiscretionary paid time off | Emotional and mental wellness support | Fitness programs | Learning and development programs | Medical, dental, vision plansSenior-level Full TimeSeattle, Washington, United States R1d ago
-
Senior Machine Learning Scientist USD 159K-255KC++ | Computer Vision | Deep learning | Image Segmentation | KerasDiscretionary paid time off | Emotional and mental wellness support | Employer-matched 401k | Fitness programs | Hybrid work scheduleSenior-level Full TimeBoston, Massachusetts, United States R1d ago
-
Senior Machine Learning Scientist USD 401KC plus plus | C# | Computer Vision | Deep learning | Experiment design401k match | Dental insurance | Discretionary paid time off | Emotional & mental wellness support | Fitness programsSenior-level Full TimeScottsdale, Arizona, United States R1d ago
-
Android | C# | C++ | Cellular Networks | Edge ComputingDiscretionary time off | Paid Fitness Programs | Paid parental leave | Relocation assistance | SnacksSenior-level Full TimeNew York, New York, United States R1d ago
-
Senior Machine Learning Operations Engineer USD 144K-181KAPI Development | AWS SageMaker | Agentic AI | Classification | Computer VisionCareer Development Programs | Commuting cost coverage | Daily free lunch | Employee equity | Employee resource groupsSenior-level Full TimeBoston, Massachusetts, United States R1d ago
-
Desktop UI Developer (AI Software) USD 120K-185KAnimation | Asynchronous programming | C++ | Component design | GraphicsAccess to cutting-edge AI tools | Flexible working hours | Remote workMid-level Full TimeGeorgia R1d ago