Senior Research Engineer / Scientist - Storage for LLM
Seattle, Washington, United States
R
USD 207K-368K Senior-level Full Time
Tasks
- Design distributed KV cache system
- Develop cache consistency and synchronization protocols
- Evaluate open source KV stores and build GPU aware caching layers
- Implement memory aware sharding eviction and replication
- Integrate cache with token streaming pipelines
- Monitor system performance and iterate caching algorithms
- Optimize caching latency throughput eviction
Perks/Benefits
- 401k savings plan with company match
- Conference attendance
- Life insurance
- Long-term disability
- Medical/Dental/Vision insurance
- Open source contributions
- Paid Holidays
- Paid parental leave
- Paid personal time
- Paid sick days
- Research resources
- Short-term disability
- Wellbeing benefits
Skills/Tech-stack
Autoregressive decoding | Batched decoding | C++ | CUDA | CUDA aware Networking | Cache consistency | Distributed Systems | Eviction policies | GDR | GDS | GRPC | Go | HBM | Inference Server | Infiniband | KV cache | LRU | Language Models | Large Language Models | Low Latency | Low-latency serving | Memory Management | Model Parallelism | NCCL | NUMA | NVIDIA GPUs | NVLink | RDMA | RPC | Replication | Rust | Sharding | Synchronization protocols | TTL | TensorRT | Token streaming | Transformer | Triton Inference | Triton Inference Server
Education
Related jobs
-
Research Engineer / Scientist -AI for Databases USD 162K-387KAWS | Architecture Search | Artificial Intelligence | Automated Database Tuning | Azure401k match | Conference attendance | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeSan Jose, California, United States R4h ago
-
Research Engineer / Scientist - Storage for LLM USD 153K-300KBatching | C++ | CUDA | CUDA Networking | CUDA aware Networking401k matching | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid HolidaysMid-level Full TimeSeattle, Washington, United States R4h ago
-
C# | C++ | Computer Graphics | Computer Vision | Data PipelinesEquity compensation | Health benefits | Onsite work schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R9h ago
-
Senior Machine Learning Engineer, Content Platform USD 141K-360KApache Spark | Cloud Computing | Generative AI | Language Models | Large Language ModelsDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R12h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-435KDistributed Systems | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts R12h ago
-
AI Agents | AI monitoring | API Integration | Amazon Web Services | Anthropic401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States R13h ago
-
Machine Learning Engineer, Ads USD 165K-230KA/B | A/B Testing | B testing | Bidding | Conversion PredictionDirect impact | Hybrid work model | International team collaboration | Professional growth opportunities | Remote work flexibilityMid-level Full TimeSan Francisco Bay Area, USA R13h ago
-
AWS | Cloud infrastructure | Compute | Data Curation | Distributed Systems401k match | Daily lunches and snacks | Health insurance covered | Hybrid work schedule | Learning and development stipendSenior-level Full TimeRedwood City R18h ago
-
Sr. Software Engineer - Azure Storage USD 119K-234KAutomation | Azure | C# | C++ | Cloud StorageRemote workSenior-level Full TimeUnited States R18h ago
-
Staff Robotics Engineer USD 190K-235KAI Agents | AI Libraries | C++ | Critical Systems | FDIRComprehensive employee benefits | Equity | On call rotation for continuous campaignsSenior-level Full TimeRichmond, CA R18h ago
-
Sr. Staff Machine Learning Systems Engineer USD 240K-265KAdversarial Testing | Calibration | Data Engineering | Data Ingestion | Data Pipelines401k employer matching | Company holidays | Comprehensive health benefits | Employee stock purchase program | Offsite team retreatsSenior-level Full TimeUS Remote R19h ago
-
Staff Backend AI Engineer, Remote USD 164K-219KAWS | AWS Cloud | AWS Cloud Development Kit | AWS Lambda | AWS cloud development401k matching | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R19h ago
-
Junior AI Engineer (Open to remote) USD 110K-135KAPIs | Agent SDK | Agentic coding | Arize | Google ADK401k | Commuter benefits | Dental insurance | Educational assistance | Medical insuranceExecutive-level Full TimeNew York, United States R19h ago
-
Principal Machine Learning Engineer, Geometric Vision USD 407K-460K3D Computer Vision | 3D representations | Auto-labeling | C++ | CalibrationSenior-level Full TimeSunnyvale R20h ago
-
Media Software Engineer, Speech (Senior-Staff Levels) USD 180K-270KAndroid | Asynchronous I/O | Audio streaming | C# | C++401k retirement savings plan | Company holidays | Complimentary lunch and snacks | Fertility support | Lifestyle spending accountSenior-level Full TimeSunnyvale R21h ago
-
Machine Learning Engineer, Detection and Tracking USD 160K-210KByteTrack | DETR | Data Augmentation | DeepSORT | Faster R-CNNFlexible paid time off | Hybrid work | Medical insurance | Paid Holidays | Remote workMid-level Full TimeWashington, DC R21h ago
-
ARINC 429 | ARINC 653 | ARP4754 | Bamboo | Bitbucket401k match | Disability coverage | Educational assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimePhoenix, AZ, United States R21h ago
-
Sr. Machine Learning Engineer - Machine Learning USD 178K-213KAPI Design | CI/CD | CUDA | Custom Kernels | Dependency management401k plan | Annual performance bonus | Commuter support | Company-provided laptop | Flexible paid time offSenior-level Full TimeRemote; Watertown, Massachusetts, United States R23h ago
-
Software Engineer 2 - (Python, LLM, Machine Learning) USD 201K-246KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland R1d ago
-
Senior Machine Learning Scientist USD 159K-255KC# | C++ | Computer Vision | Deep learning | Generative AIDiscretionary paid time off | Emotional and mental wellness support | Fitness programs | Learning and development programs | Medical, dental, vision plansSenior-level Full TimeSeattle, Washington, United States R1d ago
-
Senior Machine Learning Scientist USD 159K-255KC++ | Computer Vision | Deep learning | Image Segmentation | KerasDiscretionary paid time off | Emotional and mental wellness support | Employer-matched 401k | Fitness programs | Hybrid work scheduleSenior-level Full TimeBoston, Massachusetts, United States R1d ago
-
Senior Machine Learning Scientist USD 401KC plus plus | C# | Computer Vision | Deep learning | Experiment design401k match | Dental insurance | Discretionary paid time off | Emotional & mental wellness support | Fitness programsSenior-level Full TimeScottsdale, Arizona, United States R1d ago
-
Android | C# | C++ | Cellular Networks | Edge ComputingDiscretionary time off | Paid Fitness Programs | Paid parental leave | Relocation assistance | SnacksSenior-level Full TimeNew York, New York, United States R1d ago
-
Senior Machine Learning Operations Engineer USD 144K-181KAPI Development | AWS SageMaker | Agentic AI | Classification | Computer VisionCareer Development Programs | Commuting cost coverage | Daily free lunch | Employee equity | Employee resource groupsSenior-level Full TimeBoston, Massachusetts, United States R1d ago
-
Desktop UI Developer (AI Software) USD 120K-185KAnimation | Asynchronous programming | C++ | Component design | GraphicsAccess to cutting-edge AI tools | Flexible working hours | Remote workMid-level Full TimeGeorgia R1d ago