Research Engineer / Scientist - Storage for LLM
Seattle, Washington, United States
R
USD 153K-300K Entry-level Full Time
Tasks
- Build custom GPU aware caching layers
- Design distributed KV cache system
- Evaluate caching algorithms
- Extend open source KV stores
- Implement cache consistency protocols
- Implement cache synchronization protocols
- Implement eviction strategies
- Implement memory aware sharding
- Implement replication strategies
- Integrate cache with batched decoding
- Integrate cache with model parallelism
- Integrate cache with token streaming pipelines
- Monitor system performance
- Optimize low-latency access and eviction policies
- Store and retrieve intermediate states for transformer LLMs
Perks/Benefits
Skills/Tech-stack
CUDA | Caching | Distributed Systems | Eviction policies | GPU Computing | KV cache | Key-Value Stores | Key-value | Language Models | Large Language Models | Latency optimization | Memory Management | Model Parallelism | Multi-tenant | Multi-tenant systems | Performance Monitoring | RDMA | Replication | Sharding | TTL | Throughput Optimization | Token streaming | Transformer | Triton | Value Stores | Windowed LRU
Education
N/A
Roles
Data Engineer | Engineer | Research Engineer | Systems Engineer
Related jobs
-
Senior Research Engineer / Scientist - Storage for LLM USD 207K-368KCUDA | Caching | Data Structures | Distributed Systems | Eviction PolicyConference attendance | Open source contributions | Research resourcesSenior-level Full TimeSeattle, Washington, United States R4h ago
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R19h ago
-
Autonomous Systems | Build systems | C++ | Computer Vision | Core dumpsSenior-level Full TimeSunnyvale R21h ago
-
Software Engineer, Storage USD 80K-105KAnsible | Ceph | Continuous Deployment | Continuous integration | Distributed Systems401k match | Anniversary bonus | Dental insurance premium paid by employer | Gym membership reimbursement | Health Insurance Premium Paid by EmployerMid-level Full TimeRemote - United States R23h ago
-
Senior Storage Engineer USD 130K-150KAutomation | Bash | Cause analysis | Ceph | Cloud infrastructure401k match | Company-paid health insurance | Gym membership reimbursement | Internet reimbursement | Paid sabbaticalSenior-level Full TimeRemote - United States R23h ago
-
Storage Operations Engineer USD 80K-100KAnsible | Automation | Bash | Block Storage | Ceph100 percent company paid insurance premiums | 401k match | Company paid Wellable subscription | Gym membership reimbursement | Internet reimbursementMid-level Full TimeRemote - United States R23h ago
-
Staff/Senior Agentic AI Engineers (Multiple roles) USD 180K-215KAPI Design | AWS | Agent Orchestration | Agentic AI | Cloud infrastructureSenior-level Full TimeSan Francisco, California R1d ago
-
Applied AI Engineer USD 130K-180KAI Safety | AI Security | API Design | AWS | Agent FrameworksCommuter benefits | Company equity | Fitness subsidies | Flexible work schedule | Health, dental, vision insuranceMid-level Full TimeSomerville, MA R1d ago
-
AI Platform Engineer USD 130K-180KAI Safety | AI Security | API Design | API Integration | AWSAD D Insurance | Commuter benefits | Company equity | Dental insurance | Dog-friendly officeMid-level Full TimeSomerville, MA R1d ago
-
GenAI Biosecurity Expert USD 150K-178KBiological Risk | Biological Risk Assessment | Biosafety | Biosecurity | CRISPRSenior-level Full TimeNew York, NY, US R1d ago
-
GenAI Biosecurity Expert USD 150K-178KAdversarial prompting | Biological Risk | Biological Risk Assessment | Biomanufacturing | BioreactorSenior-level Full TimeNew York, NY, US R1d ago
-
Staff Data Engineer, Platform Engineering USD 190K-230KApache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeRemote - United States R1d ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R1d ago
-
AI Storage Solutions Expert USD 224K-356KAIOps | Access Control | Anomaly Detection | Block Device | Block device managementSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R1d ago
-
Senior Machine Learning Engineer, Ads ML Platform USD 216K-303KAnomaly Detection | Data Governance | Data Infrastructure | Data Lineage | Data Storage401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible remote workSenior-level Full TimeRemote - United States R1d ago
-
AI/ML Computer Science Research and Development Engineer USD 121K-231KAdversarial Machine Learning | Benchmarking | Computer Vision | Convolutional Neural Networks | Data PreprocessingSenior-level Full TimePenn State University Park, United States R1d ago
-
AI/ML Engineer, Senior USD 99K-225KAPIs | Automation | Cloud Computing | Computer Vision | Data PipelinesDependent care | Health insurance | Paid leave | Professional development | Tuition assistanceSenior-level Full TimeUSA, VA, Alexandria (6361 Walker Ln), … R1d ago
-
AI Developer USD 77K-176KAPI Development | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Health insurance | Paid leave | Professional development | Remote or hybrid work optionsMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAsynchronous Messaging | Audit Logging | Automated testing | CI/CD | ContainerizationDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAsynchronous Messaging | Audit Logging | Automated testing | CI/CD | DevSecOpsDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAgentic Workflows | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
Computer Scientist, Senior USD 99K-225KAgentic AI | Artificial Intelligence | CI/CD | Continuous Auditing | Data EngineeringDependent care | Online courses | Paid leave | Professional development | Tuition assistanceSenior-level Full TimeUSA, CO, Aurora (3855 Lewiston St), … R1d ago
-
Mid-level Full TimeUSA, DC, Washington (901 15th St … R1d ago
-
Agentic AI Machine Learning Engineer USD 99K-225KAWS | Artificial Intelligence | Azure | Deep learning | DockerDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, DC, Washington (901 15th St … R1d ago
-
Agentic AI | Distributed Computing | Ensemble algorithms | GPU Programming | Generative AI401k plan | Commuter benefits | Disability benefits | Health benefits | Hybrid work scheduleSenior-level Full Time141753-NC-Three Wells Fargo Center, Charlotte, United … R1d ago