Senior Research Engineer / Scientist - Storage for LLM
Seattle, Washington, United States
R
USD 207K-368K Senior-level Full Time
Tasks
- Build custom GPU aware caching layers
- Design distributed KV cache system
- Evaluate and extend open source KV stores
- Implement cache consistency and synchronization protocols
- Implement memory aware sharding and replication
- Integrate cache with token streaming pipelines
- Monitor system performance and iterate caching algorithms
- Optimize cache latency and eviction policies
Perks/Benefits
Skills/Tech-stack
CUDA | Caching | Data Structures | Distributed Systems | Eviction Policy | GPU Computing | KV cache | Language Models | Large Language Models | Latency optimization | Memory Management | Model Parallelism | Multi-tenant | Multi-tenant systems | RDMA | Replication | Sharding | Shared Memory | Synchronization | Throughput Optimization | Token streaming | Triton
Education
N/A
Roles
Engineer | Research Engineer | Research Scientist | Scientist | Systems Engineer
Related jobs
-
Research Engineer / Scientist - Storage for LLM USD 153K-300KCUDA | Caching | Distributed Systems | Eviction policies | GPU ComputingConference attendance | Innovation-driven culture | Open source contributions | Research resourcesEntry-level Full TimeSeattle, Washington, United States R5h ago
-
Senior Data Scientist, Engine Systems USD 221K-263KA/B | A/B Testing | B testing | Causal Inference | ConcurrencySenior-level Full TimeSan Mateo, CA, United States R10h ago
-
Mid-level Full TimeSan Jose, United States R17h ago
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R20h ago
-
Staff AI Scientist USD 199K-228KCausal Inference | Collaborative Filtering | Constrained decoding | Counterfactual evaluation | EmbeddingsDental insurance | Employee Health Ring | Employee discounts | Flexible wellness time off | Health insuranceSenior-level Full TimeRemote - United States R21h ago
-
Autonomous Systems | Build systems | C++ | Computer Vision | Core dumpsSenior-level Full TimeSunnyvale R21h ago
-
Applied Scientist II USD 167K-220KAgentic AI | Amazon SageMaker | Computer Vision | Data Science | Deep learningHybrid work model | Mentorship programMid-level Full TimeSeattle, Washington, United States R1d ago
-
Software Engineer, Storage USD 80K-105KAnsible | Ceph | Continuous Deployment | Continuous integration | Distributed Systems401k match | Anniversary bonus | Dental insurance premium paid by employer | Gym membership reimbursement | Health Insurance Premium Paid by EmployerMid-level Full TimeRemote - United States R1d ago
-
Senior Storage Engineer USD 130K-150KAutomation | Bash | Cause analysis | Ceph | Cloud infrastructure401k match | Company-paid health insurance | Gym membership reimbursement | Internet reimbursement | Paid sabbaticalSenior-level Full TimeRemote - United States R1d ago
-
Storage Operations Engineer USD 80K-100KAnsible | Automation | Bash | Block Storage | Ceph100 percent company paid insurance premiums | 401k match | Company paid Wellable subscription | Gym membership reimbursement | Internet reimbursementMid-level Full TimeRemote - United States R1d ago
-
Staff/Senior Agentic AI Engineers (Multiple roles) USD 180K-215KAPI Design | AWS | Agent Orchestration | Agentic AI | Cloud infrastructureSenior-level Full TimeSan Francisco, California R1d ago
-
Applied AI Engineer USD 130K-180KAI Safety | AI Security | API Design | AWS | Agent FrameworksCommuter benefits | Company equity | Fitness subsidies | Flexible work schedule | Health, dental, vision insuranceMid-level Full TimeSomerville, MA R1d ago
-
AI Platform Engineer USD 130K-180KAI Safety | AI Security | API Design | API Integration | AWSAD D Insurance | Commuter benefits | Company equity | Dental insurance | Dog-friendly officeMid-level Full TimeSomerville, MA R1d ago
-
GenAI Biosecurity Expert USD 150K-178KBiological Risk | Biological Risk Assessment | Biosafety | Biosecurity | CRISPRSenior-level Full TimeNew York, NY, US R1d ago
-
GenAI Biosecurity Expert USD 150K-178KAdversarial prompting | Biological Risk | Biological Risk Assessment | Biomanufacturing | BioreactorSenior-level Full TimeNew York, NY, US R1d ago
-
Staff Data Engineer, Platform Engineering USD 190K-230KApache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeRemote - United States R1d ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R1d ago
-
Engineer Sr, Embedded Systems Development USD 115K-185KADB | AIDL | AOSP | ARM | Android NDKEmployee discounts | Employee recognition programs | Health insurance | Mental health benefits | Paid time offMid-level Full TimeNiles, IL, United States R1d ago
-
Engineer Sr, Embedded Systems Development USD 115K-185KADB | AIDL | AOSP | ARM | Android HALEmployee discounts | Employee recognition | Employee volunteering opportunities | Healthcare | Hybrid workMid-level Full TimeNiles, IL, United States R1d ago
-
AI Agent | APIs | CRM automation | Cross-Functional Collaboration | Cross-functional401k plan with company matching | Childcare reimbursement | Commuter reimbursement | Medical, dental, and vision insurance | Parental leave policyMid-level Full TimeSan Francisco Office R1d ago
-
API connectors | APIs | CRM automation | Data Structures | GraphQL401k with company matching | Childcare reimbursement | Commuter reimbursement | Medical, dental, and vision insurance | Parental leaveEntry-level Full TimeNew York Office R1d ago
-
AI Storage Solutions Expert USD 224K-356KAIOps | Access Control | Anomaly Detection | Block Device | Block device managementSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R1d ago
-
Senior Machine Learning Engineer, Ads ML Platform USD 216K-303KAnomaly Detection | Data Governance | Data Infrastructure | Data Lineage | Data Storage401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible remote workSenior-level Full TimeRemote - United States R1d ago
-
AI/ML Computer Science Research and Development Engineer USD 121K-231KAdversarial Machine Learning | Benchmarking | Computer Vision | Convolutional Neural Networks | Data PreprocessingSenior-level Full TimePenn State University Park, United States R1d ago
-
Senior Data Scientist USD 140K-200KAWS QuickSight | Agile | CI/CD | Data Mining | Data VisualizationCareer development | Educational opportunities | Remote workSenior-level Full TimeBaltimore, MD, USA R1d ago