Research Engineer / Scientist - Storage for LLM
San Jose, California, United States
USD 156K-387K Entry-level Full Time
Tasks
- Design distributed KV cache system
- Develop cache consistency and synchronization protocols
- Evaluate open source KV stores and extend caching layers
- Implement memory aware sharding and replication
- Integrate cache with batched decoding
- Integrate cache with token streaming pipelines
- Monitor performance and iterate caching algorithms
- Optimize cache latency and eviction
Perks/Benefits
- Competitive compensation
- Conference attendance
- Generous research resources
- Innovation-driven culture
- Open source contributions
Skills/Tech-stack
Attention Mechanisms | CUDA | Caching | Distributed Systems | Eviction policies | GPU Computing | Key-Value Storage | Key-value | Language Models | Large Language Models | Latency optimization | Memory Management | NVIDIA Triton | RDMA | Replication | Sharding | Shared Memory | TTL | Throughput Optimization | Transformer | Windowed LRU
Education
N/A
Roles
Engineer | Research Engineer | Research Scientist | Scientist
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States8h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA8h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas11h ago
-
Staff Data Scientist, ML (People Analytics & Insights) USD 217K-255KA/B | A/B Testing | Access Control | B testing | BigQuery401k matching | Fertility benefits | Life and disability insurance | Lifestyle spending account | Mental health benefitsSenior-level Full TimeChicago, IL; Menlo Park, CA; New …13h ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsCompany-matched 401k | Flexible schedule | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeUnited States R14h ago
-
Artificial Intelligence | C plus plus | CUDA | Camera Calibration | Computer VisionVisa sponsorship not availableMid-level Full TimeKenner, LA, United States16h ago
-
Senior-level Full TimeSouthfield, Michigan, USA, 4807617h ago
-
Agent systems | Alignment Training | C++ | CoT prompting | Computer VisionSenior-level Full TimeSeattle, Washington, United States18h ago
-
C++ | DPO | GNN | Graph Neural Networks | Heterogeneous GraphsEntry-level Full TimeSeattle, Washington, United States18h ago
-
Forward Deployed Engineer IV, Applied AI, Google Cloud USD 207K-301KAPI Integration | Agent systems | Cloud platform | Conversational AI | DebuggingTravel up to 50%Senior-level Full TimeSan Francisco, CA, USA; Austin, TX, …19h ago
-
AI Inference | CUDA | Compilers | Computer Vision | Embedded SoftwareSenior-level Full TimeMountain View, CA, USA19h ago
-
Deep learning | Isaac Sim | Jetson | Language Models | Large Language ModelsSenior-level Full TimeMountain View, CA, USA19h ago
-
Artificial Intelligence | Data Engineering | Data Pipelines | Deployment | Generative AISenior-level Full TimeMountain View, CA, USA19h ago
-
Cause analysis | Data Modeling | Data Visualization | Data pipeline | Language ModelsSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA19h ago
-
Embedded Systems Engineer, Humanoid Robotics USD 144K-300KARM | BSP | Bare Metal | Board Support | Board Support PackageSenior-level Full TimeBoston, MA1d ago
-
Mid-level Full TimeRichardson, TX, United States1d ago
-
AI/ML Software Engineer USD 95K-140KAWS | Agent systems | Agentic Workflows | Autogen | AzureDisability insurance | Life insurance | Paid parental leave | Paid time off | Retirement plan matchSenior-level Full TimeEvendale, United States R1d ago
-
Senior-level Full TimeSan Diego, California, United States of …1d ago
-
Senior Legal AI Engineer USD 100K-185KAI Agents | Citation Evaluation | Data Protection | Enterprise Security | Ethical AIEmployee assistance program | Fitness reimbursement | Flexible work schedule | Headspace app access | Mental health daysSenior-level Full TimeUnited States of America, Eagan, Minnesota R1d ago
-
AI Agents | API Integration | Cloud Native | Cloud services | Cloud-native development401k plan | Adoption reimbursement | Disability benefits | Employee assistance program | Employee discountsSenior-level Full TimeBothell, Washington1d ago
-
APIs | Amazon Web Services | Azure | Cloud Architecture | Cloud Native401k plan | Accidental death insurance | Adoption reimbursement | Critical illness coverage | Disability benefitsSenior-level Full TimeBothell, Washington1d ago
-
Amazon Web Services | Azure | Cloud Native | Cloud Native Architecture | Distributed Systems401k plan | Adoption reimbursement | Disability benefits | Disability insurance | Employee assistance programSenior-level Full TimePlano, Texas1d ago
-
API performance | AWS | Azure | Cloud Native | Distributed Systems401k plan | Adoption reimbursement | Disability benefits | Employee assistance program | Employee discountsSenior-level Full TimeSan Ramon, California1d ago
-
Lead Applied Scientist, Search & Information Retrieval USD 147K-274KAWS SageMaker | AzureML | Distributed Systems | Elasticsearch | Hugging FaceCareer development and growth | Commuter benefits | Employee assistance program | Fitness reimbursement | Flexible work-life balanceSenior-level Full TimeUnited States of America, New York, … R1d ago