Research Engineer / Scientist - Storage for LLM
San Jose, California, United States
USD 156K-387K Entry-level Full Time
Tasks
- Design distributed KV cache system
- Develop cache consistency and synchronization protocols
- Evaluate open source KV stores and extend caching layers
- Implement memory aware sharding and replication
- Integrate cache with batched decoding
- Integrate cache with token streaming pipelines
- Monitor performance and iterate caching algorithms
- Optimize cache latency and eviction
Perks/Benefits
- Competitive compensation
- Conference attendance
- Generous research resources
- Innovation-driven culture
- Open source contributions
Skills/Tech-stack
Attention Mechanisms | CUDA | Caching | Distributed Systems | Eviction policies | GPU Computing | Key-Value Storage | Key-value | Language Models | Large Language Models | Latency optimization | Memory Management | NVIDIA Triton | RDMA | Replication | Sharding | Shared Memory | TTL | Throughput Optimization | Transformer | Windowed LRU
Education
N/A
Roles
Engineer | Research Engineer | Research Scientist | Scientist
Related jobs
-
Senior AI Operations Engineer USD 170K-180KAI infrastructure | Azure | CI/CD | Cloud infrastructure | Container Engine for Kubernetes401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountSenior-level Full TimeWork From Home, United States R5h ago
-
Cloud Computing | Compute Optimization | Distributed Cache | Distributed Systems | Document DatabasesEntry-level Full TimeSan Jose, California, United States9h ago
-
Senior Data Scientist - Government & Public Services USD 113K-208KClass imbalance | Cloud Computing | Data Exploration | Data Preparation | Data leakageSenior-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …9h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States9h ago
-
Software Engineer Level 1 -FFNN-8889 USD 78K-250KAccumulo | BSON | Bigtable | Distributed Systems | HBase401k match | Employee referral programs | FSA | Flexible work arrangements | Mental health supportMid-level Full TimeHanover, MD9h ago
-
Software Engineer Level 2 -FFNN-8890 USD 78K-250KAccumulo | BSON | Bigtable | Database Design | Development Lifecycle401k match | Dental insurance | Employee referral programs | Flexible spending accounts | Flexible work arrangementsMid-level Full TimeHanover, MD9h ago
-
Data Pipelines | Data Storage | Distributed Systems | High Performance | High-Performance ComputingCareer growthEntry-level Full TimeSan Jose, California, United States9h ago
-
Apache Flink | Apache Spark | Automation | C++ | Cause analysisSenior-level Full TimeSan Jose, California, United States9h ago
-
Cost estimation | Distributed Caches | Distributed Systems | Document Databases | Embedding IngestionSenior-level Full TimeSeattle, Washington, United States9h ago
-
Agentic data | Apache Hive | Apache Spark | Coding Data | Data CurationSenior-level Full TimeMenlo Park, CA10h ago
-
Visiting Researcher, FAIR (University Grad) USD 145K-204KData Governance | Data Quality | Human-in-the-loop | Language Models | Language ProcessingSenior-level Full TimeMenlo Park, CA10h ago
-
Staff Software Engineer, Agentic AI, Trust and Safety USD 207K-301KAgentic AI | Anti-abuse | Anti-abuse systems | Architecture ownership | Artificial IntelligenceSenior-level Full TimeKirkland, WA, USA10h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KBigtable | C++ | Cloud Databases | Cloud SQL | Cloud platformTravel up to 30%Mid-level Full TimeReston, VA, USA10h ago
-
Customer Engineer, AI/ML, Startups, Google Cloud USD 104K-151KAI Studio | Agent systems | Agentic Workflows | Artificial Intelligence | AutogenMid-level Full TimeAustin, TX, USA10h ago
-
Research Engineer, Benchmarking, Robotics, DeepMind USD 147K-211KBenchmarking | Data Pipelines | Deep learning | Docker | Embedded deploymentMid-level Full TimeMountain View, CA, USA10h ago
-
Senior Staff Software Engineer, Dataproc, Control Plane USD 262K-365KC++ | Cloud APIs | Cloud Computing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA10h ago
-
AI accelerators | C++ | CPU | Diffusion Models | Edge ComputingSenior-level Full TimeMountain View, CA, USA10h ago
-
AI control | Adversarial Testing | Cybersecurity | Detection and Response | Language ModelsMid-level Full TimeSan Francisco, CA, USA10h ago
-
AI Rater | Cohort Analysis | Data Analysis | Exploratory Data Analysis | Language ModelsSenior-level Full TimeMountain View, CA, USA; New York, …10h ago
-
Senior Software Engineer, Spam and Abuse, AI/ML USD 174K-253KAPI Development | Algorithms | Continuous Deployment | Continuous Training | Data ProcessingSenior-level Full TimeSan Jose, CA, USA10h ago
-
Staff Software Engineer, Cloud SQL, MySQL USD 207K-301KArtificial Intelligence | Cloud Platforms | Data Structures | Data Structures and Algorithms | Database DesignEmployee stock purchase | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA10h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Error Analysis | Evaluation401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States17h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Deep learning | Distributed Systems | Experimentation | Feature EngineeringCommuter benefits | Dental insurance | Disability benefits | Equity awards | Health insuranceSenior-level Full TimeBoston, Massachusetts17h ago
-
Software Engineer, Embedded Agentic AI USD 195K-345KAgent Orchestration | Agent systems | C# | C++ | ContainerizationFinancial wellness support | Hybrid work schedule | Mental health support | Paid time off | Remote work optionsEntry-level Full TimeAustin, Texas17h ago