Research Engineer / Scientist - Storage for LLM
San Jose, California, United States
USD 156K-387K Entry-level Full Time
Tasks
- Design distributed KV cache system
- Develop cache consistency and synchronization protocols
- Evaluate open source KV stores and extend caching layers
- Implement memory aware sharding and replication
- Integrate cache with batched decoding
- Integrate cache with token streaming pipelines
- Monitor performance and iterate caching algorithms
- Optimize cache latency and eviction
Perks/Benefits
- Competitive compensation
- Conference attendance
- Generous research resources
- Innovation-driven culture
- Open source contributions
Skills/Tech-stack
Attention Mechanisms | CUDA | Caching | Distributed Systems | Eviction policies | GPU Computing | Key-Value Storage | Key-value | Language Models | Large Language Models | Latency optimization | Memory Management | NVIDIA Triton | RDMA | Replication | Sharding | Shared Memory | TTL | Throughput Optimization | Transformer | Windowed LRU
Education
N/A
Roles
Engineer | Research Engineer | Research Scientist | Scientist
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA1h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R6h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States13h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA14h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA15h ago
-
Machine Learning Engineer - LLMs USD 160K-250KActive Learning | DPO | Data Augmentation | Data loaders | Document Classification401k | Equity | Flexible vacation policy | Medical/dental/vision/life insurance | Relocation supportSenior-level Full TimeLos Angeles, CA16h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA16h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas17h ago
-
Sr. AI/ML Engineer II (6707) USD 210K-253KAWS | Anaconda | CI/CD | Containerization | Data analytics401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, vision insurance | Paid time offMid-level Full TimeTysons Corner, VA17h ago
-
Robotic Software Engineer USD 191K-253KAgent systems | Autonomy | Behavior Trees | C++ | Computer VisionHealth benefits | Travel opportunitiesMid-level Full TimeCosta Mesa, California, United States18h ago
-
Senior Software Engineer (Data Engineer) USD 138K-162KAWS | Akka | Algorithms | Apache Spark | Cloud Native401k plan company match | Basic life insurance | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeUnited States R18h ago
-
AWS | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Secrets401k | Healthcare coverage | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R19h ago
-
Autonomy | C plus plus | CPU GPU | CPU/GPU Optimization | Critical softwareHealthcare | Paid Company Holidays | Paid time off | Phone stipend | Wellness benefitsSenior-level Full TimeSan Carlos - Hybrid R19h ago
-
Senior Machine Learning Engineer, Safety USD 216K-303KData Preprocessing | Deep learning | Distributed Training | Embeddings | Hugging FaceSenior-level Full TimeRemote - United States R19h ago
-
Staff Data Scientist, ML (People Analytics & Insights) USD 217K-255KA/B | A/B Testing | Access Control | B testing | BigQuery401k matching | Fertility benefits | Life and disability insurance | Lifestyle spending account | Mental health benefitsSenior-level Full TimeChicago, IL; Menlo Park, CA; New …19h ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsCompany-matched 401k | Flexible schedule | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeUnited States R19h ago
-
Machine Learning Engineer USD 140K-190KApache Flink | Apache Kafka | Apache Spark | Bigtable | CI/CDMid-level Full TimeSan Francisco, California19h ago
-
Principal Data Scientist – Machine Learning & AI USD 150K-200KAPIs | AWS | Artificial Intelligence | Automated retraining | AzureSenior-level Full TimeUK Remote; US Remote R19h ago
-
Algorithms | Concurrent programming | Data Structures | Distributed Systems | ESQL401k match | Flexible schedule | Generous vacation days | Health coverage | Parental leaveSenior-level Full TimeUnited States R19h ago
-
Algorithms | Concurrency | Data Structures | Distributed Systems | Engine technologyCompany-matched 401k | Donation matching | Employee stock program | Flexible schedule | Health coverageSenior-level Full TimeUnited States R20h ago
-
Senior Staff Decision Science (Risk) USD 190K-235KCredit Risk | Dashboarding | Data Visualization | Data pipeline | Experimentation401k match | Company equity | Dental insurance | Free subscription | Medical insuranceSenior-level Full TimeNew York, NY; San Francisco, CA20h ago