Member of Technical Staff - Inference Research
Tasks
- Build autoscaling for serverless traffic
- Collaborate with research labs
- Deploy and tune models with customers
- Design disaggregated prefill decode
- Develop speculative decoding
- Implement quantization strategies
- Improve observability for latency and quality
- Manage KV cache and memory
- Own end to end inference research bets
- Train and evaluate custom speculators
- Turn serving research into product primitives
Perks/Benefits
Skills/Tech-stack
Autoscaling | Disaggregated Prefill | FP8 | INT4) | KV cache | Kernels | LLM Inference | Language Models | Large Language Models | Memory Management | Model Deployment | Model Serving | Observability | Quantization | Speculative decoding | Tail Latency
Education
N/A
Regions
Countries
States
Related jobs
-
AI Software Engineer USD 91K-169KAgile | Bash | C++ | Cloud Computing | Containers401k match | Dental insurance | Education assistance | Employee assistance program | Flexible schedulesMid-level Full TimeManassas, VA, US11h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R14h ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R17h ago
-
Agent architecture | Benchmarking | Biomedicine | Context engineering | Data integrationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R17h ago
-
AWS | Bitbucket | Confluence | Data Analysis | Eclipse401k employer contribution | Direct contribution to 401k vesting | Educational assistance | Federal Holidays | Healthcare benefitsSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …1d ago
-
Software Engineer 1 - (Python, UI/UX, LLM) USD 169K-207KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Healthcare coverage | PTOMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 241K-295KAI Agents | APIs | Backend Development | Data Pipelines | Docker401k matching | Education assistance | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland1d ago
-
Cloud Software Engineer 3 - (Cloud, Hadoop, Java) USD 228K-278KAnsible | Apache Kafka | Apache Lucene | Apache Solr | Avro401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeFort Meade, Maryland R1d ago
-
Software Engineer III, AI/ML, Platforms and Devices USD 147K-210KAndroid | C++ | Data Processing | Debugging | Language ProcessingSenior-level Full TimeSeattle, WA, USA1d ago
-
AI Strategy Lead USD 192K-278KAgentic AI | Artificial Intelligence | As-a-Service | Business Intelligence | Data AnalysisSenior-level Full TimeChicago, IL, USA; Sunnyvale, CA, USA1d ago
-
Agents | Artificial Intelligence | Automated Evaluation | C++ | Code reviewSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Staff ML Engineer, Search Ads Shopping Relevance Models USD 207K-300KC++ | CI/CD | Data Analysis | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA1d ago
-
Senior-level Full TimePasadena, CA, United States1d ago
-
Senior-level Full TimePasadena, CA, United States1d ago
-
Sr. Staff AI Engineer, Enterprise Applied AI USD 265K-331KArtificial Intelligence | Compliance | Cost Optimization | Embeddings | Generative AI401k plan | Comprehensive insurance benefits | Employee stock purchase program | Paid sick leave | Paid vacationSenior-level Full Time607 Hansen (Palo Alto California)1d ago
-
Sr. AI Engineer, Enterprise Applied AI USD 162K-203KAPIs | Agent Design | Algorithms | CI/CD | Cloud Computing401k plan | Annual performance bonus | Employee stock purchase program | Insurance benefits | Paid sick leaveSenior-level Full Time667 Auburn Ave NE (Atlanta Georgia)1d ago
-
AI Software Engineer USD 160K-250KAWS | Agent Orchestration | Async Python | CI/CD | Context ManagementEquity awards | Health insurance | Performance based cash bonus | Remote work opportunityMid-level Full TimeNew York, New York, United States R1d ago
-
Mid-level Full TimeUSA VA Home Office (VAHOME), United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer, Senior USD 77K-176KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive … R1d ago
-
Sr AI/ML Engineer - Remote USD 120K-214KAgent Orchestration | Agent communication | Agent to Agent | Agent-to-Agent Communication | CI/CDRemote work flexibilitySenior-level Full TimePrimary location: Minnetonka, Minnesota1d ago
-
AI/ML Engineer USD 98K-176KDatabricks | Deep learning | Docker | Embeddings | GitHub Copilot401k contribution | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programs | Telecommute within USMid-level Full TimePrimary location: Minnetonka, Minnesota1d ago
-
Sr. AI Engineer - Remote or Hybrid in Eden Prairie, MN USD 120K-214KAPI Development | AWS | Agent systems | Agentic AI | Azure401k contribution | Comprehensive benefits package | Equity stock purchase | Hybrid work option | Incentive and recognition programsSenior-level Full TimePrimary location: Minnetonka, Minnesota1d ago
-
Artificial Intelligence | Automation | Continuous Improvement | Data Preparation | Data ScienceMentorship | Networking | Relocation assistance | Tuition reimbursementMid-level Full TimeMedina Headquarters, United States1d ago
-
Senior AI/ML Engineer - TS/SCI w/ Poly USD 112K-196KAgent Orchestration | Agno | Cost Optimization | Langgraph | Language ModelsSenior-level Full TimeUSA MD Columbia (Field), United States1d ago