Member of Technical Staff - Inference Research
Tasks
- Build autoscaling for serverless traffic
- Collaborate with research labs
- Deploy and tune models with customers
- Design disaggregated prefill decode
- Develop speculative decoding
- Implement quantization strategies
- Improve observability for latency and quality
- Manage KV cache and memory
- Own end to end inference research bets
- Train and evaluate custom speculators
- Turn serving research into product primitives
Perks/Benefits
Skills/Tech-stack
Autoscaling | Disaggregated Prefill | FP8 | INT4) | KV cache | Kernels | LLM Inference | Language Models | Large Language Models | Memory Management | Model Deployment | Model Serving | Observability | Quantization | Speculative decoding | Tail Latency
Education
N/A
Regions
Countries
States
Related jobs
-
Data Scientist Associate USD 77K-80KAPIs | Access Control | Artificial Intelligence | Audit Logging | BenchmarkingOnsite work locationMid-level Full TimeUniversity1d ago
-
Staff Software Engineer, AI Engines 3P TPU Inference USD 207K-300KData Processing | Debugging | Distributed Computing | Fine Tuning | GPUSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer, AI/ML, Google Search Ads USD 147K-210KAlgorithms | C++ | Code review | Data Processing | Data StorageMid-level Full TimeMountain View, CA, USA1d ago
-
Senior Staff Software Engineer, AI/ML, Google Ads USD 262K-364KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1d ago
-
Applied Machine Learning | C++ | Concurrency | Distributed Systems | GoSenior-level Full TimeSan Jose, CA, USA1d ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KComputer Vision | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSunnyvale, CA, USA1d ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | Data durabilitySenior-level Full TimeKirkland, WA, USA1d ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-252KAgent tooling | Application Performance Tuning | Application performance | C++ | CI/CDSenior-level Full TimeMountain View, CA, USA; New York, …1d ago
-
AI Deployment Lead – Devin AI | Onsite USD 44K-154KAPI Design | Access Management | Agent Orchestration | Agentic Systems | CI/CD401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States1d ago
-
AI Engineer II USD 60K-90KAPI Development | Backend Development | Cloud Computing | Databricks | DockerOnsite workMid-level Full TimeLocation Irving, Texas1d ago
-
Staff Frontier Agents Engineer (Applied AI) USD 252K-315KA/B | A/B Testing | AWS | Ablation Studies | AzureCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Senior Frontier Agents Engineer (Applied AI) USD 216K-270KA/B Testing | AWS | Ablation Studies | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Frontier Agents Engineer (Applied AI) USD 180K-225KA/B | A/B Testing | AWS | Ablation Studies | Agent FrameworksCommuter stipend | Dental insurance | Health insurance | Learning and development stipend | Paid time offMid-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Software Engineer, API Multimodal USD 293K-385KConcurrency | Distributed Systems | Go | Latency | ObservabilitySenior-level Full TimeSan Francisco1d ago
-
Senior AI Engineer - Services Special Projects USD 150K-260KAdversarial evaluation | Airflow | CI/CD | Cloud Platforms | Content ModerationSenior-level Full TimeSan Francisco Bay Area1d ago
-
API Design | AWS | AWS CloudWatch | AWS Lambda | AWS Step FunctionsBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimePlano, TX, United States1d ago
-
AI Programmer Analyst - Need 11+ Exp USD 120K-154KAI Agents | AIOps | Anomaly Detection | Automated Incident Remediation | Azure AIMid-level Contract Full TimeDallas, TX, United States1d ago
-
AI Engineer USD 180K-200KAgent Orchestration | Data Pipelines | Distributed Systems | LLM | Machine Learning401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …1d ago
-
Principal AI Engineer USD 185K-265KAPI Integration | Agent systems | Artificial Intelligence | Cloud Native | Cloud-native ArchitecturesEducation reimbursement | Health plans | Paid time off | Parental leave | Remote workSenior-level Full TimeRemote - USA R1d ago
-
Data Engineer USD 160K-200KAWS | Apache Spark | Azure | CI/CD | DBT401k match | Continuing education support | Employee assistance program | Flexible spending accounts | Generous paid time offSenior-level Full TimeAuburn Hills, MI, US R1d ago
-
API Design | AWS | Access Control | Amazon S3 | Apache AirflowEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNashville, TN1d ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer USD 102K-209KAnalytics Cloud | Analytics Platforms | Apache Airflow | Apache Kafka | Apache Spark401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeNashville, TN, United States1d ago
-
3D Perception | Auto-labeling | C++ | Data pipeline | Deep learningSenior-level Full TimeMountain View, CA, USA1d ago
-
Senior-level Full TimeWashington, DC1d ago