Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization
Tasks
- Apply model quantization
- Architect LLM deployment environments
- Build system stability frameworks
- Collaborate with perception prediction teams
- Enable rapid model iteration
- Establish profiling and telemetry frameworks
- Integrate optimization toolchains
- Lead root cause analysis
- Monitor GPU utilization
- Optimize hardware execution
- Optimize inference performance
- Own model deployment
- Scale service deployment pipelines
- Schedule compute resources
Perks/Benefits
- N/A
Skills/Tech-stack
AWQ | C++ | CUDA | FP8 | GPU Architecture | GPU memory | GPU memory bandwidth | Graph compilation | INT8 | Kernel Fusion | LightLLM | Memory bandwidth | ONNX Runtime | OpenMP | PyTorch | Python | SGLang | TGI | TensorRT | TensorRT-LLM | VLLM
Education
Related jobs
-
Bottleneck identification | C# | C++ | Code review | DebuggingSenior-level Full TimeSan Jose, CA, USA3h ago
-
Senior Software Engineer, Embedded Systems/Firmware, XR USD 174K-252KAlgorithms | C# | C++ | Code review | Data StructuresSenior-level Full TimeSan Jose, CA, USA; Kirkland, WA, …3h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R15h ago
-
[8GT] Senior Data Engineer USD 120K-155KAWS | BigQuery | CDK | Domo | DynamoDBAgile environment | Great Place to Work certification | Mentoring opportunitiesSenior-level Full TimeSan José, San José Province, Costa …18h ago
-
Software Engineer, Embedded Agentic AI USD 170K-210KC# | C++ | Cloud Platforms | Containerization | DockerDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offEntry-level Full TimeSan Jose, California R19h ago
-
Mid Machine Learning Engineer USD 145K-190KAWS SageMaker | Airflow | Azure Machine Learning | DBT | GitRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru R1d ago
-
Data Processing | Deep learning | Distributed Computing | Feature Engineering | MLOpsMid-level Full TimeSan Jose, California, United States1d ago
-
A/B | A/B Testing | Apache Flink | Apache Spark | B testingEntry-level Full TimeSan Jose, California, United States1d ago
-
Algorithms | C++ | CUDA | Computer Systems | Continuous batchingCareer developmentEntry-level Full TimeSan Jose, California, United States1d ago
-
Algorithms | C++ | CUDA | Computer Systems | Continuous batchingEntry-level Full TimeSan Jose, California, United States1d ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Foundation)- 2027 Start (PhD) USD 129K-256KDeep learning | Generative Recommendation | Language Models | Large Language Models | Machine LearningEntry-level Full TimeSan Jose, California, United States1d ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Foundation) - 2027 Start USD 118K-187KDeep learning | Generative Recommendation | Information Retrieval | Language Models | Language ProcessingEntry-level Full TimeSan Jose, California, United States1d ago
-
Agentic Systems | Causal Inference | Contrastive Learning | Debiasing | Deep learningOnboarding supportEntry-level Full TimeSan Jose, California, United States1d ago
-
Data Scientist – AI & Predictive Analytics USD 106K-142KData analytics | Hadoop | Hive | Machine Learning | NoSQL401k matching | Employee assistance program | Flexible spending account | Health insurance | Health savings accountEntry-level Full TimeSan Jose, CA, United States1d ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KAutomation | Benchmarking | Data Analysis | Language Models | Language ProcessingCareer development workshops | Hands-on projects | Industry exposure | Social eventsEntry-level InternshipSan Jose, California, United States2d ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KBatch Processing | Data Engineering | Data Governance | Data Lake | Data QualityEntry-level Full TimeSan Jose, California, United States2d ago
-
Research Intern (AI/LLM Network) - 2026 Start (PhD) USD 136K-300KDistributed Systems | Linux | Machine Learning | Network Protocols | NetworkingEntry-level InternshipSan Jose, California, United States2d ago
-
LLM AIOps Development Engineer - Data Center Networking USD 157K-256KBGP | CI/CD | ClickHouse | Deep learning | DockerMid-level Full TimeSan Jose, California, United States2d ago
-
Senior Data Application Engineer, Core USD 163K-236KCloud Data | Cloud data lakehouse | Data Contracts | Data Governance | Data LakehouseSenior-level Full TimeSan Jose, CA, USA2d ago
-
Staff Software Engineer, AI/ML Storage Infrastructure USD 207K-300KC++ | Compute Technologies | Data Structures | Data structures algorithms | Distributed SystemsEquity compensation | Health insurance | Paid time off | Professional development | Retirement planSenior-level Full TimeSan Jose, CA, USA2d ago
-
Staff Software Engineer AI/ML USD 163K-253KA/B | A/B Testing | Autogen | B testing | Batched Inference401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environmentSenior-level Full TimeSan Jose, California, United States2d ago
-
Computer Scientist USD 164K-238KAndroid | App Development | Artificial Intelligence | C++ | Camera App DevelopmentEntry-level Full TimeSan Jose, United States R2d ago
-
AI Engineer (San Jose, CA) USD 125K-175KAWS | Agent patterns | Anthropic | Azure | CI/CD401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeSan Jose, CA2d ago
-
Sr Engineer, Advanced Security Response Team (ASRT) USD 126K-208KApplication Security | Automation | Bash | Bot Detection | Cross-Site ScriptingAccident insurance | Accidental death and dismemberment | Company-Paid Holidays | Critical illness insurance | Disability insuranceSenior-level Full TimeSan Jose, United States R2d ago
-
Senior-level Full TimeSan Jose, CA, USA Office (SANJOSE)2d ago