Senior Deep Learning Architect, LLM Inference
Tasks
- Build inference benchmarking methodologies
- Contribute to deep learning software projects
- Develop inference performance data results website
- Guide inference serving direction
- Identify performance bottlenecks in client server LLM applications
- Improve team efficiency with coding agents and inference technology
- Invent profiling and analysis tools
- Optimize inference server performance
- Verify GPU product performance launches
- Work on LLM workload characterization
Perks/Benefits
Skills/Tech-stack
CPU microarchitecture | Compiler optimizations | Data parallelism | Deep learning | Disaggregated serving | GPU microarchitecture | LLM Inference | Language Models | Large Language Models | MCP | Machine Learning | Mixture of Experts | OpenAI API | Performance Tuning | Profiling | PyTorch | SGLang | Software Optimization | TRT-LLM | VLLM | Visualization
Education
Regions
Countries
States
Related jobs
-
Staff/Sr. ML Compute Efficiency Engineer USD 197K-300KC plus plus | Distributed Systems | GPU Computing | High Performance | High-Performance ComputingSenior-level Full TimeSanta Clara1d ago
-
Distinguished Engineer, Scaled Out Inferencing USD 320K-488KAI infrastructure | CUDA | Cloud Native | Cloud Native Architecture | Container OrchestrationSenior-level Full TimeUS, CA, Santa Clara R2d ago
-
Software Engineer, CUDA Deep Learning Systems USD 152K-258KC++ | CUDA | Computer Architecture | Deep learning | Distributed ComputingBenefits | EquityMid-level Full TimeUS, CA, Santa Clara R2d ago
-
Machine Learning Systems Engineer, Networking USD 152K-287KAnomaly Detection | CPU Optimization | Data Ingestion | Feature Engineering | GoComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara2d ago
-
Machine Learning Engineer, AI Safety USD 152K-281KBias Mitigation | Content Safety | Deep learning | Keras | Language ModelsComprehensive benefits packageMid-level Full TimeUS, CA, Santa Clara R2d ago
-
Senior Solutions Architect, Industrial Robotics USD 184K-287KAI | Computer Vision | Data Generation | Deep learning | Digital TwinsSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Senior Solutions Architect, Industrial Robotics USD 184K-287KArtificial Intelligence | Computer Vision | Data Generation | Deep learning | Digital TwinEquity | Health insurance | Paid time offSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Computer Vision | Deep learning | Language Models | Large Language Models | Machine LearningEntry-level InternshipSanta Clara, CA6d ago
-
Computer Vision | Deep learning | Language Models | Large Language Models | Machine LearningMid-level Full TimeSanta Clara, CA6d ago
-
Senior Machine Learning Engineer, Perception USD 184K-287K3D Geometry | BEV Representation | Camera | Computer Vision | Deep learning401k plan | Free lunch | Salary and benefits package | Unlimited beverages | Unlimited snacksSenior-level Full TimeSanta Clara, CA6d ago
-
C++ | CUDA | CUPTI | Continuous batching | KV cacheSenior-level Full TimeUS, CA, Santa Clara R7d ago
-
AWS | Azure | Bazel | C# | C++Equity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara R7d ago
-
Senior MLOps Engineer USD 184K-287K3D Geometry | Accelerated computing | C plus plus | CI/CD | Cloud infrastructureEquity | Health benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara7d ago
-
C++ | CUDA | Data Preprocessing | Data Processing | Data loadingSenior-level Full TimeUS, CA, Santa Clara7d ago
-
Senior Deep Learning Performance Architect USD 184K-287KASIC Architecture Evaluation | ASIC architecture | Architecture evaluation | Artificial Intelligence | C++Equity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara7d ago
-
C# | C++ | Caching | Distributed Systems | GPU ArchitectureComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R7d ago
-
Senior Deep Learning Computer Architect USD 184K-287KAttention Mechanisms | C++ | CUDA | Communication | Computer ArchitectureEquity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara7d ago
-
Senior Deep Learning Performance Architect USD 184K-287KASIC architecture | Architecture simulation | C# | C++ | CUBLASSenior-level Full TimeUS, CA, Santa Clara7d ago
-
Senior Software Engineer, Deep Learning - MLIR TRT USD 184K-287KC# | C++ | CUDA | Compression | Deep learningSenior-level Full TimeUS, CA, Santa Clara7d ago
-
Senior GPU Architect, Deep Learning USD 184K-287KAttention Mechanisms | C# | C++ | Computer Architecture | Deep learningBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara7d ago
-
Senior Deep Learning Frameworks Sustaining Engineer USD 152K-218KBazel | C# | C++ | CI Jenkins | CI/CDBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara7d ago
-
Analytical Models | C# | C++ | CUDA | CutlassEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara7d ago
-
API | AWS | CI/CD | Cloud platform | Distributed SystemsSenior-level Full TimeSanta Clara, CA8d ago
-
Senior Software Engineer – TensorRT Edge-LLM USD 152K-241KAttention | C++ | CUDA | Compiler optimization | FlashInferSenior-level Full TimeUS, CA, Santa Clara R8d ago
-
Senior AI Workflow Engineer USD 184K-287KASP.NET | Agentic AI | Ansible | Artifactory | CI/CDEquity | Health insurance | Paid time offSenior-level Full TimeUS, CA, Santa Clara8d ago