Research Engineer - LLM/VLM Inference Optimization (Seed Infra)
San Jose, California, United States
USD 244K-450K Mid-level Full Time
Tasks
- Build compiler level optimized inference pipelines
- Collaborate with teams to improve model toolchains and ecosystem
- Design high performance inference systems for large scale LLMs and VLMs
- Develop CUDA kernels and low precision inference computation
- Develop and optimize inference engines and serving frameworks
- Optimize inference throughput with streaming and speculative decoding
- Perform performance analysis and identify bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
CUDA | CUDA kernels | Compiler optimization | Graph Fusion | High Performance | High-Performance Computing | Inference Optimization | Low Precision | Low-precision computing | Parallel Computing | Performance Analysis | Performance Computing | Precision computing | Speculative decoding | Streaming inference
Education
N/A
Related jobs
-
Perception Engineer III USD 155K-185KArduPilot | C++ | CUDA | Coordinate frames | DDS401k company match | Annual Company Holidays | Life insurance | Medical, dental & vision coverage | Paid time offSenior-level Full TimeUnited States16h ago
-
AI Software Engineer USD 80K-210KAWS Kinesis | Apache Airflow | Apache Kafka | C# | C++401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
ML Research Engineer - Hardware Codesign USD 185K-455KC++ | CUDA | Floating point | Floating point numerics | Functional simulationHybrid work schedule | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
Staff AI engineer USD 170K-250KAI Evaluation | AWS | Agent Orchestration | Caching | Distributed SystemsFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Data Engineer Mid-Level USD 80K-145KAnalytics Platforms | Data Engineering | Data Visualization | Data integration | High PerformanceHealth insurance | Hybrid work | Paid time offMid-level Full TimeWinchester, United States2d ago
-
C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learningSenior-level Full TimeBurlingame, CA2d ago
-
Senior-level Full TimeUnited States, California, Mountain View; United …2d ago
-
On-Device ML Compiler Engineer, Model Compilation, Graphics, Games and Machine Learning USD 175K-312KC++ | CPU | CUDA | GPU | MLIRSenior-level Full TimeCupertino2d ago
-
Senior AI Software Engineer USD 92K-209KAPI Design | Access Management | Agent systems | Agentic AI | C++401k match | Commuter benefits | Dental insurance | Flexible spending accounts | Health insuranceSenior-level Full TimeNashville, TN, United States2d ago
-
Ansible | C# | C++ | CMake | CUDAMentorship | Remote work | Training workshopsMid-level Full TimeBaltimore, MD, United States R3d ago
-
ADA | AFSIM | C# | C++ | Data FusionEntry-level Full TimeAtlanta, GA3d ago
-
Campus AI Research Engineer (Full-Time) USD 300K-300KC++ | CUDA | GPU Programming | HPC | High ThroughputCPT/OPT eligible | Visa sponsorshipEntry-level Full TimeChicago; New York3d ago
-
Campus AI Research Engineer (Intern) USD 300K-300KC# | C++ | CUDA | Data Mining | Deep learningCPT OPT eligibility | International student support | Work visa sponsorshipEntry-level InternshipChicago; New York3d ago
-
ML Platform Engineer USD 100K-150KAPI Gateway | Automated rollback | Autoscaling | C++ | CachingCareer growth | Direct W2 employment | H1B transfer support | Long-term employment | Remote workSenior-level Full TimeJersey City, NJ R3d ago
-
Division Head - Computational Fluid Dynamics USD 203K-336KAerodynamics | Cavitation | Computational Fluid Dynamics | Computing Architectures | Fluid DynamicsHybrid work option | On-site work option | Periodic travelExecutive-level Full TimePenn State University Park, United States3d ago
-
Associate, Quantitative Developer – Prime Services USD 150K-200K.NET | Azure | C# | Concurrent programming | Data ModelingCareer development | Health and well-being benefits | Paid time off | Retirement savings programSenior-level Full Time1 Vanderbilt Avenue TDS, New York, …3d ago
-
Division Head - Computational Fluid Dynamics (FACULTY) USD 109K-219KComputational Fluid Dynamics | Computing systems | Fluid Dynamics | High Performance | High-Performance ComputingHybrid work option | Medical, dental, and vision coverage | Periodic travel | Retirement plans | Tuition discountExecutive-level Full TimePenn State University Park, United States3d ago
-
Senior-level Full TimeWaterford, IE3d ago
-
Machine Learning Engineer - Model Inference USD 166K-230KC++ | Cloud infrastructure | Containers | Continuous batching | Distributed SystemsMid-level Full TimeCupertino3d ago
-
Senior AI Infrastructure Engineer - Model Training USD 190K-260KBF16 | C++ | CUDA | Data parallelism | DeepSpeed401k | Dental and vision plans | Dependent care FSA | Dog-friendly office | FSASenior-level Full TimeMountain View, CA3d ago
-
Staff Machine Learning Engineer USD 151K-309KA/B | A/B Testing | B testing | Canary Deployment | Capacity PlanningHybrid workSenior-level Full TimeRemote, US R3d ago
-
Data Engineer Senior USD 115K-160KAnalytics Platforms | Data Engineering | Data Visualization | Data integration | Desktop applicationsHybrid work | Top Secret/SCI clearance requiredSenior-level Full TimeWinchester, United States4d ago
-
Data and Analytics Engineer USD 80K-128KAlgorithm Evaluation | Data Visualization | MATLAB | Machine Learning | OpticsTravel opportunitiesEntry-level Full TimeHuntsville, AL, United States4d ago
-
Backend Engineer- Inference Services USD 150K-220KC# | C++ | Convolutional Neural Network | Git | High PerformanceMid-level Full TimeUSA | Remote R4d ago
-
ML Platform Engineer USD 100K-150KAPI Gateway | Abuse detection | Access Management | Automated rollback | AutoscalingSenior-level Full TimeUnited States - Remote R4d ago