Principal LLM Inference Engineer
Tasks
- Build and maintain inference runtimes and serving frameworks
- Build proof of concept systems
- Create technical publications and open source contributions
- Develop and tune custom kernels
- Drive quantization sparsity and batching strategies
- Manage distributed inference tensor pipeline and KV cache
- Optimize operators for throughput and latency
- Prototype LLM inference use cases
- Provide workload insights to hardware firmware and compiler teams
- Translate POCs into customer demonstrations
Perks/Benefits
Skills/Tech-stack
Batching | C# | C++ | CUDA | CUDA kernel | CUDA kernel programming | Continuous batching | Distributed inference | JAX | KV cache | Kernel programming | Mixture of Experts | Model Serving | Multi model serving | Multi-model | ONNX Runtime | Performance Profiling | Pipeline parallelism | Python | Quantization | SGLang | Sparsity | Speculative decoding | Tensor Parallelism | TensorRT-LLM | Triton | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
AI Model Developer USD 125K-150KAWS | Angular | Azure | CI/CD | D3.jsHybrid work environment | Public Trust determination supportMid-level Full TimeFAIRFAX, VA, United States5h ago
-
Lead Infrastructure Engineer USD 135K-196KAWS | Cloud technologies | Configuration Drift | Configuration Management | Configuration drift managementSenior-level Full TimeAlpharetta, GA, United States6h ago
-
Senior-level Full TimeRaleigh, North Carolina, USA, 276167h ago
-
Data Engineer USD 99K-130KBusiness Objects | Change Management | Data Governance | Data Lineage | Data ModelingMid-level Full TimeNashville, TN, United States8h ago
-
Mid-level Full TimeCenter, Center District, IL8h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Deep learningFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeRichmond, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Computer vision hardware | Edge ComputingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeJacksonville, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Analysis | ForecastingEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeTampa, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Image SegmentationFlexible schedule | Flextime | Mentorship | Office work options | Personalized growth roadmapsSenior-level Full TimeChicago, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Computer vision hardware | Edge ComputingEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthSenior-level Full TimeBoston, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Deep learningEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeHouston, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Science | Image SegmentationFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeWest Palm Beach, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeAtlanta, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Deep learning | Image SegmentationFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimePort Charlotte, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Image Segmentation | Image classificationFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBlacksburg, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Image SegmentationEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeDallas, United States9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Deep learning | Edge ComputingFlextime | Mentorship | Office work option | Personalized growth roadmaps | Professional growthSenior-level Full TimeAustin, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Data Science | Image Segmentation | Image classificationFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBaltimore, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingFlexible schedule | Mentorship | Professional growth | Remote and office options | TechtalksSenior-level Full TimeFort Lauderdale, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Image SegmentationEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsSenior-level Full TimeTallahassee, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeSan Francisco, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Cameras | Clustering | Computer Vision | Data AnalysisEducation budget | Fitness budget | Flextime | Mentorship | Onsite work optionsSenior-level Full TimeMiami, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Science | Image SegmentationEducation budget | Fitness budget | Flexible schedule | Mentorship | Onsite work optionsSenior-level Full TimeBoca Raton, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Data Science | Image SegmentationFlexible schedule | Mentorship | Onsite work options | Professional growth | Remote work optionsSenior-level Full TimeOrlando, United States10h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-215KAnomaly Detection | Clustering | Computer Vision | Deep learning | Image SegmentationEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeLos Angeles, United States10h ago