Principal Software Engineer, TensorRT-LLM
US, CA, Santa Clara, United States
USD 272K-431K Senior-level Full Time
Tasks
- Architect inferencing software
- Collaborate across teams on AI inferencing
- Follow developments in AI and evolve code design
- Guide development of scalable software
- Perform performance analysis and tuning
Perks/Benefits
Skills/Tech-stack
AI Inference | AI inference frameworks | C# | C++ | Deep learning | Inference frameworks | JAX | Language Models | Large Language Models | Performance Analysis | PyTorch | Python | Software Design
Education
Bachelor of Science | Doctor of Philosophy | Master of Science
Regions
Countries
States
Cities
Related jobs
-
Staff Software Engineer, AI/ML, YouTube USD 207K-300KAudio Processing | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSan Bruno, CA, USA1h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1h ago
-
Staff Software Engineer, AI/ML Data Processing USD 207K-300KAPIs | Checkpointing | Cloud technologies | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
2026 Summer Internship | Data Analytics & AI USD 50K-90KDashboarding | Data Engineering | Data Pipelines | Data analytics | ETLCareer development opportunities | Community service opportunities | Executive spotlights | Hybrid schedule | Professional development sessionsEntry-level InternshipMiramar, FL, US, 331325h ago
-
Senior Machine Learning Engineer USD 150K-200KDistributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programsSenior-level Full TimeRemote - USA R7h ago
-
Senior AI Automation Engineer, CS Ops - Moveworks USD 187K-295KAI tools | API | Agent Frameworks | Analytics | AutomationRemote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Senior Robotics Software Engineer - Simulation USD 130K-170KBullet | C++ | CI/CD | Data Generation | Digital TwinsSenior-level Full TimeSan Jose, CA9h ago
-
Senior-level Full TimeSan Jose, CA9h ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R9h ago
-
Research Engineer, Gemini AutoRater USD 166K-244KData collection | Fine Tuning | Foundation Models | Human evaluation | Language ModelsSenior-level Full TimeMountain View, California, US9h ago
-
Computational Geometry Software Engineer USD 130K-250KC++ | CAD | CAM | Docker | GPU Computing401k | Dental insurance | Flexible vacation policy | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, CA10h ago
-
Software Engineer - Reference Data (Java/SQL) USD 175K-200KAPI Development | Distributed Systems | Git | HBase | HadoopMid-level Full TimeNew York10h ago
-
Senior LLM Software Engineer USD 191K-287KAWS | Agentic Automation | Data Pipelines | Event Driven | Event-driven architecture401k retirement plan | Caregiver leave | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeCosta Mesa, California, United States10h ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R11h ago
-
Machine Learning Engineer, Geometry Team USD 175K-215K3D Spatial Reasoning | C++ | Computer Vision | Distributed Training | JAXSenior-level Full TimeKirkland, Washington, United States12h ago
-
Lead- Full Stack Engineer USD 150K-190KAWS Fargate | AWS Lambda | Amazon RDS | Amazon S3 | CI/CDCareer development opportunities | Entrepreneurial environment | Equal employment opportunity | High responsibilityMid-level Full TimeMcLean, Virginia, United States12h ago
-
AI Search | AWS | Amazon SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
AWS S3 | Ansible | Automation | Azure Blob | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Senior Staff AI Engineer, AI Privacy Expert USD 198K-326KAI privacy | Data Memorization | Differential Privacy | Explainability | Federated LearningHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States13h ago
-
Sr. Staff AI Engineer, GenAI Safety USD 191K-315KAI Safety | Content Safety | Distillation | Distributed Systems | Evaluation PipelineHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States13h ago
-
Staff AI Engineer, AI Privacy Specialist USD 170K-277KAnonymization | Data Memorization | Data Utility | Differential Privacy | Evaluation FrameworksHealth and wellness programs | Hybrid work flexibility | Time away from workSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Software Engineer - Perception (Fallback Stack) USD 151K-255KC++ | Computational Geometry | Confidence Calibration | Deep learning | Linear Optimization401k matching | Comprehensive health insurance | Learning and wellness stipends | Paid time offMid-level Full TimeSunnyvale, California, United States13h ago
-
Software Engineer, Full-Stack USD 180K-300KBackend Development | JavaScript | Python | React | Testing401k match | Health benefits | Learning & development stipend | Relocation assistance | Unlimited PTOMid-level Full TimeRedwood City13h ago
-
Generative AI | Language Models | Large Language Models | Machine Learning | Recommender SystemsHealth and wellness programs | Time away from workExecutive-level Full TimeMountain View, CA, United States14h ago
-
AI Engineer USD 150K-215KAgent Orchestration | Agent systems | AgentOps | Amazon Bedrock | Azure OpenAIMid-level Full TimeRemote United States R14h ago