Product Marketing Manager - TensorRT-LLM

Become a part of NVIDIA, the industry frontrunner in AI computing, and help us revolutionize AI-powered solutions. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. We are looking for a technical product marketing manager who is passionate about model optimization and deployment to join NVIDIA’s developer team. Inference is where AI delivers results, powering innovation across every industry. Optimized inference allows for larger models to be used in real world applications while increasing throughput, lowering cost, and reducing power consumption.

We need someone technical to build go-to-market plans and shepherd the creation of supporting marketing materials like sample applications, tutorials, white papers, and deeply technical presentations that convey the value of NVIDIA TensorRT and TensorRT-LLM. Do you have the rare blend of both technical and marketing skills? We need hard-working and creative people who want to work on state-of-the-art technology and are passionate about supporting developers. If so, we would love to learn more about you.

What you’ll be doing:

• Build product positions - Collaborate with business leaders across NVIDIA to understand and communicate the value of our products to developers. You will gather evidence, develop compelling product claims, and establish positioning points that highlight our strengths and address our competitors' weaknesses.

• Introduce products - Develop and complete well-crafted marketing plans, ensuring consistent messaging across all materials. Collaborate with a diverse cross-functional team, including product management, technical marketing, engineering, campaign managers, and PR, to effectively implement these plans.

• Foster awareness - Segment and target audiences, identify asset gaps, and collaborate with technical teams to build developer-centric marketing content. This includes generating deep technical blogs, webinars, tutorials, and more to showcase the outstanding features and capabilities of TensorRT-LLM.

• Public engagement - Represent NVIDIA at trade shows, conferences, and customer meetings. Evangelize and nurture the use of our software development kits to grow the NVIDIA developer community.

What we need to see:

• Familiarity with popular large language models like Llama, GPT, Gemma and Phi, and an understanding of kernel fusion, quantization, memory manipulation, and other model optimization techniques for inference deployment.

• Inference ecosystem knowledge - Experience with compilers such as OAI Triton, XLA, MLIR, and frameworks like PyTorch, JAX, and ONNX.

• Ability to explain core computer science concepts related to performance, such as Amdahl’s law.

• 10+ years of meaningful work experience in a technical marketing role related to deep learning software.

• A degree in Computer Science, Computer Engineering, or a similar field (or equivalent experience).

• Proficiency in modern programming languages like Python

• Outstanding written and verbal communication and interpersonal skills, with a proven ability to articulate value propositions to both technical and non-technical audiences.

• Demonstrated ability to prioritize projects, commit to getting things done, and work independently.

• A willingness to work on new products and technologies with an entrepreneurial spirit.

• Writing samples - Please include samples of public-facing technical content you’ve built.

Ways to stand out from the crowd:

• Experience in marketing inference optimization products.

• Familiarity with NVIDIA GPUs and the CUDA parallel programming model

• Direct experience with NVIDIA TensorRT-LLM

• A Master's degree or equivalent experience from a leading university in software engineering or computer science.

The base salary range is 184,000 USD - 345,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.