Principal Pytorch Staff Engineer

Job Summary:

At Red Hat, we connect an innovative community of customers, partners, and contributors to deliver an open-source stack of trusted, high-performing solutions. We offer cloud, Linux, middleware, virtualization, and AI technologies, together with award-winning global customer support, consulting, and implementation services. Red Hat is a rapidly growing company supporting more than 90% of Fortune 500 companies.

The AI Core Components organization, part of AI Engineering, is looking for individuals with a passion for Open Source, automation and helping grow the impact of Red Hat’s AI offerings for our customers and the community. 

As a Staff Engineer you’d be a person with deep expertise in Machine Learning systems and tools, relentless curiosity, and a bias for action. This role is ideal for someone who thrives at the intersection of AI innovation and engineering excellence and is passionate about boosting engineering productivity through the intelligent use of the latest AI advancements.

What you will do:

• Prototype with Purpose: Rapidly build PoCs using the latest AI models and frameworks to enhance developer workflows across the PyTorch engineering lifecycle (code, test, document, debug, optimize).

• Bridge Industry & Implementation: Evaluate innovations from open source, academia, and industry and assess how they can improve the way PyTorch is built and maintained.

• Drive Developer Productivity: Create intelligent tools that support faster iteration, better testing, and smoother onboarding for PyTorch engineers—turning AI into leverage.

• Embed in the Team: Work alongside core PyTorch engineers to understand friction points and infuse AI-powered solutions into existing workflows and CI pipelines.

• Lead by Influence: Set technical direction in the space of AI-enhanced engineering productivity. Act as a multiplier for the team—mentoring, demoing, writing internal blogs, and making innovation accessible.

• Contribute to the PyTorch Ecosystem: Your work will extend to open-source tooling or enhancements that benefit the broader PyTorch community.

What you will bring:

• 8+ years of experience in machine learning, software engineering, or systems design, with significant exposure to AI/ML infrastructure.

• Deep understanding of LLMs, AI agents, vector search, prompt engineering, and developer productivity tools.

• Strong Python programming skills and experience with PyTorch, Hugging Face Transformers, LangChain, vLLM, or OpenAI/Anthropic APIs.

• Demonstrated ability to build fast, impactful prototypes that lead to production-ready tools.

• Experience improving engineering workflows through AI tools—code generation, automated test generation, bug triage, documentation assistants, etc.

• Familiarity with modern software engineering practices: CI/CD, DevOps, VS Code extensions, or internal tooling development.

• Collaborative mindset and excellent communication skills—comfortable working with developers, QE, product managers, and leadership.

Nice to have:

• Contributions to PyTorch or other open-source ML/AI frameworks.

• Experience building developer tools or productivity platforms within ML orgs.

• Familiarity with AI use cases in systems optimization, model compilation, or hardware acceleration.

• Exposure to long-context transformer models and techniques like EasyContext, NoLiMa, or KV-cache paging.

About Red Hat

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.

Inclusion at Red Hat
Red Hat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.

Equal Opportunity Policy (EEO)
Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.

Red Hat does not seek or accept unsolicited resumes or CVs from recruitment agencies. We are not responsible for, and will not pay, any fees, commissions, or any other payment related to unsolicited resumes or CVs except as required in a written contract between Red Hat and the recruitment agency or party requesting payment of a fee.

Red Hat supports individuals with disabilities and provides reasonable accommodations to job applicants. If you need assistance completing our online job application, email application-assistance@redhat.com. General inquiries, such as those regarding the status of a job application, will not receive a reply.