Software Engineering Manager, AI Model Serving (Waterford, hybrid))

About the job

Do you want to be part of a team that is focused on scaling the deployment, tuning, and monitoring of Foundation Models and large language models? Do you want to play a pivotal role in shaping the roadmap and strategy for OpenShift AI serving with the large language models? We are seeking an experienced and dynamic Engineering Manager to lead our fast growing and globally distributed engineering team. 

The ideal candidate will combine strong technical expertise in machine learning, MLOps, and AI secure supply chain with stellar leadership and managerial skills.. As an engineering manager, you will be responsible for guiding the development and deployment of model serving and model metrics & monitoring by driving innovation, and ensuring the successful execution of projects. This role requires a strategic thinker who can align open source initiatives with business goals and foster a collaborative and high-performance team culture. 

Primary job responsibilities

• Lead and inspire a distributed team of individual contributors, fostering a collaborative and innovative work environment.

• Engage with the AI and machine learning open source communities such as  KServe, TrustyAI, Kubeflow, HuggingFace, vLLM, and several other open source communities.

• Work with product management and engineering teams to develop technology roadmaps and schedules, and communicate these schedules externally.

• Work with cross-functional engineering managers and teams on documentation, product management, and quality assurance to coordinate tasks necessary for releasing enterprise-quality MLOps software.

• Working closely with the technical leads and scrum leads to direct the team in agile development. 

• Mentor and nurture team members in their career development, and professional growth.

• Recruit and build a world class engineering team.

• Work closely with engineers and researchers on Red Hat OpenShift, Red Hat Enterprise Linux, and Red Hat Middleware teams to provide end-to-end AI/ML capabilities.

Qualifications

• 5+ years of significant hands-on software development and system design experience.

• 2+ years of managing software engineering teams.

• Proven experience in leading machine learning engineering teams, with a track record of successful project delivery and development of software engineers.

• Experience in machine learning frameworks and tools, such as PyTorch, and HuggingFace.

• Excellent programming skills in languages like Python, or Go.

• Experience with developing and scaling applications with Kubernetes. 

• Solid understanding of core machine learning concepts. 

• Excellent written and verbal communication skills.

• Ability to lead and work with diverse and distributed teams from multiple countries and cultures.

  #LI-PM1

About Red Hat

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.

Diversity, Equity & Inclusion at Red Hat
Red Hat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from diverse backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions of diversity that compose our global village.

Equal Opportunity Policy (EEO)
Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.

Red Hat does not seek or accept unsolicited resumes or CVs from recruitment agencies. We are not responsible for, and will not pay, any fees, commissions, or any other payment related to unsolicited resumes or CVs except as required in a written contract between Red Hat and the recruitment agency or party requesting payment of a fee.

Red Hat supports individuals with disabilities and provides reasonable accommodations to job applicants. If you need assistance completing our online job application, email application-assistance@redhat.com. General inquiries, such as those regarding the status of a job application, will not receive a reply.