Engineering Manager, Software Engineering, PyTorch Training Acceleration

This team works at the center of some of the most exciting and innovative parts of AI. This is an opportunity to ensure Meta continues to scale and optimize next generation ML models and training clusters by working across multiple products groups, next generation model architectures, scale up AI training, and hardware accelerators (GPUs).Engineering Manager, Software Engineering, PyTorch Training Acceleration Responsibilities

• Develop the foundational technology to unlock new model development paradigms and bring the state of the art algorithms and infra to PyTorch.
• Develop systems and techniques to leverage Accelerators like NVIDIA and AMD GPUs to scale and optimize AI Training
• Explore and adapt PyTorch technologies to the right problems that Meta Product Groups are facing. Along the way, optimize, improve, and work closely with other PyTorch teams to push forward in directions that maintain PyTorch as an industry leading ML framework that users love.
• Manage engineers and help them develop their careers, assigning them to projects tailored to their skill levels, long-term skill development, personalities, and work styles.
• Communicate and collaborate effectively with cross-functional hardware and software engineering teams.
• Operate strategically and tactically. Develop the vision and strategy to help set direction for the team.
• Work closely with dedicated recruiting staff to expand the team, including sourcing candidates, interviewing candidates, participating in conferences/events, and onboarding new employees.

Minimum Qualifications

• At least 8 years of experience in managing a software team in a fast-paced environment, including managing managers.
• Worked on Large scale distributed training, Fully Sharded Data Parallel, Parallelism Mechanisms (Tensor Parallelism, Pipeline Parallelism, Expert parallelism)
• Understand and analyze the interplay of hardware and software architectures on future algorithms, programming models and applications.
• Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management.

Preferred Qualifications

• Managed an org that has done Accelerator (GPU/ASIC) kernel development and optimization.
• Managed org that has experience in accelerating libraries on AI hardware, similar to cuBLAS, cuDNN, CUTLASS, HIP, ROCm etc.
• Experience working closely with hardware architectures such as Intel SIMD, GPU, RISC-V, AI Accelerators etc.
• Knowledge of ML frameworks like PyTorch, TensorFlow, ONNX, MXNet, etc.

For those who live in or expect to work from California if hired for this position, please click here for additional information. About Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
$२,१३,०००/year to $२,९३,०००/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.