AI Compiler Engineering Lead - Distinguished Engineer

Invent the future with us.    Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient, sustainable cloud computing.   By providing a new level of predictable performance, efficiency, and sustainability Ampere is working with leading cloud suppliers and a growing partner ecosystem to deliver cloud instances, servers and embedded/edge products that can handle the compute demands of today and tomorrow.   Join us at Ampere and work alongside a passionate and growing team — we’d love to have you apply!   About the role:   Ampere is looking for an enthusiastic and highly-skilled AI Compiler Engineering Lead to join our expanding AI/LLM Compiler Team.  In this role, you will spearhead the ongoing design and development of advanced compilers for Ampere's upcoming AmpereOne Aurora products. Your responsibilities will include managing the compiler architecture, making substantial contributions to its backend development, and expanding the team.  You will work closely with Ampere’s hardware engineering design teams to develop a “best in class” algorithm-compiler-hardware ecosystem.  What you’ll achieve:  

• Successfully develop and deliver a functional AI compiler (either ahead-of-time or just-in-time) along with an associated runtime environment, ensuring robust performance and reliability. 
• Lead the Ampere Computing AI compiler software efforts, driving innovation and excellence in Ampere’s compiler technology. 
• Work hand-in-hand with the silicon design team to enhance the Ampere Aurora AI accelerator, contributing to cutting-edge hardware-software integration. 
• Design and implement advanced solutions and enhancements for prominent machine learning libraries, including Llama.cpp, PyTorch, JAX, vLLM, and ONNX (C++), significantly boosting their performance and capabilities. 
• Conduct in-depth analyses of neural network models, identifying and proposing optimizations at multiple levels including model architecture, framework efficiency, compilation process, and execution speed, leading to substantial performance improvements. 

About you:  

• Master's or PhD degree in Computer Science, Electrical Engineering, Mathematics, or a similar quantitative field and 15 years of overall software engineering experience. 
• Strong Proficiency in Python and C/C++ Languages: Bring your expertise and passion for programming with at least 4 years of hands-on experience in Python and C/C++, driving innovative solutions through powerful code. 
• Experience with Large-Scale Software Systems: Showcase your background working on substantial software projects, especially in the realm of compilers or domain-specific compilers, contributing to robust, high-performance systems. 
• Knowledge of Essential Tools: Demonstrate your command of vital development tools such as Linux, Git, GCC, and LLVM, ensuring smooth, efficient workflows and high-quality results. 
• Adaptability in a Startup Environment: Thrive in our fast-paced, dynamic startup culture where your ability to take initiative and achieve impactful results is highly valued and rewarded. 
• Familiarity with Machine Learning and Deep Learning: Leverage your expert knowledge of machine learning and deep learning, with hands-on experience in popular frameworks like TensorFlow, PyTorch, Llama.cpp, and vLLM, to drive groundbreaking advancements in AI technologies. 

What we’ll offer: At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, bonus, equity, and comprehensive benefits. We offer an annual bonus program tied to internal company goals and annual meritocratic equity awards that enable our employees to participate in the success of the company. Benefits highlights include:

• Premium medical health care, so that you and your family members can feel secure in your health
• A generous paid time off policy so that you can embrace a healthy work-life balance
• A wide variety of office amenities including nutritious snacks and refreshing drinks, free gym and sauna access to keep you fueled and healthy
• Flexible working hours and a remote work policy that includes reimbursement of connectivity costs and equipment to work from home
• Sports card fully financed by Ampere

And there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are passionate about inventing industry leading cloud-native designs that contribute to a more sustainable future. We are excited to share more about our career opportunities with you through the interview process. #LI-DR
#Remote