Principal Architect - AI Compiler

Our team at Microsoft CoreAI is at the forefront of developing AI technologies that combine language, vision, and other sensory inputs to power Microsoft AI products. We offer these advanced models as services for both internal and external applications, driving innovation across the ecosystem. We collaborate extensively with OpenAI and numerous Microsoft product teams, including Copilot and Office. 
 
We are seeking a Principal Architect - AI Compiler to pioneer the use of Large Language Models (LLMs) and AI-driven techniques in next-generation compiler and kernel development. This role is ideal for someone with expertise in modern AI and ML techniques who is passionate about pushing the boundaries of AI-assisted software engineering and compiler optimization.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Responsibilities

• AI Kernel Authoring & Optimization: Leverage LLMs to generate, optimize, and rewrite compute kernels for performance and portability across diverse hardware targets. 
• AI-Driven Debugging & Porting: Use AI tools to assist in debugging and porting kernels across architectures, improving developer productivity and code quality. 
• Algorithm Replacement: Identify and replace traditional compiler algorithms with AI-powered alternatives to enhance performance, maintainability, and adaptability. 
• Kernel Fusion via AI: Design and implement AI-driven strategies for kernel fusion to reduce memory bandwidth usage and improve runtime efficiency. 
• Collaborative Innovation: Work closely with compiler architects, ML researchers, and systems engineers to integrate AI capabilities into the compiler toolchain. 
• Research & Prototyping: Stay at the forefront of AI and compiler research, rapidly prototyping and evaluating new ideas. 

Qualifications

Required/Minimum Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to C++, Python
  • OR equivalent experience.
• 8+ years developing AI algorithms, systems, and applications
• 5+ years experience developing and deploying state-of-the-art AI based systems in a production environment

Other Requirements: 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: 

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/Additional Qualifications

• PhD in AI, Machine Learning, Compilers, or Algorithms 
• 10+ years programming in C++ and Python. 
• 10+ years experience developing AI algorithms, systems, and applications.  
• Demonstrated ability to work in a quick, innovation-driven environment. 
• Experience with compiler frameworks, including MLIR and LLVM. 
• Proficiency in CUDA or Triton 
• Understanding of AI inference stacks  

Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $163,000 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft posts positions for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

#CoreAI