Applied Scientist II - Copilot Tuning

Copilot Tuning is a new product that aims to fine-tune LLMs (large language model) on tenant data, enabling task-specific agents and solutions. We are a small, nimble team that is advancing the state of the art of models in M365 Copilot. Come join our team and help transform the LLM experience in the enterprise.

We are seeking an Applied Scientist II - Copilot Tuning with stellar research and system building skills and the desire to pursue the cutting edge in model development that pushes technological boundaries. We are looking for candidates with interest and experience in LLM post-training, especially reinforcement learning and alignment.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Train and deploy Language Models adapted to specific industry needs.
• Create and adapt novel training and fine-tuning algorithms for language models with special focus on reinforcement learning and alignment.
• Identifies, researches, and implements machine learning solutions given product requirements.
• Brings a research project to successful completion yielding new algorithms, prototypes, theories, tools, methods, analyses, insights, or collections of data which solve one or more open research problems.
• Document and share best practices across the organization.
• Supports mentorship by assisting with onboarding of research interns or other early in career team members.

Qualifications

Required Qualifications:

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field
  • OR equivalent experience.
• 1+ years of experience training/fine tuning AI/ML models, preferably large language models.
  
• 1+ years of experience building Generative AI pipelines, e.g. with RAG (Retrieval augmented generation).
  
• 1+ years of experience with Python and/or PyTorch.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Deep knowledge of transformer models and architectures.
• Experience with reinforcement learning algorithms and applications.
• Experience working with customers deploying AI solutions.

Applied Sciences IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until August 8, 2025.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

 

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

 

#RL #Reinofrcement-learning #Post-training #LLM #Alignment