Software Engineer

Do you want to make a real impact on how billions of people experience search every day? Here’s your chance! The Bing Metrics Team is on the lookout for passionate and talented full-stack developers and data scientists who are excited to build cutting-edge solutions for measuring and enhancing the quality of search results at Bing.

In this role, you’ll be part of a dynamic, international team responsible for ensuring Bing delivers the best, most accurate, and reliable results to users worldwide. You’ll dive deep into petabytes of user data, uncovering potential issues, and utilizing advanced AI techniques, including LLMs, to evaluate and improve search quality across the board. Whether it’s at the query level, on-page insights, or evaluating entire search results, you’ll use the latest tech to make Bing smarter, faster, and better for users everywhere.

What you’ll do:
- Design and develop innovative data pipelines that help track and improve search quality at Bing.
- Work on complex, multi-step systems powered by LLMs to identify, diagnose, and fix search quality issues.
- Collaborate with over 80 teams across the entire Bing ecosystem to drive improvements in search relevance and quality.
- Build tools that automatically assess and generate valuable insights to fine-tune search results and user experience.

This role offers unmatched exposure within Bing, with high visibility and significant influence over search engine relevance. You’ll be at the forefront of Bing’s mission to deliver flawless search experiences on a global scale.

We’re looking for a detail-oriented engineer with a passion for large-scale computing and problem-solving, someone who loves building innovative, scalable data solutions—especially around LLMs. You should be a curious and creative thinker, eager to design tools and pipelines that improve search quality. If you’re passionate about driving excellence in search and get frustrated with bad search results, this is the job for you!

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Builds tools and pipelines with Bing Logs using Big Data platforms.
• Designs and implements E2E pipelines (from data collection, evaluation and result display).
• Designs and implements tools for LLM models, engineer prompts for textual and multi-model LLMs for data processing and insight generation.
• Designs and implements creative visualization for results.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science, or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• Experience in Machine Learning and Data Science.

Preferred Qualifications:

• Experience in testing and relevance evaluation.
• Experience or deep interest in Large-Language Models (ChatGPT).
  
• Experience for (big) data and data analytics.
  
• Interest in designing dashboards for data visualization in novel ways.

 

Software Engineering IC2 - The typical base pay range for this role across the U.S. is USD $81,900 - $160,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $105,600 - $174,600 per year.

 

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay    

 

Microsoft will accept applications for the role until March 18, 2025.

 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

 

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

 

#MicrosoftAI   #Bing