Research Software Engineer II - Computer Agent

The Microsoft Applied Sciences Group incubates disruptive technologies for Microsoft’s next-gen hardware products and is working on several exciting projects that will shape how computers and other devices perceive the user and the user’s environment. Operating as a startup within the company, this team works closely with several research and product teams to bring compelling new experiences to the market. A lot of these experiences will be powered by large language models, NLP, speech, and computer vision – and as part of this team, you will have the unique opportunity to develop and implementing the ML algorithms and DNN models that make magic happen!

We are looking for a Research Software Engineer II - Computer Agent in the field of computer agent, which involves expertise in computer vision, NLP, planning and decision making, and deep learning techniques to help our devices understand the user intents and execute a series of actions to complete the tasks in a computer environment. The ability to analyze multimodal data and interpret various human and human-object interactions is key to Applied Sciences’ mission of enabling a seamless set of human computer interactions. As part of this team, you will be working with a growing team of talented researchers already dedicated to this mission and use data and hardware only available to a select few. Naturally, the opportunity for you to push the state of the art in this field is huge.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Research and develop computer agent models and algorithms with Python and other relevant programming languages
• Train deep learning models in TensorFlow and PyTorch, including data engineering
• Build pipelines to test algorithms and models and analyze the results
• Optimize algorithms and models for speed and accuracy on target hardware
• Embody our Culture and Values

Qualifications

Required/Minimum Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience
• 2+ years experience with machine leaning techniques (i.e. CNN, RNN, Transformer, Reinforcement learning), AND with machine learning frameworks and tools (i.e. Python, Tensorflow, PyTorch, and/or Onnx experience).
• 2+ years experience with Large Language Models, Agents, Prompt Engineering, Data Mining or equivalent work experiences.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements that are required for this role. These requirements include, but are not limited to the following specialized security screenings:  

• Microsoft Cloud Background Check:This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Additional or Preferred Qualifications

• Bachelor's Degree in Computer Science OR related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript,OR Python
• OR Master's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience.
• 3+ years experience with deep leaning techniques (i.e. CNN, RNN, Transformer, reinforcement learning), AND with machine learning frameworks and tools (i.e. Python,  Tensorflow, PyTorch, and/or Onnx experiences).
• Publication as lead author or essential contributor in top-tier audio/speech/NLP/vision/ML conferences and journals (i.e. ICML, ICLR, NeurIPS etc.).
• Proficient knowledge on Computer Science and Signal Processing and ability to understand and implement complex algorithms.

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $98,300 - $193,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $127,200 - $208,800 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay   

Microsoft will accept applications for the role until February 28, 2025.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.