Senior Software Engineer

AI is the strategic bet for Microsoft. The Azure AI Platform is right at the front end. Our project involves cutting edge technologies and problems. Joining the projects you will gain knowledge and experience about generative AI, large language model, transformers, GPU optimization, AI applications, etc. The AI business is also growing rapidly, and our products will directly face the impact of the large number of customers, which is continuously growing.

Within the AI Platform, the Azure ML team enables data scientists and developers to build quickly and easily, train, deploy, manage, and consume machine learning models.

The Models as a Service team is hiring Senior Engineer Manager. The team designs, builds, and operates the largest scale engineering system in the industry for Large Language Models and GenAI Services. Key areas that we are working on:

• Building and Scaling our Inferencing Cloud across our flagships AOAI Service and growing the Model as A Service model Families
• Expand the Gen AI Model Offerings to more model providers, and best and latest models and provide a unified experience across AOAI and MAAS/MAAP for Azure AI customers

Responsibilities

• Collaborate with appropriate stakeholders to comprehend and identify user requirements, scope solutions, estimate work, and schedule deliverables
• Lead discussions for the architecture of products or solutions and apply engineering principles to establish robust and maintainable architecture and designs
• Lead by example within the team by producing extensible and maintainable code, adhering to best engineering practices, raising the quality bar, and improving the team's response to customer incidents
• Respond, resolve, and integrate customer feedback with agility and dedication
• Manage and drive project execution with high quality and great agility

Qualifications

Required:

• Bachelor's Degree in Computer Science or related technical field and 8 - 10 years of experience in object-oriented programming and design patterns (C#, Python, C++, .NET or Java)
• 6+ years of hands-on experience shipping products across multiple product cycles

Preferred:

• Experience on python, pytorch, large language model, generative AI
• Experience with distributed systems design and implementation
• Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)
• Passion for machine learning, artificial intelligence, and data science
• Experience working on large-scale projects or applications
• Effective communication skills and ability to collaborate with diverse remote teams
• Quick learner with a passion for solving complex and exciting problems
• Familiarity with Azure or any existing Cloud Service Platforms

#IDCAIPlatformHiring

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.