Software Engineer - II

Microsoft is leading the AI strategy with an ambitious mission to democratize AI, make it an essential ingredient for delivering breakthrough customer experiences and to ensure the benefits of AI reach every person and organization on the planet, safely and responsibly.

We are looking for a seasoned Software Engineer at Microsoft, Hyderabad, who is passionate about designing and building highly reliable, available platform to support model inferencing at the scale of billions of requests per day. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities

You will be joining the Azure Managed Inference team that builds and runs the model-serving platform for Generative LLMs. This team is at the forefront of delivering this innovation with massive scale powering every Azure customer and scenario in the industry, both 3P and 1P customer like Bing and Office and solve exciting problems on the intersection of AI and Cloud.

Responsibilities

• Design and build complex high scale services for model serving, considering security, scalability, maintainability, and cost-effectiveness
• Code Review and Quality Assurance: Focus on delivering a high-quality product and ensuring compliance with standards that safeguard customer security & privacy and modelling the engineering culture we aspire to for other engineers on the team
• Problem Solving: Solve complex technical issues to improve the service & our customer's experience
• Production Service Support: Work as part of an on-call rotation to support the services within the team's ownership, mitigating customer impacting incidents, driving clarity, and providing guidance and leadership to other engineers on the team when handling incidents
• Collaborate with cross-functional and cross-geo teams and stakeholders
• Embody our culture and values

Qualifications

Required Qualification:

• Master's and 2+ years' experience, or Bachelor's and 4+ years' experience in Computer Science, Computer Engineering, or related field
• Strong hold on Data Structures, algorithmic problem solving and proficiency in software development/engineering skills (Python/Java/C#)
• Proven Industry experience on large-scale data processing, distributed computing, or cloud platforms and building highly performant production solutions
• Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)
• Experience with cloud platforms (e.g., Azure, AWS) and distributed computing
• Excellent verbal and written communication skills and ability to work independently and collaboratively

Preferred Qualifications:

• Proficiency in Python and open-source tools (e.g., TensorFlow, PyTorch) to develop production-grade quality products is a plus.
• Experience working with and using LLMs to build large scale products and applications is a plus
• Design and build end-to-end high performance ML workloads covering model training, data analysis, model serving and model evaluation is a plus

#IDCAIPlatformHiring

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.