Principal Data Engineer

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure and responsible for powering Microsoft’s “Intelligent Cloud” mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft's over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Teams, OneDrive and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization, and manageability solutions. Our focus is on smart growth, high efficiency, and delivering a trusted experience to customers and partners worldwide and we are looking for passionate, high energy engineers to help achieve that mission. 

The Cloud Hardware Analytics & Tools (CHAT) Team within SCHIE develops advanced analytical and tooling solutions to support and improve the quality of Microsoft Azure. We collect and analyze data across the full Azure stack, HW & SW components, Silicon development processes, and much more. CHAT Data Science, a branch of CHAT, provides data science support, machine learning and artificial intelligence solutions, and advanced visualizations to cloud engineering and management partners.  

We are looking for a Prinicpal Data Engineer to support our custom data analytics and visualizations platform. This high-impact role focuses on the pillars of data engineering of compliance, data management and transformation as well as modeling, and will have direct contributions to Azure-level projects, including working with highly visible platforms through data-driven approaches. This role closely collaborates with BI and Data Science, Software Engineers, other Data Engineers, Program Managers, and HW Engineering teams. 

Responsibilities

• Analyze large-scale Azure data to address critical business problems 

• Work on complex, mission-critical solutions that involve multiple Azure Services 

• Design and develop production-level code for data engineering efforts 

• Work in collaborative environment 

Qualifications

Required/Minimum Qualifications 

• 5 years of engineering experience in Data Engineering (Azure, SQL, PySpark, C#). 

• 5 years of experience with querying large volumes of data in SQL or Kusto databases 

• Experience in analytics for one of the technical domains (IoT, telemetry, fleet/inventory management, repairs & reliability analysis) or project/program analytics is preferred 

• 3 years of experience in monitoring & managing  data pipelines, capacity & usage analytics, Azure subscriptions or similar technical infrastructures 

• Strong C#, SQL and Python language skills for scripting and automation 

• CS Degree or equivalent experience  

• Excellent communications skills, both verbal and written 

#SCHIEINDIA

Additional or Preferred Qualifications 

• 3 years of experience with ADO Repo & CI/CD Pipelines management and automation 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. 

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.