Principal Data Engineer

Microsoft Teams is core to Microsoft's vision for intelligent communications and productivity panes into modern workplace. As the hub for teamwork in Office 365, Microsoft Teams continue to build momentum across collaboration, chat, meetings, and calls, with over 320M monthly active users.

We are looking for a Principal Data Engineer as part of Teams data engineering team in Redmond. You will grow your skills by working on highly scalable systems and latest technologies, processing petabyte scale data daily with the latest big data tools like Microsoft Fabric, Azure Data Lake and Azure Data Explorer. You will collaborate closely with data science to derive actionable insights and influence our product and growth strategy.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• You will build advanced code to extract raw data, coach the team on techniques to validate its quality, and ensure the correct data is ingested across the pipeline. You’ll also provide expertise on techniques to transform raw data into forms compatible with downstream data sources.
• Using your technical experience, you’ll improve data tools used to transform, manage, and access data across the organization. You’ll also write code to optimize storage and availability of data platforms so that they’re more resilient.
• You will improve performance monitoring protocols across the project, building automation into data visualizations and aggregations to address pipeline health patterns. You’ll also implement robust solutions and self-healing processes that prevent recurring points of failure across products.
• You will interpret laws and develop procedures that ensure compliance with all applicable laws and policies across the entire pipeline. You’ll also govern data accessibility across multiple data pipelines and/or models.
• Embody our culture and values. 

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, or data engineering work
  • OR equivalent experience.
• 5+ years of big data experience with any of the big processing tools such as Apache Spark, Snowflake, Hadoop etc.,
• Experience in processing of Tera Bytes to Peta byte scale of data. 

Other Requirements:

 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Experience in any of the following languages or equivalent language: Scala, Pyspark, C#, Java, Python, Rust.
• Experience with Azure cloud.
  
• Experience in other big data technologies.
  
• Data driven, customer focused, and organized.
  
• Experience operationalizing and supporting services.

 

Data Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until November 15, 2024.

 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

 

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

 

#swe24