Senior Data Engineer
Vancouver, British Columbia, Canada
Full Time Senior-level / Expert USD 108K - 199K
Microsoft
Entdecken Sie Microsoft-Produkte und -Dienste für Ihr Zuhause oder Ihr Unternehmen. Microsoft 365, Copilot, Teams, Xbox, Windows, Azure, Surface und mehr kaufen
As a Senior Data Engineer on our team, you will work at the intersection of data engineering and data science, you will play a critical role in building and optimizing the data pipelines that continuously monitor the performance of publishers and brands, build visualizations and set up alerts to monitor pipeline health. You will also create techniques to transform raw data into meaningful metrics using different data sources. You will develop data pipelines to aggregate data and extract signals required for the brand and content quality prediction models. In addition to creating reliable data solutions, this role involves maintaining and ensuring compliance with Microsoft’s security and engineering standards, enabling the team to respond to risks swiftly and proactively.
This position offers a unique opportunity to shape the landscape of MSN partner success and growth at one of the world’s leading technology companies. You will be instrumental in architecting and refining data processes that enhance Microsoft’s ability to support MSN content publishers and enable them to succeed and grow at scale, directly contributing to increasing the revenue on their spending.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- You will build code to extract raw data, validate its quality, and apply your deep data knowledge to ensure the correct data is ingested across the pipeline. You’ll also create techniques to transform raw data into forms compatible with downstream data sources.
- You will identify opportunities to leverage and contribute to the development of data tools that are used to transform, manage, and access data. You’ll also write and validate code to test the storage and availability of data platforms so that they’re more resilient.
- You will write code to implement performance monitoring protocols across data pipelines, building visualizations and aggregations to monitor pipeline health. You’ll also implement solutions and self-healing processes that minimize points of failure across multiple product features.
- You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies. You’ll also govern data accessibility within your assigned pipelines.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling or data engineering work
- OR equivalent experience.
- 2+ years experience in query languages (e.g., SQL, KQL).
- 2+ years experience with object-oriented programming languages (e.g., Python, C#, Java, or C++).
Preferred Qualifications:
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
- OR equivalent experience.
- 1+ year(s) experience with big data systems and tools, such as PySpark, Databricks, or Azure Synapse.
- Experience with machine learning and statistical modeling
- Demonstrated ability to build and manage data systems in the cloud
- Problem-solving skills and attention to details, with a proactive approach to identifying
and mitigating risks.
Data Engineering IC4 - The typical base pay range for this role across Canada is CAD $108,100 - CAD $199,700 per year.
Find additional pay information here:
https://careers.microsoft.com/v2/global/en/canada-pay-information.html
Microsoft will accept applications for the role until February 25, 2025
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
#MicrosoftAI
Tags: Azure Big Data Business Analytics CAD Computer Science Databricks Data governance Data pipelines Engineering Java Machine Learning Mathematics ML models OOP Pipelines PySpark Python Security SQL Statistical modeling Statistics
Perks/benefits: Career development Health care Medical leave
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.