Senior Data Quality Engineer

Job Description

Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with 16,700 stores in 31 countries, serving more than 9 million customers each day.

It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With strong data engineering expertise, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success.

About the role

We are looking for a Data Quality Engineer with a collaborative, “can-do” attitude who is committed & strives with determination and motivation to make their team successful. A Data Quality Engineer who has experience in testing data in system integration and production environment after change deployment. This role is responsible for ensuring data quality matrix generated through data lake/delta lake and data warehouse is accurate and optimal for the trustworthy and defect free data. This role will help drive Circle K’s next phase in the digital journey by transforming data to achieve actionable business outcomes. The Data Quality Engineer will create test cases and test scripts to validate data before and after data pipeline execution to decide on data quality.

Responsibilities

• Collaborate with business stakeholders and other technical team members to develop, test, and support the data applications that are most relevant to business needs and goals.
• The Data Quality Engineer provides continuous automated and manual testing of data sets for use in internal data systems and for delivery from internal systems to business users within organization, such data sets can be in several formats, depending on supplier systems and business requirements, including JSON, XML, CSV or parquet.
• The data quality engineer works in the global tech team with Senior data engineers, data engineers and BI engineers.
• The data quality engineer will write testing plans and routines, manage continuous integration and regression testing processes, and be the point person for clearing data for release according to delivery specifications.
• The engineer must be able to function effectively in a high-volume, rapid delivery environment in which available data must meet all quality standards, security and accessibility specifications without fail.
• Work with data/product managers and development leads to create testing strategies.
• Design, monitor and maintain QA reports, KPIs & quality trends for the internal data systems.
• Create test plans and test cases.
• Execute and automate test cases and perform bug tracking.
• Help create and implement quality processes and requirements.

Required Qualifications

• Full-Time bachelor’s degree in engineering/technology, computer science, information technology, or related fields.
• 5+ years of relevant experience in ETL/ELT testing, providing DQ reports and performance tuning using ETL tools such as SSIS/ADF in a multi-dimensional Data Warehousing environment like SQL DB/Synapse.
• 5+ years of strong and extensive hands-on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, Data Warehouse and Power BI.
• Familiarity with Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Blob Storage, Python/PySpark, Logic Apps, Key Vault, and Azure functions and Power BI.
• Good experience in defining and enabling data quality standards for auditing, and monitoring purposes.
• Knowledgeable about industry data compliance strategies and practices, such as continuous integration, regression testing and versioning.
• Strong collaboration, teamwork skills, excellent written and verbal communications skills.
• Self-starter and motivated with ability to work in a fast-paced agile environment.
• Proficiency in the functional and non-functional testing including unit-testing, integration testing and defect management tools.
• Strong proficiency in scripting to read/write SQL queries and python.

Preferred Skills

• Strong Experience in ETL/ELT testing, BI application testing and defect management process.
• Data Quality and Testing related certifications are a plus.

Technologies we use: Azure Data Factory, Databricks, Azure Synapse, Azure Tabular, Azure Functions, Logic Apps, Key Vault, DevOps, Python, PySpark, Scripting (PowerShell, Bash), Git, Terraform, Power BI, Snowflake

#LI-DS1