Data Engineer, Data Migration

Status: Temporary, Full-Time (2-year term, potential for extension)
Number of Positions: 1
Work Location: Hybrid, Vancouver B.C. (a combination of in-office in Vancouver and remote work)

Who we are

The British Columbia College of Nurses & Midwives (“BCCNM”) is the college empowered under the Health Professions Act to regulate the practice of all licensed practical nurses, nurse practitioners, registered midwives, registered nurses, and registered psychiatric nurses in British Columbia. Regulation helps to protect the public by ensuring that professional care or service received by the public is competent, ethical, and meets the standards that society views as acceptable.

As western Canada’s largest health profession regulator, we believe a diverse and inclusive team enriches our efforts to protect the public. We welcome applications from all who reflect of the communities we serve, and especially encourage Indigenous Peoples and members of equity-seeking groups to apply. We believe diverse perspectives and experiences bring both innovation and better outcomes to the work we do and the decisions we make.

What we offer you​​

We promise to provide you with rewarding work that challenges you. You will be part of a passionate team contributing to our important mandate of protecting the public. As a member of the team, you can expect to be working in a collaborative, team-based environment, and treated in a respectful and professional manner.

The expected starting base salary for this position is $91,202 - $95,761 annually, depending on a variety of factors including qualifications and experience. Once hired, you will progress through a wider salary range over time as you continue to develop job knowledge, skills and competencies for the role.

In addition to base salary, the college offers a generous vacation and extended benefits package. As an employee, you receive 100% employer-paid health and dental benefits. And we contribute to B.C.'s Municipal Pension Plan to help you secure your retirement income. Throughout your career with us, you will engage in a variety of learning and development. We will support your professional development and cover your professional membership costs. To support you in work and life, we provide an employee assistance program and fitness allowance perk. Working with us allows you to enjoy flexible hybrid work. This position is located in Vancouver, but you’ll be able to work remotely up to 3 days a week. Our office is closed for the 11 statutory holidays in B.C. as well as Easter Monday and Boxing Day.

What you’ll be doing

Reporting to the Manager, Business Intelligence and Data, the Data Engineer (DE) supports CRM data migration and Business Intelligence projects by designing and building data management and analytics solutions, ensuring high quality and trusted data is available and accessible to BCCNM to make informed business decisions on our registrants, including developing reporting and analytics systems and self-serve reports for BCCNM internal and external customers.

The DE is responsible for working with data owners and various stakeholders from the business, IT and external teams to ensure successful delivery of the Data Projects.

Scope and Complexity

The DE is responsible for developing and maintaining data pipelines in Azure data platform, designing and managing data repositories, lakes and data warehouse. The DE supports the data governance and data quality strategies on the operational level maintaining the various artifacts on the data assets, including the data dictionary, lineage, ownership and business rules.

The DE works closely with the other data engineers and the data analysts (DA), business analysts (BA), records analyst, privacy analyst, IT and business SME’s. Specifically, for the Data migration project, the DE designs the source to target mapping, extracts the data from the current systems, transforms and loads the data into the new cloud-based CRM solution. The DE also works closely with the Application and QA teams to validate the data ensuring quality and alignment with the data architecture.

Internally, the DE works closely with the Operations Department and other business users within BCCNM.

Externally, the DE works with external stakeholders of the College, which may include other consulting firms, Health Regulators, the Ministry of Health and other agencies or bodies in the health care industry.

Together with Data Analysts, the work of the Data Engineer helps to promote organizational and operational effectiveness and promotes BCCNM’s information governance through managing data accuracy, data quality and integrity.

Duties/Accountabilities

1. Work together with other data engineers, data analysts, business analysts, business SME’s, records analyst, and privacy analyst to understand the needs for data and create effective, secure data workflows.
2. Responsible for designing, building, and maintaining secure and compliant data processing pipelines using various Microsoft Azure data services and frameworks including but not limited to Azure Fabric, Data factory, blob and Azure Synapse.
3. Build databases, data marts or data warehouse and perform data migration work.
4. Build reporting and analytical tools to utilize the data pipeline, provide actionable insight into key business performance metrics.
5. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Microsoft Azure Cloud.
6. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and/or Azure Blob Storage.
7. Utilize Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
8. Implement data validation and cleansing procedures to ensure the quality, integrity, and dependability of the data.
9. Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
10. Monitor and resolve data pipeline problems to ensure consistency and availability of the data.
11. Develop algorithms to transform data into useful data models.
12. Identify, design, and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
13. Adapt and learn new technologies per business requirements.
14. Ensure compliance with data governance, privacy and security policies.
15. Demonstrates a commitment to ongoing learning related to Indigenous cultural safety and humility to constructively disrupt indigenous-specific racism in BC’s health care system.
16. Fosters and maintains an organizational culture that promotes equity, diversity and inclusion, mutual respect, teamwork, and service excellence.

Qualifications

• A bachelor’s degree in computer science or other quantitative field plus relevant experience.
• Minimum 3 years experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Advanced experience programming ETL code, building and optimizing data pipelines, architectures, and datasets using Microsoft Azure technologies.
• Advanced experience with Dynamics CRM and SharePoint.
• Experience with data migration projects within a Microsoft and Azure environment is considered an asset 
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
• Demonstrated knowledge and application of relevant legislation; ethical and legal obligations, guidelines relating to privacy, confidentiality, and security of information.
• Ability to plan, prioritize and manage workload within a time sensitive environment.
• Excellent oral, written, and interpersonal communication skills. Ability to use audience appropriate communication and language to present information, analyze results and convey concepts.
• Ability to work outside of regular work hours, on occasion, to ensure the smooth functioning of BCCNM related systems.
• Knowledge of Canadian colonial impacts on Indigenous people in social and health contexts, including social, economic, political, and historical realities impacting Indigenous communities and knowledge of Indigenous-specific anti-racism and accompanying reports (e.g. The Truth & Reconciliation Commission’s 94 Calls to Action (2015), the In Plain Sight Report (2020), and Reclaiming Power and Place’s Calls for Justice (2019)) is an asset. 
• Demonstrated understanding of equity, diversity, inclusion, and cultural humility as they apply to health care is an asset.