Senior Data Engineer (Azure Databricks)

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.
 
By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.
 
From prototype to real-world impact - be part of a global shift by doing work that matters.

Job Description

Job Description

• Responsible for ingestion of data sources and feature engineering to support creation of modelling data layers, integrate data into models / workflows.
• Representation at Architecture Review Boards.
• Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies
• Create and maintain data solutions IN Azure, using any of the following: Data Factory, Synapse, Databricks, Fabric 
• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitoring and resolving data pipeline problems, ensuring  consistency and availability of the data.

Qualifications

• Proficient in Python 
• Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling.
• Strong experience with Relational and ideally NoSQL databases.
• Strong understanding of ETL/ELT processes.
• Exposure to data monitoring and observability tools.
• Relevant experience with Event-Driven Architecture
• Good understanding of Agile ways of working

Additional Information

Our diversity makes us stronger - it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us, regardless of background, identity, or personal characteristics, feels valued, respected, and free from discrimination. As an equal opportunity employer, we welcome applications from all individuals and base hiring decisions on merit, skills, qualifications, and potential.