IT Data Engineering Manager

Job Description

The IT Data Engineering Manager will act as a pivotal role in furthering the data maturity of the Data & AI department through owning and delivering the data engineering roadmap. They will manage the Data Engineering team, providing best practice and specialised support to the team acting as an expert and consultant to deliver solutions which enable the business to deliver optimal value.
The IT Data Engineering Manager will be accountable for the end-to-end engineering lifecycle from ingestion to transformation to serving.
The IT Data Engineering Manager  will support with the development and optimisation of the environment and platforms to ensure continued growth and delivery of industry best practice

• Define and drive the data engineering strategy and best practices
• Oversee data platform architecture, ensuring scalability and reliability
• Manage and lead a team of data engineers
• Collaborate with architects, analysts, and business teams to align data solutions with business goals
• Own the data engineering roadmap for ‘Group Data’ ensuring delivery of demonstratable real value to Greene King
• Own the end-to-end data engineering lifecycle from data ingestion to data transformation to data serving for new data sources
• Support and input to the development and optimisation of data engineering tools / processes / environments
• Own the ongoing maintenance and optimisation of existing data pipelines
• Own the documentation of all existing and new data pipelines and processes
• Manage the testing of all deployed solutions to ensure all solutions are accurate and fault tolerant
• Ensure adherence to all regulation so that data engineering solutions and resulting business usage is compliant
• Act as a technical data steward to review and optimise the data quality across the central data platform
• Collaborate with the data architect(s) to deliver data solutions in line with overall strategy and principles
• Collaborate with the digital analytics team to understand the business requirements and needs to ensure data engineer solutions deliver the optimal business return
• Collaborate with the Business Intelligence and ETL teams to ensure alignment with data management and transformation logic while also avoiding duplication of effort / work
• Work with cross-functional teams including Retail IT, Operations and Business Units to understand requirements and data/system challenges
• Collaborate with the Business to understand the business challenges and opportunities and optimise the value that can delivered from Greene King’s data
• Understand and map data flows across the business and systems to identify opportunities to drive value
• Maintain and support up-to-date records of all system integrations, data flows, process maps, system diagrams, business rules and data models related to the data pipelines
• Collaborate with the data architect(s) and Cloud Engineering team to accurately estimate cloud service requirements and costs
• Proactively research latest developments and emerging trends in data engineering, AI and data science which apply to our industry

Qualifications

We’re all about rewarding our team’s hard work, that’s why…

You’ll receive a competitive salary, pension contribution as well as:

• The chance to further your career across our well-known brands – as one of the industry's top apprenticeship providers, we can provide training and development at each level of your career. 
• Discount of 33% for you and 15% for your loved ones on all of our brands – so you enjoy your favourite food and drink at a discount.
• Free employee assistance program – mental health, well-being, financial, and legal support because you matter!
• Discount of 50% for you and 25% for your loved ones at our Greene King Inns and hotels. – so you can enjoy a weekend away without breaking the bank.
• Refer a friend – who do you know who could be interested in a new role? When they are placed, you could earn up to £1,500 for referring them!
• Wage Stream – access your wage before payday for when life happens.
• Retail discounts – Receive up to 30% off at Superdrug, exclusive discounts with three mobile along with many more…

Additional Information

• Degree level qualification in a relevant subject e.g. mathematics, statistics, computer science etc.
• Best Practice knowledge and experience of Data Engineering standards and approaches
• Significant knowledge of data engineering processes - ELT / ETL, Batch, Streaming, API, Eventing, Pub/Sub etc
• Expert in SQL, Python and other coding languages
• Significant knowledge in Azure DevOps process
• Significant knowledge in Data Modelling (Dimension etc)
• Best Practice knowledge and experience of Lakehouse concepts and design
• Best Practice knowledge and experience of Databricks concepts and design
• Knowledge of Azure Cloud Infrastructure and Security
• Significant Experience with Delta/Iceberg Open Table Format
• Significant Experience with Data ingestion patterns and Data Engineering Frameworks
• Experience with troubleshooting via logs and building informative logging into pipelines
• Deep understanding of data as a product and its value in serving a company
• Team management experience, with a proven record of developing members team members
• Excellent written and verbal communication skills with the ability to effectively communicate complex and technical subject matter to non-specialists
• Experience in a fast-paced multi-brand industry
• Strong stakeholder management experience at various levels of an organisation
• Experience of the analysis of business challenges to define data requirements and process flows