Data Engineering Specialist

Why this job matters

Our ability to deliver brilliant personalised experiences for all of our 28 Petabytes of BT wealth of data and 30m customers is fundamental to our future success. As a business we are investing extensively in the automation of our operations and networks, and in building our base management and data capabilities. This will allow us to take better decisions with data and to act on them in an automated way across all our customer interactions.

Data driven automation and decision making has never been more important to BT. We’re creating the best personal experiences for our customers to help them stay connected, and that mission is all underpinned by high quality, low latency data. This role will play a critical part in the creation and be part of BT Digital build data pipelines, data systems and the data products built on top.

As part of a team of highly skilled data engineers, you will create and maintain our  logical data models, integrating data from multiple data sources into a central cloud repository. You will apply data cleansing and data standardisation rules, providing clear documentation of the business rules embedded in the system, with the potential of solving data quality issues through your team. You will work closely with the wider team to understand what the data journey needs to look like and work closely with the Data Architect team, Data scientists and AI team to develop our products and services. You will write and maintain data engineering user documentation to provide transparency and maintain the knowledge base within the team

What you’ll be doing

1.Drives the design, coding, unit testing, and deployment of data processes'for ingestion and transformation of data while keeping data security and privacy in mind.
2.Leads the development of architecture and design patterns to process and store high volume data sets.
3.Leads key projects using advanced technical knowledge to drive new solutions to large, open-ended problems that may be ambiguous or lacking clear precedent.
4.Drives the use of best practices and delivery in an Agile process that consistently delivers a quality product for the organisation.
5.Drives the use of new or existing data to define key indicators to provide visibility into the quality of the BT Group's data, pipelines, and infrastructure.
6.Implements complex initiatives and projects, translating objectives into a scalable solution that meets end customers' needs within deadlines.
7.Mentors other data engineers, helping to improve the team's abilities by acting as a technical resource.
8.Champions, continuously develops and shares with team knowledge on emerging trends and changes in data engineering.

You'll have the following skills & experience

Essential skills & experience

• Deep technical knowledge of complex (and simple) data architectures, covering all aspects (compliance, risk, security) of our requirements
• Detailed knowledge of the concepts and principles of data engineering
• Sound awareness of Data Management best practice, including data lifecycle management
• Extensive skills in SQL, both at production grade and at analytical level, gained through intensive application in a commercial business environment
• Can deliver complex big data solutions with structured and unstructured data
• Excellent oral and written communication skills for all levels of an organisation
• Collaborate to identify how work activities across the teams are related and highlight inefficiencies. You help to remove barriers and find the resources or support needed to improve processes
• Some knowledge of Cloud Computing patterns, workflows and services; and how they relate to a big data platform.
• Advanced math skills (linear algebra, Baysesian statistics, group theory)
• Background in machine learning & software engineering frameworks such as TensorFlow or Keras

Desirable skills & experience

• Experienced in deploying data solutions and cloud infrastructure via CI/CD pipelines
• Experienced in deploying Infrastructure as Code (Terraform / Cloudformation etc)
• Knowledge of REST/Graph APIs and how they can be used in a data environment.
• Knowledge of Docker/Kubernetes, and how these can be used to simplify deployments.
• Experience of building large scale data pipelines on at least one Cloud Platform (GCP and AWS preferred)
• Solid Python data and development experience with major SDK’s / packages.

Our leadership standards

Looking in:
Leading inclusively and Safely
I inspire and build trust through self-awareness, honesty and integrity.
Owning outcomes
I take the right decisions that benefit the broader organisation.

Looking out:
Delivering for the customer
I execute brilliantly on clear priorities that add value to our customers and the wider business.
Commercially savvy
I demonstrate strong commercial focus, bringing an external perspective to decision-making.

Looking to the future:
Growth mindset
I experiment and identify opportunities for growth for both myself and the organisation.
Building for the future
I build diverse future-ready teams where all individuals can be at their best.

About us

BT is part of BT Group, along with EE, Openreach, and Plusnet.

Millions of people rely on us every day to help them live their lives, power their businesses, and keep their public services running. We connect friends to family, clients to colleagues, people to possibilities. We keep the wheels of business spinning, and the emergency services responding. 

We value diversity and celebrate difference. ‘We embed diversity and inclusion into everything that we do. It’s fundamental to our purpose: we connect for good.’

We all stick to the same values: Personal, Simple, and Brilliant. From day one, you’ll get stuck in to tough challenges, pitch in with ideas, make things happen. But you won’t be alone: we’ll be there with help and support, learning and development.  

This is your chance to make a real difference to the world: to be part of the digital transformation of countless lives and businesses. Grab it.

A FEW POINTS TO NOTE:

Although these roles are listed as full-time, if you’re a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch.

DON'T MEET EVERY SINGLE REQUIREMENT?

Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.