Data Engineer

About Us

We are Data Services, our mission is to unlock the value of data by delivering high-quality, reliable, and secure data services that are accessible, understandable, and actionable. We continuously evolve our offerings, leveraging modern cloud-based technologies, and fostering strong partnerships to help our colleagues in the Bank navigate the complexities of a data-driven world and achieve their strategic objectives.

Job Description

The world of data in Central Banking is evolving rapidly. With the rise of detailed data collection in financial regulation and the swift advancements in cloud-native data technologies, the demand for skilled data engineers is growing. We’re on the lookout for a mid-level Data Engineer to join our Data Engineering team. In this role, you'll help design, build, and support data pipelines on the Bank’s strategic cloud-first data platform! Your work will play a crucial role in supporting the Bank’s core responsibilities around monetary policy, financial stability, and regulatory supervision.

Role Requirements

• Design, develop, test, and deploy scalable, cost-effective, and secure distributed architectures using Azure services such as Azure Databricks and Azure Data Lake Storage.
• Use Databricks to ingest, transform, and load data into modern data platforms.
• Write efficient, scalable code using Python and PySpark, optimizing for performance in Azure Databricks and on-premise systems where applicable.
• Ensure data is fit-for-purpose, accurate, and available in a timely manner for business intelligence, analytics, and operational use cases.
• Monitor and optimize existing data pipelines, both cloud-native and legacy, to enhance performance, reliability, and maintainability, while minimizing impact on business operations.
• Prototype and implement modern data engineering approaches using Azure-native tools and Delta Lake, contributing to a culture of innovation and continuous improvement.
• Mentor and guide junior engineers, sharing expertise in data engineering best practices, particularly in Azure and distributed data processing using Spark.
• Work closely with business users and analysts to translate requirements into scalable data solutions using both cloud and on-prem components.
• Stay informed of emerging technologies and trends in data engineering, particularly within the Azure ecosystem and Databricks platform.
• Lead and contribute to the migration of existing data infrastructure to Azure, ensuring smooth transitions, minimal disruption, and long-term scalability.
• Collaborate cross-functionally with architects, analysts, and stakeholders to align on data strategy and ensure the interoperability of Azure-based and legacy systems.

Minimum Criteria

• Experience with Azure services such as Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
• Expertise in SQL.
• Experience using Python and Spark.
• Experience using CI/CD methodology with industry-standard tools.

Essential Criteria 

• Work with testing team to ensure pipelines are tested thoroughly.
• Linux or Unix navigation skills.
• Understanding of standard methodologies for development and use of source control, preferably experience with Git.
• Self-driven with a passion for learning new technologies and skills.

Desirable Criteria

• Experience delivering data pipelines on Hortonworks/Cloudera on-prem.
• Familiarity with:
  • Apache Airflow and Atlas
  • Cloudera Manager
  • Migration of existing platform to cloud
  • Data modelling

Our Approach to Inclusion

The Bank values diversity, equity and inclusion. We play a key role in maintaining monetary and financial stability, and to do that effectively, we believe we need a workforce that reflects the society we serve. 

At the Bank of England, we want all colleagues to feel valued and respected, so we're working hard to build an inclusive culture which supports people from all backgrounds and communities to be at their best at work. We celebrate all forms of diversity, including (but not limited to) age, disability, ethnicity, gender, gender identity, race, religion, sexual orientation and socioeconomic status. We believe that it’s by drawing on different perspectives and experiences that we’ll continue to make the best decisions for the public.

We welcome applications from individuals who work flexibly, including job shares and part time working patterns. We've also partnered with external organisations to support us in making adjustments for candidates and employees in the recruitment process where they're needed.

For most roles where work can be carried out at home, we aim for colleagues to spend half of their time in the office, with a minimum of 40% per month.  Subject to that minimum requirement, individuals and managers should work together to find what works best for them, their team and stakeholders.

Finally, we're proud to be a member of the Disability Confident Scheme. If you wish to apply under this scheme, you should check the box in the ‘Candidate Personal Information’ under the ‘Disability Confident Scheme’ section of the application.

Salary and Benefits Information

We encourage flexible working, part time working and job share arrangements.  Part time salary and benefits will be on a pro-rated basis as appropriate.

We offer a salary as follows:

Leeds circa £40,320 - £45,360

In addition, we also offer a comprehensive benefits package as detailed below:

• A non-contributory, career average pension giving you a guaranteed retirement benefit of 1/95th of your annual salary for every year worked. There is the option to increase your pension (to 1/50th) or decrease (to 1/120th) in exchange for salary through our flexible benefits programme each year.
• A discretionary performance award based on a current award pool.
• A 8% benefits allowance with the option to take as salary or purchase a wide range of flexible benefits.   
• 26 days’ annual leave with option to buy up to 12 additional days through flexible benefits. 
• Private medical insurance and income protection.

National Security Vetting Process

Employment in this role will be subject to the National Security Vetting clearance process (and typically can take between 6 to 12 weeks post offer) and the passing of additional Bank security checks in accordance with the Bank policy.  Further information regarding the vetting and security clearance requirements for the role will be provided to the successful applicant, and information about how the Bank processes personal data for these purposes, is set out in the Bank's Privacy Notice.

The Bank of England welcomes applications from all candidates, but as a UK Visas and Immigration (UKVI) approved sponsor, we have a responsibility to comply with the Immigration Rules and guidance.  As such, our ability to employ individuals who require sponsorship for immigration purposes is limited.  The Bank cannot guarantee that you and / or the role you are applying for will be eligible for sponsorship and that any application made to UKVI will be successful.  Eligibility will therefore be considered on a case by case basis.

The Application Process

Important: Please ensure that you complete the ‘work history’ section and answer ALL the application questions fully. All candidate applications are anonymised to ensure that our hiring managers will not be able to see your personal information, including your CV, when reviewing your application details at the screening stage. It’s therefore really important that you fill out the work history and application form questions, as your answers will form a critical part of the initial selection process.

This role closes on 22 May 2025. 

The assessment process will comprise of two interview stages.  

Please apply online, ensuring that you complete your work history and answer ALL the application questions fully and in detail as your application will not be considered if all mandatory questions are not fully completed.

We are the UK's central bank - and we are a bank like no other; known by our peers for our world-leading thinking on policy and strategy.   Our mission is to promote the good of the people of the UK by maintaining monetary and financial stability. We seek to keep prices stable and people's money safe. We know our work matters to people, to families, up and down the UK. We are driven by curiosity and the desire to do important, challenging work.    It takes a great team to run the Bank of England. We rely on each other to play our part. We benefit from a collaborative culture and long-established flexible ways of working, supporting our colleagues balance their work and personal lives. We strive to be a place where people feel they belong and have equal access to opportunities, because different perspectives helps us make the best decisions for the public.   There's much to gain from working with us - from career defining work at the heart of the UK economy, being part of a fantastic team, and a rewarding compensation package.    Join us and find a bank like no other. Together, we can make a difference.
The Bank of England will use and protect the information you provide when you apply for a role with us, in line with our obligations under data protection law.  This is so we can assess your suitability for the role and administer your application. If you’re successful we’ll use it to offer you a position and onboard you to join the Bank.
If you would like more details about how your information will be used and your information rights, please visit our recruitment privacy notice