Junior Data Engineer (hybrid)

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Your role in the team

We are looking for a motivated and detail-oriented Data Engineer to join our dynamic data and analytics team. In this role, you will work closely with data analysts, data consultants, and with data engineers from other organizations to build, maintain, and optimize data pipelines, ensuring that the ATSC’s (Allstate Technical Support Centre) data infrastructure is scalable, reliable, and efficient. This is an excellent opportunity for someone with a strong foundation in data engineering, eager to learn and grow in the field.

As a Data Engineer, you will have the opportunity to work with cutting-edge technologies in cloud computing, big data frameworks, and ETL processes. You will play a key role in transforming raw data into actionable insights and building the backbone for data-driven decision-making across the organization.

Key Responsibilities

• Assist in the design, development, and maintenance of ETL (Extract, Transform, Load) pipelines for efficient data processing and integration from multiple sources.
• Work with both relational and NoSQL databases to manage, optimize, and query data for performance and scalability.
• Ensure data integrity, quality, and consistency across systems, performing routine checks and monitoring data flows.
• Collaborate with data consultants, analysts, and other stakeholders to ensure data is available, accurate, and accessible for various business needs.
• Support the implementation of cloud-based data storage and processing solutions using platforms such as AWS or Azure.
• Assist in automating repetitive data tasks and optimizing existing workflows to improve data delivery and processing times.
• Troubleshoot issues related to data pipelines, databases, and data quality, providing solutions, or escalating to senior engineers as needed.
• Document data engineering processes, workflows, and technical specifications to maintain clear records and improve knowledge sharing within the team.

Essential Skills

• All candidates must demonstrate they have a legal right to work in the UK for employment at Allstate. Allstate is not providing sponsorship for this vacancy.
• Basic understanding of data modeling concepts, including normalization, denormalization, and schema design.
• Experience with Extract, Transform, Load (ETL) processes, including using tools like Microsoft SSIS
• Experience of using and maintaining databases (e.g., SQL, Oracle, MongoDB)
• Experience with data warehousing solutions and big data technologies and cloud platforms (Apache Spark, and Apache Kafka, AWS, Dremio)
• Strong programming skills in Python, PySpark, SQL, and Shell Scripting.
• Experience cleaning and transforming raw data into usable formats.
• Experience integrating data through APIs for data ingestion or interaction with other data sources.
• Understanding data quality standards and how to ensure that data pipelines produce accurate and reliable data.
• Experience debugging data pipeline issues, data integrity problems, and performance bottlenecks.

Desirable Skills

• Familiarity with data visualization tools (e.g., Tableau, Power BI) for presenting insights.
• Experience with CI/CD (Continuous Integration/Continuous Deployment) workflows and automation tools like Jenkins.
• Basic knowledge of Microsoft Fabric

Posting End Date- Tuesday 31st December 2024

#LI-Hybrid

#LI-MM1

Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.  

You’ll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we’ve proven that Allstate empowers everyone to lead, drive change and give back where they work and live. 

Good Hands. Greater Together.

What we offer

As Digital DNA’s Workplace of the Year 2020 & 2022 winners, we offer a generous benefits package that includes flexible annual leave entitlement, dental and healthcare insurance, an attractive pension package and discounts on gym memberships, public transport and parking. 

Allstate invests heavily in your development, as an employee you will have access to multiple world-class learning platforms and courses from our award-winning in-house Learning & Development team. 

We pride ourselves in providing clear career paths and opportunities for internal mobility allowing you to further develop within the organisation. 

We encourage a better work life balance and you’ll have the opportunity to apply for various flexible working arrangements.

Statement on Fair Employment and Equal Opportunities

Allstate NI wishes to ensure equal opportunity is given to all job applicants.  This company will not discriminate on the grounds of race, gender (including gender reassignment status), sexual orientation, religious belief, political opinion, marital status, age or disability.

We are an equal opportunities employer. We welcome applications from all suitably qualified persons. However, as women are currently under-represented in our workforce, we would particularly welcome applications from women. All appointments will be made on merit. 

Applicants should note Allstate NI complete AccessNI background checks on all candidates offered a position.

Posting End Date:

31 December 2024