Data Engineer

Data Engineer

Department: Data Services

Employment Type: Permanent - Full Time

Location: North West UK - Hybrid

Compensation: £45,000 - £50,000 / year

Description

We are seeking a Data Engineer to join our dynamic Data Services team. This role is critical to our ongoing projects and future initiatives. Our team is diverse, collaborative, and always eager to learn and improve. We are looking for someone with AWS experience who can contribute to our innovative projects and help us achieve our goals.

As part of our agile squad, you will be responsible for the delivery, maintenance, and support of various CDL products. Your key tasks will include providing support and feature enhancements in line with our product delivery roadmap. You will play a pivotal role in the development of innovative applications, ensuring they are reliable, cost-optimized, performant, supportable, secure, and sustainable.

About CDL
CDL is one of the UK’s leading software development houses, employing over 600 people at its campus in Stockport. It has a consistent history in the high-volume retail insurance sector. CDL has spearheaded developments in the aggregator, web and telematics space, including connected home, enrichment and self-service solutions. As a result, the company’s robust and innovative technologies have enabled its customers to thrive in the highly competitive UK insurance marketplace. We have built a collaborative and creative culture where we employ agile techniques to deliver our pace-setting applications. We pride ourselves on cultivating an inspiring working environment with our employees at the heart of our company.

In a nutshell we are the market leading software house in our industry, creating the software, websites & apps for the Insurance & Finance sector across the UK. If you were to go on a price comparison website, approximately 65% of the companies on there are our clients!

Why Join Us:

• Be part of a collaborative and supportive team that values diversity and inclusion.
• Work in a hybrid environment with the flexibility to work from home and the office.
• Engage in continual learning and professional development opportunities.
• Contribute to innovative projects that have a significant impact on the company's digital presence and customer engagement.

Key Responsibilities

• Develop and build out a new API to replace current legacy applications.
• Collaborate with team members to ensure effective communication and teamwork.
• Take technical ownership and maintain a keen awareness of industry and technology breakthroughs.
• Provide mentoring and coaching to junior team members.
• Work closely with the business analyst to understand and implement requirements.
• Attend sprint ceremonies and task planning.
• Operate with a continuous improvement mindset towards the products you look after.
• Maintain existing solutions and their automated pipelines that deliver high-quality, reliable, and fault-tolerant software/systems.
• Work on solutions that are automated, scalable, highly available, fault-tolerant, and aligned with all CDL's architectural pillars.
• Write, co-write, or review documentation.
• Be responsible for the entire lifecycle of your work: development, test, production, and subsequent fixes and improvements.

Skills Knowledge and Expertise

• Proven experience with AWS (EMR, Lambda, S3, Step Functions, Athena, API Gateway).
• Expertise using SQL.
• Experience using Python.
• Proven experience with Infrastructure-as-Code tools such as Terraform.
• Experience with automation pipelines and testing tools, such as Git/GitLab Pipelines/JMeter.
• Excellent communication skills and the ability to work well in a team.

Nice to Have:

• Experience in PySpark.
• Experience with Go.
• Building out ETL pipelines using data formats like CSV, Fixed Format, JSON, Parquet, XML.
• Experience with Karate.
• Developing CI/CD pipelines for automated testing and deployments.
• Experience with OpenAPI/Swagger.
• Experience with OpenSearch/Elasticsearch.
• Experience with transformation and orchestration tools such as DBT, Dagster and Glue.

Benefits

Salary

The salary for the role of Data Engineer pays up to £50,000p.a. providing a fantastic opportunity for career progression through CDL’s clearly defined career framework (https://progression.cdl.co.uk/).

Your growth and advancement within CDL are only limited by your own ambition and effort.

Benefits 

• Hybrid Working (2 Days a Week in the office - SK4 2HD)
• Truly flexible working.
• 25 days holiday to start, increasing by 1 day per 1 year of service up to 30 days.
• Top employer for 9th year running
• Excellent training and development platform
• Opportunities for career progression
• Health and Wellbeing programme
• Virtual activities, lunch and learns, coffee mornings and meetups.
• Life and health assurance
• Electric Vehicle Scheme
• Established Recognition Award System
• Great Parental Benefits
• Diversity and Inclusion network 
• Pension scheme
• Community projects and volunteer days 
• Refer a friend bonus 

Campus Benefits:

• On-site free parking
• Open plan modern offices
• Quiet Spaces are also available
• Shuttle bus to and from the station
• Subsidised restaurant
• Games room and chill out zone
• Annual Hackathon & Deep Racer Events
• Social activities, regular social events through our social group Xtra, including a summer BBQ, competitions, bowling, go-karting, football games, Winter party and much more!
• Car wash, barber, yoga classes, boot camp and massage services all on site
• Cycle to work scheme
• Shower and dry rooms

Diversity and inclusion
We’re on a journey to keep innovating, that means welcoming new ideas and ways of thinking.
 
CDL recognises that building a diverse workforce is critical to the success of our business. We strongly encourage applications from a diverse talent pool and  welcome the opportunity to discuss flexibility requirements and workplace  adjustments with all our applicants.