Senior Data Engineer
London, United Kingdom
Octopus
Innovative, entrepreneurial businesses investing in the people, ideas and industries that will help to change the world - Octopus Group.Company Description
At Octopus, we’re entrepreneurs and we’re investors, on a mission to back the people, ideas and industries that will change the world.
We think working here is great, but we’re understandably bias. Click here to explore Life at Octopus.
Job Description
What’s in it for you?
This is a hands on, busy role where you’ll be able to utilise your skills and experience whilst also driving efficiencies, designing and implementing models for reporting and analysis, and working across a variety of projects. We look for those with an entrepreneurial spirit and the culture here allows those with creativity to flourish.
The team:
You will join the data engineering team, reporting into the head of data engineering. The team consists of 6 developers with extensive experience in data processing, storage, and analysis. They manage the central data warehouse and offer data engineering expertise across various business projects, including data migration, cleansing, analysis, and reporting. There’s a real focus on collaboration, knowledge sharing and feedback to support the growth of the team and drive impact for our stakeholders.
What will you be doing?
- You will play a key part in transforming Octopus to a data-driven organization. Demonstrating a passion for data and finding interesting ways to innovate data development, you’ll be responsible for the development of pipelines to ingest data from various source systems and third parties, the data is extracted through different techniques including API, Change Tracking, Message Queues, Files etc. We use StreamSets and Azure Data Factory for data ingestion.
- Optimize performance and storage of the data in the Data Warehouse and other operational databases. The data warehouse is an Azure Synapse Instance, and the operational database are on Azure SQL and MySQL instances.
- Be part of various projects across software development, and data migration with active involvement in database design and migration.
Qualifications
Ideally, you’ll have
✅ Knowledge in writing complex SQL and ability to analyse data, and experience in migration of data across various systems.
✅ You can work with data in various data formats including database, parquet files, hierarchical json/xml, delimited files and excel.
✅ A track record of designing and implementing complex modern data warehouse solutions.
✅ Good knowledge in working with various Rest API protocols.
✅ Excellent communication skills to capture requirements, manage relationships with stakeholders and articulate the solution.
We encourage you to apply even if you don’t tick every box. What’s the worst that can happen?
This role will evolve as we grow and develop. So, if you are looking for a challenge in a fast paced and dynamic business, we can deliver on that.
Additional Information
What we offer
💰 A competitive salary, bonus, pension and share incentive plan
✈️ Take what you need holiday
🏡 Flexible working - We do 3 days in the office, 2 days remotely
⚓ Anchor (our wellness hub) which includes Headspace, one to one coaching through Sanctus, Parent Cloud, Digital GP, Shout & more
👪 Enhanced family leave policies
❤️ Life insurance, critical illness cover and income protection
🏥 Private medical insurance for you and your family
🚗 Electric vehicle leasing
🌍 The option to work overseas up to a month per year
Our Values
At Octopus we don’t just focus on what we do but also how we do it. Everyone shares our values of being straightforward, helpful and bold.
We’re committed to creating a diverse and inclusive employee experience for all. We promote equal opportunities for growth and development regardless of race, gender, religion, sexual orientation, age, disability, or socio-economic background. We believe strongly that teams are at their best when every member of the team feels safe to bring their whole self to work.
Our Values
At our core, we believe that how a company behaves is just as important as what it does. That’s why we chose to become an accredited B Corp (the equivalent of a Fairtrade coffee stamp but for companies) and to change our Articles of Association so that the interests all our stakeholders – employees, customers, communities, environment and shareholders – are considered in every decision we make.
We are committed to building a workplace where diversity is valued, and inclusion is a priority. By providing equal opportunities for growth and development, we embrace and celebrate all races, genders, religions, sexual orientations, ages, disabilities, and socio-economic backgrounds. We believe teams achieve their best when every member feels safe, respected and empowered to be their authentic selves.
We're proud to be disability confident and are committed to supporting candidates with a disability, including neurodiversity and mental health conditions, throughout the recruitment process. Applicants are welcome to opt-in to the disability confident scheme as part of our application process. If you require any adjustments to the interview process, we’ll be happy to accommodate where possible.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Azure Data warehouse Engineering Excel JSON MySQL Parquet Pipelines REST API SQL XML
Perks/benefits: Competitive pay Flex hours Health care Insurance Medical leave Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.