Senior Data Engineer
London, United Kingdom
EDF Trading
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
When you join EDF Trading you’ll become part of a diverse international team of experts who challenge conventional ideas, test new approaches and think outside the box.
Energy markets evolve rapidly so our team needs to remain agile, flexible and ready to spot opportunities across all the markets we trade in: power, gas, LNG, LPG, oil and environmental products.
EDF Group and our customers all over the world trust that their assets are managed by us in the most effective and efficient manner and are protected through expert risk management. Trading for over 20 years, it’s experience that makes us leaders in the field. Energy is what we do.
Most of all, we value our people. Become part of the team and you will be offered a great range of benefits which include hybrid working, a personal pension plan, private medical and dental insurance, bi-annual health assessment, corporate gym memberships, electric car lease programme, childcare vouchers, cycle to work scheme, season ticket loans, volunteering opportunities and much more. We even provide free fruit to keep you healthy.
Gender balance and inclusion are very high on the agenda at EDF Trading so you will become part of an ever-diversifying family of around 800 colleagues based in London, Paris, Singapore, Tokyo and Houston. Regular social and networking events, both physical and virtual, will ensure that you always feel connected to your colleagues and the business.
Who are we? We are EDF Trading, part of the EDF Group, a world leader in low-carbon sustainable electricity generation partnered with JERA, one of Japan’s largest utilities; the perfect organisation at which to begin or progress your career in the commodities sector.
Join us, make a difference and help shape the future of energy.
Job Description:
Department: Data Insights team
The Data Insights team plays a vital role in our organisation, transforming raw data into comprehensive and meaningful insights that can drive informed decision-making. Moreover the data insights team is responsible for establishing and maintaining robust and efficient data pipelines and data models that bring together all sources of data internal and external to EDFT into useful data products for the entire organisation. Those data products can be dashboards or enriched datasets used for further analysis by other teams.
Position purpose
We are looking for a visionary Senior Data Engineer to join our dynamic Data Insights team. This role is pivotal as we embark on a comprehensive data architecture review this year. The ideal candidate will bring thought leadership and hands on experience designing, implementing and optimizing data infrastructure so serve a dynamic fast-moving business.
Main responsibilities
- Build and optimise robust data pipelines, ensuring seamless integration into business processes.
- Take a leading yet collaborative role in our data architecture review, helping to define the roadmap and drive the execution.
- Provide thought leadership and strategic direction on modern data architecture and infrastructure. Including the ability to critique / weigh up merits of different technologies.
- Mentor and support the professional development of data engineers and analysts within the team.
- Design and implement scalable data models and processes to support our data needs.
- Manage an on prem and cloud-based data infrastructure and drive cloud migration initiatives where necessary and justified.
- Oversee data migration projects, ensuring accuracy, security, and minimal disruption.
- Work with big data processing technologies to handle and optimise large datasets.
- Enhance database management practices to ensure optimal performance and reliability.
- Collaborate with stakeholders across teams to align data strategy with business objectives.
Experience and technical requirements
- Strong Python and SQL experience is essential
- Proven track record of leading data team initiatives and architecture reviews.
- Hands-on experience with data modelling, migration, and database management.
- Extensive experience with cloud platforms (Azure required) and cloud migration projects.
- Hands-on experience with big data processing frameworks (e.g., Spark, Hadoop).
- Experience working with data orchestration tools; familiarity with Dagster is a bonus.
- Track record of mentoring team members, fostering a collaborative and growth-focused environment.
- Strong analytical, problem-solving, and project management skills.
- Experience with Docker and containers desirable
- Experience with data visualisation tools
Hours of work:
40 hours per week - Monday to Friday – Hybrid
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Azure Big Data Dagster Data pipelines Data strategy Docker Hadoop Pipelines Python Security Spark SQL
Perks/benefits: Career development Flex hours Health care Salary bonus Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.