Data Engineer Lead - NatGas and Power
London, United Kingdom
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Gunvor Group
We move all forms of physical energy from where it is sourced to where it is demanded. Find our more about Gunvor Group and our global footprint.Job Title:
Data Engineer Lead - NatGas and PowerContract Type:
Time Type:
Job Description:
Reporting to the Head of Data, the Data Engineering Lead will oversee the design, development, and maintenance of high-performance data systems that support trading, risk, and analytics functions across the Natural Gas and Power business. This role bridges technical execution and business impact, ensuring that data pipelines, platforms, and products are robust, scalable, and aligned with enterprise data strategy.
The ideal candidate will lead a team of data engineers, collaborate with trading desks and analysts, and ensure that data infrastructure supports pre-trade modeling, live execution, and post-trade analytics with precision and reliability.
Main Responsibilities
1. Data Platform Ownership
Lead the development and maintenance of scalable data pipelines and databases tailored to Natural Gas and Power trading workflows.
Ensure seamless integration of internal and external data sources (e.g., market prices, fundamentals, grid data, weather feeds) into centralized platforms.
Deliver real-time, high-quality data to support trading decisions, risk management, and performance tracking.
2. Technical Leadership & Team Management
Manage and mentor a team of data engineers, fostering technical excellence and continuous learning.
Oversee code quality, architecture decisions, and deployment practices across the team.
Collaborate with the Global Head of Data to align engineering efforts with strategic priorities.
Lifecycle Management: Overseeing data enrichment, update, and deletion processes, and ensuring documentation in enterprise catalogs
3. Business Collaboration
Work closely with traders, quantitative analysts, and risk managers to understand data requirements and deliver fit-for-purpose solutions.
Translate business needs into technical specifications and ensure timely delivery of data products.
4. Data Quality & Governance
Implement monitoring systems to ensure data accuracy, completeness, and timeliness.
Support data governance initiatives, including metadata management, lineage tracking, and access controls.
Ensure compliance with regulatory standards (e.g., REMIT, EMIR) and internal audit requirements.
5. Innovation & Continuous Improvement
Evaluate and adopt new technologies (e.g., streaming platforms, time-series databases, ML pipelines) to enhance data capabilities.
Drive automation and optimization of data workflows to improve performance and reduce operational risk.
Contribute to the evolution of enterprise data architecture in collaboration with IT and analytics teams.
Profile
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related technical field.
+10 years of experience in data engineering, with at least 2 years in a leadership or senior technical role.
Proven experience in energy trading environments, particularly Natural Gas and Power markets.
Expert in Python and SQL; strong experience with data engineering libraries (e.g., Pandas, PySpark, Dask).
Deep knowledge of ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster).
Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions.
Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI , Plot.ly, matplotlib)
Programming
OOP
DevOps
Application development lifecycle
Web technologies
HTTP/S
HTML/Javascript
REST APIs
Authentication protocols
Data formats (CSV, JSON, XML, Parquet)
Experience with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing.
Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake).
Strong understanding of data governance, master data management, and data quality frameworks.
Excellent communication and stakeholder management skills.
Ability to mentor junior engineers and foster a collaborative team culture.
Fluent in English; any other language an asset
If you think the open position you see is right for you, we encourage you to apply!
Our people make all the difference in our success.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture Azure Computer Science CSV Dagster Data governance Data management Data pipelines Data quality Data strategy Data Warehousing DevOps ELT Engineering ETL InfluxDB JavaScript JSON Machine Learning Matplotlib OOP Open Source Pandas Parquet Pipelines Power BI PySpark Python Snowflake Spark SQL Streaming XML
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.