Senior Data Engineer

🌍 London, Hybrid

⭐️ Our Perks

• Personalised Learning and Development Budget
• Hybrid working hours – Each team has their own Smart Working Charter that empowers you to do your work in the best way you can
• 25 Holiday Days + your local bank holidays
• 1 Birthday day – it only happens once a year!
• 3 So Giving Days - spend these days giving back to your chosen cause
• Religious Celebrations Leave
•  Mental Healthcare – Sessions with Unmind
• Enhanced Family Leave

🤝Values-driven culture – we’re really proud of our culture.

So Energy

Who we are:

So Energy was created in 2015 because we knew energy suppliers could be better. Since then, we’ve grown rapidly but sustainably, with 300,000 customers and over 450 Energists (what we call our people). But we’re not done. We’re on the road to a net zero future, and thanks to our partnership with ESB, we’re well on the way. We’re customer-centric, tech-led, and passionate about sustainability.

We want to do the best we can for our customers, each other, and our planet, so we’ve created a workplace that's encouraging, supportive, and offers the opportunity for growth. As a company, we live by six core values that guide everything we do:

• Clear
• Honest
• Ambitious
• Inquisitive
• Caring
• Sustainable

The Role

Senior Data Engineer at SO ENERGY

As a Senior Data Engineer, you will play a key role in the development and maintenance of our data infrastructure, ensuring efficient and scalable data pipelines. You will be responsible for hands-on implementation and optimization of data systems on the Google Cloud Platform (GCP), contributing to critical projects while mentoring junior Engineers. This role focuses on delivering technical solutions, applying best practices, and driving innovation within the data engineering team.

Reporting into our Interim Head of Data, Nethin Maharaj 👋

What you’ll be getting up to:

• Design, develop, and maintain scalable data pipelines using modern data engineering tools and technologies on our GCP stack.
  
• Build and optimize our lake house on Google Cloud Platform (GCP).
  
• Implement data ingestion, transformation, and loading processes for various data sources (e.g., databases, APIs, cloud storage).
  
• Ensure data quality, consistency, and security throughout the data pipeline.
  
• Leverage GCP services (e.g., Dataflow, Dataproc, BigQuery, Cloud Storage) to build and maintain cloud-native data solutions.
  
• Implement infrastructure as code (IaC) principles using Terraform to automate provisioning and configuration.
  
• Manage and optimize cloud resources to ensure cost-efficiency and performance.
  
• Design and implement efficient data models following a star schema approach to support analytical and operational workloads.
  
• Collaborate with data analysts to develop advanced analytics solutions.
  
• Conduct data quality analysis to drive better data management on outputs in our Curated Layer.
  
• Mentor junior data engineers and provide technical guidance.
  
• Contribute to the development of data engineering best practices and standards.
  
• Collaborate with cross-functional teams to deliver complex data projects.

This role will be a great fit if:

• Expert in GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage, and Cloud Functions. GCP Professional Data Engineer Certification is highly favourable.
• Advanced knowledge of SQL for complex data transformation and query optimization.
• Proven experience in Python for scalable data pipeline development and orchestration following best practices.
• Experience implementing Terraform for Infrastructure as Code (IaC) to automate GCP resource management.
• Knowledge of CI/CD pipelines and automated deployment practices.
• Experience with containerization technologies (e.g., Docker, Kubernetes)
• Experience building and optimizing batch and streaming data pipelines.
• Understanding of data governance principles, GCP security (IAM, VPC), and compliance requirements.
  
• Demonstrates a growth mindset by actively seeking to learn from peers and stakeholders, fostering a culture of open communication and shared knowledge.
• Works effectively across teams, including Data Science, Engineering, and Analytics, to understand their needs and deliver impactful data solutions.
• Actively participates in design discussions, brainstorming sessions, and cross-functional projects, always striving for continuous improvement and innovation.
• Builds strong relationships across the organization, using empathy and active listening to ensure alignment on goals and deliverables.
• Approaches challenges with a growth mindset, viewing obstacles as opportunities to innovate and improve processes.
• Applies a structured and analytical approach to solving complex problems, balancing immediate needs with long-term scalability and efficiency.
• Demonstrates resilience under pressure, maintaining a positive and solution-focused attitude when faced with tight deadlines or ambiguity.
• Actively seeks feedback and lessons learned from past projects to continuously refine problem-solving strategies and improve outcomes.
• Shares expertise generously, guiding team members in adopting best practices and helping them overcome technical challenges.
• Leads by example, demonstrating how to approach complex problems pragmatically while promoting curiosity and a willingness to explore new tools and technologies.

Research shows that some people are less likely to apply for a role unless they are 100% qualified. Your experience, skills and passion will set you apart so tell us about your achievements, irrespective of whether they are personal or work-related, tell us about your journey, and about what you learnt.

So, if this role excites you, don’t let our role description hold you back, get applying!

APPLICATIONS CLOSE ON 05 JUNE 2025

Hiring Process

1. 📞 30 minute Phone Screening with the Talent Team
   
2. First Stage interview with Head of Data & BI Lead 
   
3. Second Stage interview with Staff Data Engineer & Data Engineer - Technical exercise
4.  Final Stage Cultural fit interview with Tech Director and People Partner 

Support – If you have a medical condition or an individual need for an adjustment to our process, and you believe this may affect your ability to be at your best – please let us know so we can talk about how we can best support you and make any adjustments that may be needed.

Our Values

We look for people who share our values and can add to our culture. Values are shared beliefs that guide our decision-making, culture is how we function as a group and how we live our values as individuals.

Clear - The energy industry can be pretty complex so we strive to provide clear communication to our customers and colleagues

Honest - Transparency is key, Whether that's providing clear bills to our customers or trusting our staff to do the right thing.

Ambitious - All of us are ambitious about the future of So Energy and what we can contribute to it.

Inquisitive - We are also questioning the Status Quo to see if there is a better way to do things for our customers

Caring - We care about the work we are doing, our customers and our colleagues
Sustainable - As a renewable energy company we are providing sustainable products but we also care about sustainable careers. That's why learning and continuous development is so important to us.

Diversity, Equity, Inclusion & Belonging

At So Energy, we’re committed to cultivating an environment that promotes diversity, equity, inclusion and belonging. We are a global community and we believe our unique qualities should be celebrated as they are critical to our innovation. It’s essential to us that you bring your authentic self to work every single day, no matter your age, ethnicity, religion, citizenship, gender identity, sexual orientation, disability status, caring responsibilities, neurodiversity, or otherwise. Inclusion isn’t just an initiative at So Energy. We strive to embed it not just into our values but throughout our entire culture.