Senior Data Engineer
London, England, United Kingdom
Mediabrands
The world has changed, so we have too. We’ve reengineered the very core of our business to guarantee we keep pace with a consumer that moves faster than ever before.WHO ARE WE:
We’re Mediahub, the industry’s best-kept secret. This year we got our first Campaign School Report, coming in at number one for building the most ethnically diverse team in the industry.
COMvergence rank us as the UK's fastest-growing media agency for the second year running.
We bring a challenger mindset to everything we do. Brands choose to work with us to disrupt category norms.
We offer the best of both worlds. A start-up culture backed by Mediabrands.
Just some of the brands we work with – New Balance, Pinterest, Celebrity Cruises.
Role Overview:
As a Senior Data Engineer, you will lead the design, development, and optimisation of data pipelines and systems, ensuring scalability, reliability, and performance. This role involves managing Python-based development projects, automating workflows, and creating frameworks that empower analytics and data science teams. You will collaborate across teams, mentor junior engineers, and take ownership of key initiatives, including infrastructure migration and the development of analytics solutions.
This position is ideal for an experienced data engineer with a passion for innovation, problem-solving, and delivering impactful data-driven solutions.
Key Responsibilities:
Python Development and CI/CD Practices:
- Collaborate on Python-based projects, ensuring adherence to best coding practices and standards.
- Implement and manage CI/CD pipelines to streamline development workflows and support scalable systems.
- Utilise Git/GitHub for version control and team collaboration, promoting efficient development processes.
Data Pipeline Design and Optimisation:
- Design, build, and optimise data pipelines within Databricks and MySQL Warehouse to meet client, analyst, and data scientist needs.
- Leverage PySpark to enable high-performance data processing and analytics at scale.
Automation and Standardisation:
- Champion automation-first solutions to solve complex challenges, including integrating machine learning models and developing bespoke tools.
- Create and maintain Python packages to standardise systems across projects, reducing redundancy and enhancing scalability.
Quality Assurance and Debugging:
- Establish comprehensive QA systems to enforce data integrity and streamline debugging processes across pipelines and projects.
Project Leadership and Team Management:
- Take ownership of multiple concurrent projects, managing priorities, client expectations, and technical challenges.
- Mentor and guide junior engineers and analysts, fostering professional growth and technical excellence within the team.
Stakeholder Management and Communication:
- Effectively communicate technical and project updates with stakeholders, ensuring clarity and alignment across all initiatives.
- Coordinate efforts between internal teams (data infrastructure and internal tools) and external clients (analytics and measurement frameworks).
Experience & Skills Required:
- Technical Expertise: Proficient in Python, PySpark, and SQL, with experience in CI/CD pipelines and version control using Git/GitHub.
- Data Engineering: Strong background in designing and optimising data pipelines within Databricks and MySQL Warehouse.
- Automation: Proven ability to develop scalable, reusable Python packages to enhance efficiency and standardisation across projects.
- Data Analytics and Reporting: Skilled in creating insights dashboards using Google Data Studio and Power BI, and conducting correlation analysis.
- Infrastructure Migration: Experience leading large-scale infrastructure migration projects, particularly within cloud-based environments like Databricks.
- Media and AdTech Ecosystems: Familiarity with media adtech platforms, ecosystems, and measurement frameworks.
- Communication and Leadership: Strong verbal and written communication skills, with experience mentoring team members and managing stakeholder relationships.
- Project Management: Ability to manage complex projects, prioritising tasks and delivering high-quality results under tight deadlines.
Ideal Candidate Profile
We are seeking a skilled and motivated Senior Data Engineer with a proven track record of delivering innovative data solutions. The ideal candidate will thrive in a collaborative and dynamic environment, bringing technical excellence, leadership, and a passion for driving impactful change through data engineering. If you are ready to lead transformative projects and mentor a growing team, we would love to hear from you.
Employee Transparency
At IPG Mediabrands, we celebrate differences and believe this makes us stronger. IPG Mediabrands are equal-opportunity employers committed to championing an inclusive culture that provides a sense of belonging for all our employees. We do not discriminate against any applicant based on age, disability, race, colour, ethnicity, national origin, gender, sexual orientation, gender identity, religion, belief, marital status or any other characteristic protected by law.
Please reach out to our Talent Inclusion Specialist Jess at Jess.Richardson@mbww.com if you would like to have a confidential conversation regarding any adjustments that would ensure our recruitment process is accessible for you. Please note requesting a reasonable adjustment will not affect your application.
The Perks
We aim to provide all our people with a supportive and fun work environment where you can develop your full potential and benefit from the broad range of opportunities within the agency. When you join us, we want to make sure you feel valued – and that you are rewarded for your fantastic work. So, we also offer a range of benefits:
- Flexi–leave, with 25 days annual leave to be taken as minimum. In addition to your holiday entitlement, the office usually closes between Christmas & New Year
- Free breakfast and free lunch
- Early finish Fridays
- Core Hours (Mon-Thurs, flexible start/finish times)
- Retail discounts
- Wellbeing programme
- Interest free season ticket loan
- Paid time off for Volunteering
- Group Income Protection
- Life Assurance
- Private Medical Insurance or Health Cash Plan (dependent on level)
- Group Personal Pension Plan with matched contributions from 3-6%
- Generous Parental Leave & Pay
- Independent mortgage advice
- Financial education
- Employee Assistance Programme
- Free eye tests
- Flexible benefits including Dental, Travel insurance, Cycle to Work, Gym Discounts and many more!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: CI/CD Data Analytics Databricks Data pipelines Data Studio Engineering Git GitHub Machine Learning ML models MySQL Pipelines Power BI PySpark Python SQL
Perks/benefits: Career development Flex hours Flex vacation Health care Insurance Medical leave Parental leave Startup environment Transparency
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.