Senior Data Engineer(Python)
London, England, United Kingdom
GroupM
GroupM is the world’s leading media investment company. We make advertising work better for people.About WPP Media
WPP is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients and communities. For more information, visit wpp.com.
WPP Media is WPP’s global media collective. In a world where media is everywhere and in everything, we bring the best platform, people, and partners together to create limitless opportunities for growth. For more information, visit wppmedia.com
About Choreograph: A Leading WPP Media Brand
Choreograph is WPP’s global data products and technology company. We’re on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation.
We work with agencies and clients to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising.
We’re endlessly curious. Our team of thinkers, builders, creators and problem solvers are over 1,000 strong, across 20 markets around the world.
Role Summary and Impact
Our team consists of 100+ engineers, designers, data, and product people, working in small inter-disciplinary teams closely with creative agencies, media agencies, and with our customers, to develop and scale our DCO platform, a leading digital advertising optimization suite that delivers amazing outcomes for brands and audiences.
As a Data Engineer you will work with our Product and Engineering team, as well as other feature development teams, to build, deliver and operate our data platform. The role is a hands on data engineering role, analysing and sourcing data for our teams to use, building and maintaining pipelines and automations to wrangle, cleanse, secure, govern and provide that data to teams, building automations, owning tests, supporting junior engineers, and contributing to the wider team principles and practices, and the tools we use. The role has no line management responsibilities.
Our data platform is built with Python and Airflow, deployed using CI/CD, heavily exploits automations, and runs on AWS, GCP, k8s, Snowflake and more. Our efforts in data engineering support our adserving platform which serves 9 petabytes and 77 billion objects annually, which amounts to 20 billion ad impressions across the globe. You’ll play a leading role in significantly scaling this further.
Responsibilities:
- Work with product, product engineering, data engineering, and data science peers to build and support our AdTech platform.
- Architect and build data-oriented solutions that are simple, scalable, reliable, secure, maintainable, and make a measurable impact.
- Provide our teams with the data they need to build, sell, and manage our platform. Develop, deliver and maintain batch and real-time data pipelines, analysis services, workflows and orchestrations, and create and manage the platforms and data infrastructure that hold, secure, cleanse and validate, govern, and manage our data.
- Manage our data platform, incorporating services using Airflow/Composer, BigQuery, Snowflake, Kafka, and Redis running on Kubernetes, GCP, and AWS.
- Support our Data Science teams with access to data, performing code reviews, aiding model evaluation and testing, deploying models, and supporting their execution.
- Employ modern pragmatic engineering principles, practices, and tooling, including TDD/BDD/ATDD, XP, QA Engineering, Trunk Based Development, Continuous Delivery, automation, DevSecOps, and Site Reliability Engineering.
- Contribute to driving ongoing improvements to our engineering principles, practices, and tooling. Provide support & mentorship to junior engineers.
- Develop and maintain a contemporary understanding of AdTech developments, industry standards, partner and competitor platform developments, and commercial models, from an engineering perspective.
Skills and Experience
At WPP Media, we believe in the power of our culture and our people. It’s what elevates us to deliver exceptional experiences for both our clients and each other. In this role it will be critical to embrace WPP & WPP Media’s shared core values:
- Be Extraordinary by Leading Collectively to Inspire transformational Creativity.
- Create an Open environment by Balancing People and Client Experiences by Cultivating Trust.
- Lead Optimistically by Championing Growth and Development to Mobilize the Enterprise.
- Proven experience designing, building, and operating data-oriented solutions in a high volume, transactional, global, industry. Experience with advertising technology (AdTech) highly desired.
- Proven experience and a passion for developing and operating data-oriented solutions using Python, Airflow/Composer, Kafka, Snowflake, BigQuery, and a mix of data platforms such as Spark, AWS Athena, Postgres and Redis. Excellent SQL development, query optimization and data pipeline development skills required. Strong experience using public cloud platforms including AWS and GCP is required; experience with docker and Kubernetes strongly preferred. Experience in the use of multiple programming languages is highly desirable. Experience using Functional programming is ideal.
- Proven experience in developing data structures and algorithms. Experience supporting ML/AI highly desirable.
- Proven experience contributing to product strategy development with Product Management teams. Experience in SaaS product engineering and operations highly desirable.
- Proven experience in data engineering and testing practices and implementing these in teams, with a willingness to share, partner and coach engineers, product people, and operations through pragmatic and effective development and delivery practices.
- Proven experience shaping and evolving the principles, practices, and tooling supporting agile, testing/QA, DevSecOps, automation and SRE in a data-focussed team. Experience in Trunk Based Development, XP, & implementing CI/CD as used in data teams is highly desirable.
- A focus on continuous learning and improving, both technically and professionally, in your industry, for you and your teams.
- Demonstrated resilience, with experience working in ambiguous situations.
- Strong English, excellent influencing and communication skills, and excellent documentation skills.
Life at WPP Media & Benefits
Our passion for shaping the next era of media includes investing in our employees to help them do their best work, and we’re just as committed to employee growth as we are to responsible media investment. WPP Media employees can tap into the global WPP Media & WPP networks to pursue their passions, grow their networks, and learn at the cutting edge of marketing and advertising. We have a variety of employee resource groups and host frequent in-office events showcasing team wins, sharing thought leadership, and celebrating holidays and milestone events. Our benefits include competitive medical, group retirement plans, vision, and dental insurance, significant paid time off, preferential partner discounts, and employee mental health awareness days.
WPP Media is an equal opportunity employer and considers applicants for all positions without discrimination or regard to particular characteristics. We are committed to fostering a culture of respect in which everyone feels they belong and has the same opportunities to progress in their careers.
We believe the best work happens when we're together, fostering creativity, collaboration, and connection. That's why we’ve adopted a hybrid approach, with teams in the office around four days a week. If you require accommodations or flexibility, please discuss this with the hiring team during the interview process.
Please read our Privacy Notice (https://www.wppmedia.com/pages/privacy-policy) for more information on how we process the information you provide.
While we appreciate all applications received, only those candidates selected for an interview will be contacted.
#LI-Promoted
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Athena AWS BigQuery CI/CD Data pipelines Docker Engineering GCP Kafka Kubernetes Machine Learning Pipelines PostgreSQL Privacy Python Snowflake Spark SQL TDD Testing
Perks/benefits: Career development Health care Startup environment Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.