Data Engineer

Company Description

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. 

Founded in Barcelona in 2001, Netquest is the data collection provider of choice for the Market Research Industry. A tech-driven company built on a robust and engaged panel and a strict quality standard (ISO 20252). We make possible a truly 360 degrees view of today’s consumers collecting behavioral and declarative data from a single source, our panelists, in 23 countries across the globe. Leveraging our data, savvy researchers better define winning strategies based on an in-deep understanding of consumers' preferences and behaviors.

Job Description

As a Data team we have to cover the three main specialties at the data field: Data Science, Data Analytics and Data Engineering. Today we have covered all the current needs in each field but we are looking for a boost in the Data Engineering part, looking to the future, by adding a person who provides us experience and knowledge about doing things in the right direction.

Technologies and standards

• Proficiency in Python and SQL
• Awareness of scheduling tools, like Apache Airflow
• Interest in Big Data solutions, like Apache Spark
• In depth understanding of the Data Engineering techniques
• Ability to maintain and extend processes and functionalities
• Deep understanding of application packaging and delivery mechanisms, including CD/CI best practices and security concerns
• The ability to integrate partial solutions and RnD results into production-ready data pipelines
• The ability to build and operate infrastructure (e.g, for testing purposes)
• The ability to support on operational questions for environments in production
• Understanding of cloud infrastructure and services available for setting up and maintaining data pipelines (e.g., AWS)
• Ability to advise on data transformation workflow designs and optimizations with the dimensions of cost, performance and delivery mechanisms (streams / increments / etc.)

Qualifications

• The ability to design and implement an entire data pipeline from scratch
• The ability to decide which problems to solve with scale-up and which ones to tackle with scale-out approaches and how to combine them in data pipelines
• Knowledge about Data Architecture
• Awareness of Data Governance
• An economic view on questions of operability of crafted data pipelines:
• Maintenance of data integrity in cases of reprocessing
• Understanding of whether or how (internal or external) customer data deliveries are affected by changes to the software
• Awareness of data design patterns in the organization and best practices in general
• Deep understanding of data modelling, data schemas and evolution thereof   
• Awareness of best practices of data transformation design patterns
• An advanced focus on data integrity when crafting data pipelines, by building in means to monitor data health and state of intermediate data and alerting mechanisms 
• Designing Quality Control/Validation processes / Quality Gates

Additional Information

The accountabilities of a data engineer include the accountabilities of a data engineer but increased norms apply, meaning a senior data engineer is expected to be able to accomplish their tasks in less time, to a higher standard  (total understanding and excellent adherence to applicable standards and guidelines) and be able to solve more complex problems.

The senior data engineer is expected to look beyond their primary team scope and strive for harmonization and improvement of solutions across the CSG or even beyond. 

The senior data engineer is also accountable to pro-actively pass on their knowledge on to other engineers when the opportunity arises during the course of their work:

• During pair programming/ pair work
• When sought for advice
• During code reviews
• By participating in Communities of Practice

The senior data engineer is accountable for bringing together technical assets from different disciplines within their cross-functional team and for fostering a common solution approach between team members with different technical backgrounds.

Our Benefits

• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Want to keep up with our latest updates?

Follow us on: LinkedIn | Instagram | Twitter | Facebook

Our commitment to Diversity, Equity, and Inclusion

NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion