Data Engineer

Company Description

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. 

Founded in Barcelona in 2001, Netquest is the data collection provider of choice for the Market Research Industry. A tech-driven company built on a robust and engaged panel and a strict quality standard (ISO 20252). We make possible a truly 360 degrees view of today’s consumers collecting behavioral and declarative data from a single source, our panelists, in 23 countries across the globe. Leveraging our data, savvy researchers better define winning strategies based on an in-deep understanding of consumers' preferences and behaviors.

Job Description

As a Data team, we cover the three main specialties in the data field: Data Science, Data Analytics, and Data Engineering. While our current needs are well met in each field, we are looking to strengthen our Data Engineering capabilities by adding a skilled Data Engineer to our team. We seek a person who brings practical experience and enthusiasm to help drive our data initiatives forward.

We are currently developing a robust data strategy inside Netquest. We are looking for a collaborative team player who enjoys working with others and interacting with various departments. This role involves understanding different stakeholders' needs, sharing decisions with the team, and explaining data solutions clearly.

Key Accountabilities

The accountabilities of a data engineer include adhering to applicable standards and guidelines while solving complex problems. The data engineer is expected to work within their team scope and contribute to the harmonization and improvement of solutions across the organization.

The data engineer is also accountable for sharing knowledge with other engineers during pair programming/pair work, when sought for advice, during code reviews, and by participating in Communities of Practice.

The data engineer is responsible for bringing together technical assets from different disciplines within their cross-functional team and fostering a common solution approach among team members with diverse technical backgrounds.

Qualifications

• Experience in designing and implementing data pipelines
• Ability to address problems with scale-up and scale-out approaches and combine them in data pipelines
• Understanding of Data Architecture principles
• Awareness of Data Governance practices
• Consideration of economic aspects related to the operability of data pipelines
• Maintenance of data integrity during reprocessing
• Understanding how customer data deliveries (internal or external) are affected by software changes
• Familiarity with data design patterns and best practices
• Knowledge of data modeling, data schemas, and their evolution
• Awareness of data transformation design patterns
• Focus on data integrity in crafting data pipelines, including monitoring data health and state of intermediate data and alerting mechanisms
• Designing Quality Control/Validation processes / Quality Gates

Technologies and Standards

• Proficiency in Python and SQL
• Familiarity with scheduling tools like Apache Airflow
• Interest in Big Data solutions, such as Apache Spark
• Understanding of Data Engineering techniques
• Ability to maintain and extend processes and functionalities
• Knowledge of application packaging and delivery mechanisms, including CD/CI best practices and security concerns
• Ability to integrate partial solutions and RnD results into production-ready data pipelines
• Experience in building and operating infrastructure (e.g., for testing purposes)
• Ability to support operational questions for production environments
• Understanding of cloud infrastructure and services for setting up and maintaining data pipelines (e.g., AWS)
• Advising on data transformation workflow designs and optimizations focusing on cost, performance, and delivery mechanisms (streams/increments/etc.)

Additional Information

Our Benefits

• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Want to keep up with our latest updates?

Follow us on: LinkedIn | Instagram | Twitter | Facebook

Our commitment to Diversity, Equity, and Inclusion

NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion