Senior Data Engineer - (Bangalore)

Gracenote is the content business unit of Nielsen that powers the world of media entertainment. Our metadata solutions help media and entertainment companies around the world deliver personalized content search and discovery, connecting audiences with the content they love.We’re at the intersection of people and media entertainment. With our cutting-edge technology and solutions, we help audiences easily find TV shows, movies, music and sports across multiple platforms. As the world leader in entertainment data and services, we power the world’s top streaming platforms, cable and satellite TV providers, media companies, consumer electronics manufacturers, music services and automakers to navigate and succeed in the competitive streaming world.Our metadata entertainment solutions have a global footprint of 80+ countries, 100K+ channels and catalogs, 70+ sports and 100M+ music tracks, all across 35 languages.

Job Overview

• We are seeking an experienced Senior Data Engineer with 8-10 years of experience to join our Video engineering team with Gracenote - a NielsenIQ Company. In this role, you will design, build, and maintain our data processing systems and pipelines. You will work closely with Product managers, Architects, analysts, and other stakeholders to ensure data is accessible, reliable, and optimized for Business, analytical and operational needs.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes
• Optimize data flow and collection for cross-functional teams.
• Build infrastructure required for optimal extraction, transformation, and loading of data
• Ensure data quality, reliability, and integrity across all data systems.
• Collaborate with data scientists and analysts to help implement models and algorithms
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc.
• Create and maintain comprehensive technical documentation
• Evaluate and integrate new data management technologies and tools

Requirements

• 3-5 years of professional experience in data engineering roles
• Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred
• Expert knowledge of SQL and experience with relational databases (e.g., PostgreSQL, Redshift, TIDB, MySQL, Oracle, Teradata)
• Extensive experience with big data technologies (e.g., Hadoop, Spark, Hive, Flink)
• Proficiency in at least one programming language such as Python, Java, or Scala
• Experience with data modeling, data warehousing, and building ETL pipelines
• Strong knowledge of data pipeline and workflow management tools (e.g., Airflow, Luigi, NiFi)
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services. AWS
• Preferred Hands on Experience with building streaming pipelines with flink, Kafka, Kinesis. Flink Preferred.
•  Understanding of data governance and data security principles
• Experience with version control systems (e.g., Git) and CI/CD practices

Preferred Skill and Qualities

• Preferred Skills
• Experience with containerization and orchestration tools (Docker, Kubernetes)
• Basic knowledge of machine learning workflows and MLOps
• Experience with NoSQL databases (MongoDB, Cassandra, etc.)
• Familiarity with data visualization tools (Tableau, Power BI, etc.)Experience with real-time data processing
• Knowledge of data governance frameworks and compliance requirements (GDPR, CCPA, etc.)
• Experience with infrastructure-as-code tools (Terraform, CloudFormation)

Personal Attribute

• Strong problem-solving skills and attention to detail
• Excellent communication skills, both written and verbal
• Ability to work independently and as part of a team
• Proactive approach to identifying and solving problems
• Adaptability and willingness to learn new technologies

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.