Principal Data Engineer (Data Pipeline, Python, AWS)
Gurgaon, HR, India
Applications have closed
Nielsen
A global leader in audience insights, data and analytics, Nielsen shapes the future of media with accurate measurement of what people listen to and watch.
At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.
Nielsen is seeking an organized, detail oriented, team player, to join us in the role of an Architect. Nielsens Audience Measurement Engineering platforms support the measurement of television viewing in more than 30 countries around the world. Ideal candidate will have exceptional skills in programming, testing, debugging and problem solving as well as effective communication and writing skills.
Nielsen is seeking an organized, detail oriented, team player, to join us in the role of an Architect. Nielsens Audience Measurement Engineering platforms support the measurement of television viewing in more than 30 countries around the world. Ideal candidate will have exceptional skills in programming, testing, debugging and problem solving as well as effective communication and writing skills.
Qualification:
- Bachelor’s degree in computer science, information systems, software engineering or a related field (foreign equivalent degree acceptable) with 9+ years of experience in: software development technology.
- 5 years of experience with/in: Git; SQL; Hadoop; Spark in developing distributed processing applications and building applications with immutable infrastructure in the AWS (Amazon Web Services) Cloud with automation technologies like Terraform, Ansible or CloudFormation;
- 3 years of experience with/in: Spark; Python, Test Automation, CICD Pipeline Development
- Experience with DBT Core, Airbyte, Airflow, and Docker
Job Description:
- Design, develop, test and support highly complex software solutions for data driven applications by providing necessary design and technical expertise.
- Understand the big picture in an End-to-End environment and understand upstream and downstream requirements. Adopt standard platform tools for source code management, CICD, Orchestration, monitoring and alerting (gitlab, airflow, jenkins etc).
- Work on AWS cloud infrastructure in a DevOps capacity.
- Participate in technical planning & requirements gathering phases including discovery, design, code, test and documentation. Lead development best practices to guarantee the quality and sustainability of software deliverables.
- Support Testing and UAT phases and participate in Deployment.
- As a Staff Software Engineer on Nielsen Engineering’s OpIntel Team, you will be part of a
- Collaborative group of skilled Software Engineers who deal with a wide variety of Nielsen data from our TV, Digital/Internet, and Radio monitoring business. You will be working closely with offshore team members - mentoring and reviewing their code/design to encourage them to grow in a positive direction through setting a positive example for every step in the software development lifecycle process.
- You will be designing and building complex data-driven applications and processes that help to ensure that Nielsen TV, Digital/Internet, and Radio measuring systems are generating accurate data.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Category:
Engineering Jobs
Tags: Airflow Ansible AWS CloudFormation Computer Science dbt DevOps Docker Engineering Git GitLab Hadoop Jenkins Python Spark SQL Terraform Testing
Perks/benefits: Career development
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Staff Machine Learning Engineer jobsData Scientist II jobsPrincipal Data Engineer jobsStaff Data Scientist jobsBI Developer jobsData Manager jobsJunior Data Analyst jobsResearch Scientist jobsData Science Manager jobsBusiness Data Analyst jobsLead Data Analyst jobsData Engineer III jobsSenior AI Engineer jobsData Specialist jobsData Science Intern jobsSr. Data Scientist jobsPrincipal Software Engineer jobsData Analyst Intern jobsAzure Data Engineer jobsSoftware Engineer II jobsData Analyst II jobsBI Analyst jobsSoftware Engineer, Machine Learning jobsJunior Data Engineer jobsSenior Data Scientist, Performance Marketing jobs
Snowflake jobsLinux jobsEconomics jobsOpen Source jobsBanking jobsHadoop jobsJavaScript jobsComputer Vision jobsRDBMS jobsPhysics jobsKafka jobsData Warehousing jobsMLOps jobsAirflow jobsNoSQL jobsKPIs jobsR&D jobsGoogle Cloud jobsScala jobsOracle jobsData warehouse jobsStreaming jobsClassification jobsPostgreSQL jobsGitHub jobs
Scikit-learn jobsSAS jobsCX jobsTerraform jobsScrum jobsPandas jobsPySpark jobsData Mining jobsDistributed Systems jobsRobotics jobsIndustrial jobsBigQuery jobsLooker jobsJira jobsUnstructured data jobsRedshift jobsJenkins jobsE-commerce jobsdbt jobsReact jobsMicroservices jobsPharma jobsData strategy jobsMySQL jobsNumPy jobs