Lead Data Engineer

Responsibilities

Duties:

• Participate in scrums, design meetings, and collaborate with quality assurance, business stakeholders, data engineering coworkers, product, software development, and data scientists, as needed for each project.• Understand and articulate requirements to/from technical and non-technical audiences working alongside a data science & engineering team.• Create design documentation and review it with peers and subject matter experts.• Learn the Cadent Data Lake architecture principles and libraries and actively participate in maintaining and improving the core codebase.• Build and maintain cost effective and performant Databricks workflows using various data sources through each layer of the Cadent Data Lake; and make data available for querying and reporting.• Support the business with ad hoc data analysis to answer data questions and do proof of concepts.• Learn the Cadent media and TV business as well as it’s nomenclature, media math, and metrics.• Show initiative to identify critical problems and propose effective solutions, while exploring, learning and suggesting the most suitable technology for the problem.

Requirement: Applicants must have a Master’s degree or foreign equivalent in Computer Science, Computer Information Systems, Information Technology, Engineering (any), or related fields, plus two years of experience in Databricks (spark), AWS ecosystems and in building large-scale distributed applications, including streaming and Batch pipelines and processing petabytes of data. Pay Scale $175,00 – $195,000 per yr., plus standard benefits.

Pay Range