Data Engineer II-9682

Comcast Advertising is driving the TV advertising industry forward, from delivering ads to linear and digital audiences to pioneering the tech that makes it possible. We help brands connect with their audiences on every screen using advanced data, technology, and premium video content. Our media sales division helps local, regional, and national brands reach potential customers through multiscreen TV advertising. Our ad tech division FreeWheel provides comprehensive adtech that makes it easier to buy and sell premium video advertising across all screens, data types, and sales channels.

Job Summary

Job Description

DUTIES:                               Transform large, complex data into consumable business databases and applications for self-service analytics and reporting; perform data analysis using SQL and Spark SQL queries; develop ETL jobs using Databricks, Jupyter, and Pyspark; automate ETL jobs using AWS services, including S3, Athena, Lambda, RDS, Glue, and EMR; perform data quality checks and exploratory data analysis on large data sets using PySpark; create system architecture, design and specification using in-depth engineering skills and knowledge to solve difficult development problems and achieve engineering goals; determine and source appropriate data for a given analysis; work with data modelers/analysts to understand the business problems and create or augment data assets to support analysis; perform engineering tasks including database design, data manipulation, ETL, implementation, information storage and retrieval, data flow and analysis; resolve technical issues utilizing knowledge of policies and processes; identify and react to system notification and log to ensure quality standards for databases and applications; solve abstract problems beyond single development language or situation by reusing existing data file and flags; solve critical issues and present trends, aggregate, and quantify volume regarding specific data sources; participate in the implementation of solutions via data architecture, data engineering, or data manipulation within big data systems including Hadoop and SQL; collaborate with business owners and technical associates to ensure data collected and processed is both actionable and relevant to end goals; determine solutions for data storage and storage optimization and organization; determine table relations and how fields interact within tables to develop relational models; and collaborate with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality.  Position is eligible for 100% remote work.

REQUIREMENTS:             Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and one (1) year of experience performing data analysis using SQL and Spark SQL queries; developing ETL jobs using Databricks, Jupyter, and Pyspark; automating ETL jobs using AWS services, including S3, Athena, Lambda, RDS, Glue, and EMR; and performing data quality checks and exploratory data analysis on large data sets using PySpark.

Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Skills

AWS Lambda, Data Quality, PySpark, Spark SQL

We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.

Please visit the benefits summary on our careers site for more details.

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.