Data Engineer 2
IL - Chicago, 33 W Monroe St Suite 1900, United States
Full Time Mid-level / Intermediate USD 84K - 127K
Comcast
Comcast NBCUniversal creates incredible technology and entertainment that connects millions of people to the moments and experiences that matter most.Job Summary
We are seeking a highly skilled data engineer with expertise in SQL and either Python or Scala, who is experienced in building large-scale data pipelines using Apache Spark and designing robust data architectures on AWS. The ideal candidate will have hands-on experience in data lake architectures, open table formats (Delta Lake/Iceberg), and modern data platforms. If you are a problem solver, a data infrastructure enthusiast, and someone who thrives in fast-paced environments, we'd love to hear from you!Job Description
Core Responsibilities:
- Bachelor’s or master’s degree in computer science, Engineering, or a related field.
- 2+ years of experience in building and operating large-scale data processing systems.
- Proficiency in multiple programming languages, including Scala, Java, Python, and SQL.
- Familiarity with big data processing frameworks, such as Apache Flink, Apache Spark (Batch & Streaming), and Databricks Delta Live Tables (DLT).
- Understanding of data storage technologies, including AWS S3, Delta Lake, Apache Iceberg, Hadoop HDFS, and Apache Druid.
- Basic understanding of Data Lakehouse architectures, data modeling techniques, ETL processes, and relational databases (e.g., MySQL).
- Experience with AWS services, such as Glue, EMR and Lambda.
- Experience with workflow orchestration tools, such as Apache Airflow and Azkaban.
- Knowledge of NoSQL databases, including HBase.
- Strong problem-solving skills with a keen attention to detail.
- Excellent communication and collaboration skills to work effectively with technical and non-technical teams.
- Ability to quickly adapt and context switch among different priorities, working efficiently in a fast-paced environment.
- Strong generalist mindset with the ability to work across different technology stacks and polyglot programming skills, demonstrating fluency in multiple programming languages beyond primary expertise.
- Consistent exercise of independent judgment and discretion in matters of significance.
- Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
- Other duties and responsibilities as assigned.
Nice-to-Have:
- Experience managing highly scalable data infrastructures, ensuring performance, reliability, and cost-efficiency.
- Experience in modeling and processing complex, hierarchical data structures such as Ad Logs.
- Adept in planning work for self and the team while collaborating closely with product stakeholders.
Employees at all levels are expected to:
- Understand our Operating Principles; make them the guidelines for how you do your job.
- Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
- Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
- Win as a team - make big things happen by working together and being open to new ideas.
- Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
- Drive results and growth.
- Respect and promote inclusion & diversity.
- Do what's right for each other, our customers, investors and our communities.
Why Join FreeWheel?
Cutting-Edge Technology: Work with modern data stacks, cloud platforms, and real-time processing frameworks.
Innovation-Driven Culture: Collaborate with top engineers, data scientists, and industry leaders shaping the future of ad tech.
Growth & Impact: Solve complex, large-scale data challenges with tens of billions of daily events in a high-impact role.
Flexible & Inclusive Work Environment: We value diverse perspectives, work-life balance, and professional development.
About FreeWheel
FreeWheel, a Comcast company, is a global leader in advanced advertising technology, enabling seamless transactions across screens, data types, and sales channels. Operating in nine countries, FreeWheel powers global ad insertion and recently launched Universal Ads, a cross-publisher TV advertising platform in collaboration with major media players like NBCUniversal, Warner Bros. Discovery, and Roku. Committed to innovation, inclusivity, and professional growth, FreeWheel fosters a dynamic work environment where diverse perspectives thrive while shaping the future of premium video advertising.
About the FreeWheel Data Team
The FreeWheel Data Team is a global, high-impact engineering team focused on building scalable, high-performance, efficient data platforms and rich analytic user experiences. We develop solutions to ingest, transform, organize, and distribute vast volumes of advertising and audience data, enabling a Unified Data Lake and Data Warehouse that powers customer-facing products, machine learning applications, and real-time analytics. We process tens of billions of ad events daily, leveraging a modern data stack that includes Databricks, AWS, Apache Spark, ClickHouse, Snowflake, and Google Looker.
Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Skills
Data Engineering, Python (Programming Language), Structured Query Language (SQL)Compensation
Primary Location Pay Range: $84,845.88 - $127,268.82Comcast intends to offer the selected candidate base pay dependent on job-related, non-discriminatory factors such as experience. Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.
The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.
Education
Bachelor's DegreeWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.Certifications (if applicable)
Relative Work Experience
2-5 YearsComcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.Tags: Airflow Architecture AWS Azkaban Big Data Computer Science CX Databricks Data pipelines Data warehouse Engineering ETL Flink Hadoop HBase HDFS Java Lambda Looker Machine Learning MySQL NoSQL Pipelines Python RDBMS Scala Snowflake Spark SQL Streaming
Perks/benefits: Career development Flex hours Salary bonus Startup environment Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.