Sr Data Engineer- Ad Tech- Flink- Scala
Virtual, United States
Full Time Senior-level / Expert USD 96K - 226K
Comcast
Comcast NBCUniversal creates incredible technology and entertainment that connects millions of people to the moments and experiences that matter most.Job Summary
We are looking for a Sr. Software Engineer for the FreeWheel Data Foundation team. Our team mainly focuses on transforming and preparing high-velocity ADS log streams and deliver a single data lake for downstream consume data efficiently. The TVP Data Platform processes billions of ad events daily, delivers real-time and batch data and provides various reporting and troubleshooting products to the customers. As a software engineer, you will play a crucial role in the development, deployment, and maintenance of data pipelines and infrastructure within our organization. You will collaborate with cross-functional teams to design, implement, and optimize data solutions that enable efficient data processing, storage, and analysis.Job Description
Core Responsibilities
- Be responsible for the complete lifecycle of software development. Design, implement, and maintain scalable data pipelines to ingest, transform large volumes of data from various sources.
- Optimize streaming and batch data processing and storage solutions for performance and scalability.
- Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability.
- Collaborate with product managers and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
- Stay abreast of emerging technologies and best practices in data engineering. Identify opportunities to improve data processes, tools, and infrastructure to enhance efficiency and effectiveness.
- Document data pipelines, processes, and systems to ensure clarity and maintainability. Share knowledge and best practices with team members to foster a culture of learning and collaboration.
- Work with and mentor junior Data Engineers.
- Regular, consistent and punctual attendance.
- Provides guidance and support to other Engineers.
- Other duties and responsibilities as assigned.
Requirements:
- Ad Tech or Streaming experience
- Flink Experience
- Preferably, Scala experience but open to Java
- 5+ years of hands-on work in the field of software development.
- 3+ years of experience with data applications (Spark, Presto, Hive, etc)
- 3+ years of experience in designing and building ETL pipelines to process data at scale
- 3+ years of experience with NoSQL implementation (AeroSpike, DynamoDB, etc)
- 3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
- Excellent coding skills with Scala/Java, Python.
- Must be versatile and an inquisitive problem solver.
- Excellent communication and writing skills
- Bachelor's or master’s degree in Computer Science or similar field of study
Seems like something you might be interested in? We want to meet you to discuss this exciting opportunity.
Employees at all levels are expected to:
- Understand our Operating Principles; make them the guidelines for how you do your job.
- Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
- Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
- Win as a team - make big things happen by working together and being open to new ideas.
- Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
- Drive results and growth.
- Respect and promote inclusion & diversity.
- Do what's right for each other, our customers, investors and our communities.
Disclaimer:
- This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Comcast is an EOE/Veterans/Disabled/LGBT employer.
Skills
Amazon Web Services (AWS), Apache Spark, Data Pipelines, Java, Process Streamlining, Python (Programming Language), Scala (Programming Language)Compensation
National Pay Range: $96,600.92 USD-$226,408.42 USDComcast intends to offer the selected candidate base pay dependent on job-related, non-discriminatory factors such as experience. Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.
The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.
Education
Bachelor's Degree: Computer EngineeringWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.Certifications (if applicable)
Relative Work Experience
7-10 YearsComcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast will consider for employment applicants with arrest or conviction records in accordance with the requirements of applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Please note that federal state, or local laws and regulations may restrict or prohibit Comcast from hiring individuals convicted of certain crimes. Additionally, an applicant’s criminal history may have a direct, adverse, and negative relationship on the job duties of this position, which may result in the withdrawal of a conditional offer of employment.Tags: AWS Azure CI/CD Computer Science CX Data pipelines DynamoDB Engineering ETL Flink GCP Google Cloud Java Jenkins NoSQL Pipelines Python Scala Spark Streaming Terraform
Perks/benefits: Career development Equity / stock options Salary bonus Startup environment Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.