Senior Engineer, Enterprise BI & AI/ML Engineering-4038
PA - Philadelphia, 1701 John F Kennedy Blvd
Applications have closed
Comcast
Comcast NBCUniversal creates incredible technology and entertainment that connects millions of people to the moments and experiences that matter most.Job Summary
Job Description
.
DUTIES: Create and fully support enterprise level ETL processes using Agile methodologies and Agile project management; architect, develop, build, and test ETL pipeline software for master data assets using Python, Databricks, Spark, IICS and Kubernetes; schedule ETL jobs using Airflow; use Teradata for data marts; write SQL queries; perform Dockerization/Containerization using Kubernetes; write Linux Shell scripts; support the architecture, design, development, qualification, and deployment of applications consistent with product and technical roadmaps; work with engineering project management and principle engineers to deliver applications that meet or exceed product requirements, project schedules and reliability; develop and apply performance and bandwidth models for interactive applications to document network impacts; work with product development and operations teams to define technical requirements to accompany existing product and operation requirements; design and develop use cases in support of the technical requirements; transform technical requirements into architecture; assists in vendor technical selection and management; interface with test teams to validate test plans and procedures; work closely with development, integration and test teams to ensure product quality; and prepare deliverables for trial and market readiness. Position is eligible for 100% remote work.
REQUIREMENTS: Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and two (2) years of experience architecting, designing, building, and testing ETL pipeline software using Python and Databricks; scheduling ETL jobs using Airflow; using Teradata for data marts; and writing SQL queries; of which one (1) year includes performing Dockerization and Containerization using Kubernetes; writing Linux Shell scripts; and using Agile methodologies in a software development setting.
Disclaimer:This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Skills
Agile Methodology, Data Mart, Extract Transform Load (ETL), KubernetesWe believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Please visit the benefits summary on our careers site for more details.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Architecture Computer Science Databricks Engineering ETL Kubernetes Linux Machine Learning Python Spark SQL Teradata Testing
Perks/benefits: Career development Equity / stock options
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.