Data Engineer

Requisition Number: 67309

Corning is vital to progress – in the industries we help shape and in the world we share.

We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and lives.

Our sustained investment in research, development, and invention means we’re always ready to solve the toughest challenges alongside our customers. 

The global Information Technology (IT) Function is leading efforts to align IT and Business Strategy, leverage IT investments, and optimize end to end business processes and associated information integration technologies.  Through these efforts, IT helps to improve the competitive position of Corning's businesses through IT enabled processes.  IT also delivers Information Technology applications, infrastructure, and project services in a cost efficient manner to Corning worldwide.

Scope of Position:

In this role, the Data Engineer is responsible for applying data cleansing, enrichment/contextualization, and integrating data from multiple data sets to provide an end-to-end view of the manufacturing data. They will start with raw data from various manufacturing sources and create automated data processing pipelines to produce analytics-ready data sets. The candidate will identify trends in data sets and develop algorithms to make raw data more useful for the process engineering and Data Science teams. Excellent communication skills are essential, as the role involves working across departments to understand the insights required by partners and modeling datasets accordingly. The candidate will be a key member of our digital transformation team, focusing on manufacturing analytics and collaborating closely with domain experts, controls engineers, data engineers, and data scientists.

Responsibilities:

• Analyze and understand various manufacturing and supporting data sources.
• Design and Develop workflow integrations and automation that combines multiple software tools to collect and connect data from different manufacturing sources.
• Support and monitor performance of data pipelines to ensure efficient data processing and storage.
• Design and develop methods to filter/cleanse, enrich, and contextualize data.
• Design and develop methods/algorithms to integrate data to enable end-to-end traceability of products being manufactured.
• Leverage CI/CD to ensure Software Data quality and built-in regression test framework into our CI/CD pipeline 
• Working closely with domain experts and supporting personnel to understand the underlying business problem or opportunity, previous approaches to addressing them, and assessing the potential of advanced analytics to enable accelerated performance improvements 
• Work with DevOps to build automated data pipelines.
• Performance Optimization and tuning of all our data engineering pipeline and data lake.
• Create dashboards and visualization using BI tools.
• Develop and support unit and integration test activities, and assist with User Acceptance Testing.
• Collaborate with team members to tackle complex technological infrastructure, security, and development problems
• Willing to be on off-hours call on a rotational basis.

Education and Experience:

• BS/MS degree preferably in Information Management, Computer Science, Engineering or other related fields.
• 3-5 years of Data engineering experience on Databricks/Spark SQL, and notebooks, clusters, pipelines, and jobs.
• 3+ years of programming proficiency in, at least one modern programming language (e.g. Java, C#, JavaScript, etc.) and at least one other high-level programming language such as Python and SQL.

• 3+ years of experience with relational databases and data modelling.
• 3+ years of experience in infrastructure and configuration management including Terraform, Ansible or Chef 
• 3+ years of experience administering and deploying development CI/CD tools such as GitLab, Jenkins, or Azure DevOps. 

Required Skills

• Strong leadership and excellent verbal and written communications skills, with the ability to develop and sell ideas.
• Proven success working in a highly matrix environment.
• Excellent analytical and decision-making abilities. 
• Must demonstrate a proven willingness to go the extra mile, to take on the things that need to be done and maintain a positive attitude that can adapt to change.
• Demonstrated curiosity and an ability to learn new skills on an ongoing, sustained basis
• Demonstrated systems perspective when analyzing problems, thinking about overall operation, failure modes and how to address these problems proactively.
• Experience with data visualization tools and techniques such as Power BI or Tableau.

Desired Skills

• Expert proficiency with AWS foundational compute services, including S3 and EC2, ECS and EKS
• Understanding machine learning concepts and experience with ML frameworks like TensorFlow or PyTorch.
• Experience working, contributing to development of manufacturing execution systems and/or inspection and metrology systems and/or developing in SCADA layer.
• Familiarity with MLOps.
• Experience with data governance and data quality tools.
• Experience with GenAI and prompt engineering.
• Familiarity with Agile methodology.

Travel Requirement

• Up to 10%

Corning Puts YOU First!

We are committed to supporting your health, financial, career development, and life goals as you grow professionally and personally to achieve your highest potential. All benefits begin as soon as you start your career at Corning.

• Our monetary peer-to-peer recognition program is tied to our Values and celebrates you and your colleagues’ contributions.
• Health and well-being benefits include medical, dental, vision, paid parental leave, mental health/substance use, fitness, and disease management programs.   
• Companywide bonus and attractive short- and long-term compensation programs are available based on your role and responsibilities.  
• Professional development programs help you grow and achieve your career goals.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. To request an accommodation, please contact us at accommodations@corning.com.