Data Engineer II

What you will do? 

Join us in the Procurement Execution Center (PEC) as a Data Engineer as part of a is a diverse team of data and procurement individuals. In this role, you will be responsible for deploying supporting the E2E management of our data, including: ETL/ELT, DW/DL, data staging, data governance, and manage the different layers of data required to ensure a successful BI & Reporting for the PEC. This role will work with multiple types of data, spreading across multiple functional areas of expertise, including Logistics, MRO & Energy, Travel, Professional Services, among others. 

How you will do it? 

• Deploy data ingestion processes through Azure Data Factory to load data models as required into Azure Synapse.  
• Build and design ETL/ELT processes with Azure Data Factory (ADF) and/or Python, which once deployed, will require to be executed daily and weekly.  
• Assemble large, complex data sets that meet functional / non-functional business requirements. 
• Build the infrastructure required for optimal ETL/ELT of data from a wide variety of data sources using Azure SQL and ADF. 
• Develop data models that enable DataViz, Reporting and Advanced Data Analytics, striving for optimal performance across all data models. 
• Maintain conceptual, logical, and physical data models along with corresponding metadata. 
• Manages the DevOps pipeline deployment model, including automated testing procedures 
• Deploys data stewardship and data governance across our data warehouse, to cleanse and enhance our data, using knowledge bases and business rules. 
• Performs the necessary data ingestion, cleansing, transformation, and coding of business rules to support annual Procurement bidding activities.   
• Support the deployment of a global data standard for Logistics. 
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. 
• Support Rate Repository management as required (including Rate Card uploads to our DW). 
• Other Procurement duties as assigned.  

What are we looking for? 

• Bachelor’s degree in related field (Engineering, Computer Science, Data Science or similar) 
• 3+ years of relevant experience in BI Engineering, data modeling, data engineering, software engineering or other relevant roles.  Strong SQL knowledge and experience working with relational databases. 
• Knowledge in DW/DL concepts, data marts, data modeling, ETL/ELT, data quality/stewardship, distributed systems and metadata management. 
• Experience building and optimizing data pipelines, architectures, and data sets. 
• Azure Data Engineering certification preferred (DP-203) 
• ETL/ELT development experience (3+ years). SSIS or ADF are preferred. 
• Ability to resolve ETL/ELT problems by proposing and implementing tactical/Strategic solutions.  
• Strong project management and Organizational skills. 
• Experience with object-oriented function scripting languages: Python, Scala, C#, etc. 
• Experience with NoSQL databases is a plus to support the transition from On-Prem to Cloud. 
• Excellent problem solving, critical thinking, and communication skills  
• Relevant experience with Azure DevOps (CI/CD, git/repo management) is a plus 
• Due to the global nature of the role, proficiency in English language is a must