Data Engineer

Overview

Expleo is a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation.  We help businesses harness unrelenting technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the globe.  

We are seeking a talented Data Engineer to join our team. As a Data Engineer, you will work with a variety of technologies including Python, Py-Spark, Pandas, SQL and Azure DevOps. You will be responsible for modeling and implementing predictive maintenance solutions for our products, specifically focusing on jet engines.

Responsibilities

• Collaborate with stakeholders to understand data migration requirements

• Work with diverse data formats and source/target databases

• Design, develop, test, and maintain data migration modules

• Analyse and address data quality issues at both the source and destination

• Participate in peer reviews, design discussions, and knowledge sharing

• Prioritize and resolve issues reported in live systems to ensure minimal downtime

• Document migration processes and provide regular progress updates

Essential skills

• Strong experience with Databricks

• Proficient in SQL for data querying and transformation

• Solid understanding of Azure Services including:

  • Azure Data Factory

  • Azure Storage Containers

  • Lakehouse architecture

• Expertise in PySpark for big data processing

• In-depth knowledge of data migration processes, including ETL and data mapping

• Excellent verbal and written communication skills

Experience

• Experience with CI/CD pipelines for deployment automation

• Familiarity with COSMOS DB

• Proficiency in Python beyond PySpark

• Working knowledge of Azure DevOps tools and practices

Benefits

• Collaborative working environment – we stand shoulder to shoulder with our clients and our peers through good times and challenges  
• We empower all passionate technology loving professionals by allowing them to expand their skills and take part in inspiring projects   
• Expleo Academy - enables you to acquire and develop the right skills by delivering a suite of accredited training courses  
• Competitive company benefits
• Always working as one team, our people are not afraid to think big and challenge the status quo 

• As a Disability Confident Committed Employer we have committed to:
• Ensure our recruitment process is inclusive and accessible
• Communicating and promoting vacancies
• Offering an interview to disabled people who meet the minimum criteria for the job
• Anticipating and providing reasonable adjustments as required
• Supporting any existing employee who acquires a disability or long term health condition, enabling them to stay in work at least one activity that will make a difference for disabled people

“We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age”. 

We treat everyone fairly and equitably across the organisation, including providing any additional support and adjustments needed for everyone to thrive

#LI-DS1