Lead Data Engineer

Who we are

We are seeking a highly skilled and experienced Lead Data Engineer to join our team. The successful candidate will be responsible for leading the development of new functionality in our Python-based ETL pipeline, defining best practices and coding principles, mentoring and leading a team of Data Engineers.

What you'll be doing

• Lead Development of new functionality in the Python-based ETL pipeline 
• Define best practices and coding principles based on client standards, mentor and lead Data Engineers. 
• Plan maintenance and optimization of the existing pipelines in Python and Azure Data Factory 
• Coordinate with various stakeholders in development, architecture, rollout and operations teams as well as with customers to estimate and plan development of new features 
• Plan capacity and sizing of the service components, proactive cloud component management 
• Initiating planning and set up of new service components 
• Coordinate the operations and maintenance of related software, complex server infrastructure and databases (Synapse, PowerBI, Local development) 
• Maintain service related documentation according with client standards 
• Monitoring and SLA Management 
• Document, maintain and optimize processes and configurations related to the environments 
• Manage and support service related risk assessments and audits 

What you'll bring along

• Minimum of 5-7 years of experience in data engineering 
• At least 3 years’ experience with data oriented Python (Polars, Pandas, Pyspark,…) 
• At least 3 years’ experience with Microsoft Azure 
• Solid understanding of cloud architecture 
• ITIL (not necessarily certified, but idea of IT service management)  
• Experience with software as a service concept 
• Strong analytical skills 
• Organizing abilities 
• Strong customer focus 
• Can rapidly adapt and respond to changes in environment and priorities 
• Advanced English is a must 
• Excellent communication skills with high customer focus 
• Excellent stakeholder management skills 

Nice to have:

• Experience with Synapse, Delta Lake and/or PowerBI 
• Experience in Bl Projects 
• Familiarity with DevOps processes 
• Familiarity with DataVault 2.0