Data & Analytics Engineer

Job Description 

TIP Data & Analytics is dedicated to driving meaningful impact through data. We achieve this by building resilient, reliable, and scalable data platforms and pipelines that deliver engaging, informative, and actionable data products to internal and external stakeholders. As a Data Engineer in our agile, dynamic department, you will play a crucial role leveraging a modern, fully Azure-based cloud infrastructure. 

You will support our mission by designing and implementing robust data architectures within a medallion (bronze, silver, gold) architecture framework. Your primary responsibility will be developing metadata-driven, test-driven ETL/ELT pipelines using Azure Databricks and Apache Airflow, ensuring efficient extraction, transformation, and loading of data into Delta Lake storage on Azure Data Lake Storage Gen2. 

Your activities will consist of: 

• Designing, developing, and maintaining scalable, metadata-driven data pipelines using Azure Databricks and Airflow for workflow orchestration. 

• Contributing to our lakehouse platform engineering framework, including enhancing reusable, pre-tested code components. 

• Implementing Infrastructure as Code (IaC) solutions using Terraform within Azure DevOps deployment pipelines to automate and manage cloud resources effectively. 

• Developing and managing Delta Lake storage solutions within Azure Data Lake Storage Gen2, optimizing for performance, reliability, and scalability. 

• Applying test-driven development (TDD) practices to ensure pipeline reliability, data integrity, and facilitate continuous integration and deployment. 

• Collaborating closely with internal stakeholders to design source system architectures that enhance data quality and availability. 

• Developing monitoring, alerting, and observability solutions to maintain high availability and performance of data platforms. 

• Actively participating in integrating data from MS Dynamics-based ERP systems. 

We are looking for someone with the following qualifications: 

• Bachelor’s degree in Software Engineering, Computer Science, Business Analytics, or related field. 

• 3+ years of hands-on experience in Data Engineering using Python (PySpark preferred), Scala, or Java along with strong T-SQL proficiency. 

• Demonstrable experience with Azure Databricks, Apache Airflow, Delta Lake, Terraform, and Azure DevOps pipelines. 

• Knowledge of medallion architecture, data modeling best practices, including data vaults, data marts, and Kimball/Inmon modeling. 

• Experience implementing test-driven development practices in data engineering contexts. 

• Strong familiarity with agile methodologies in prior engineering roles. 

• Exceptional organizational and time-management abilities. 

• Strong communication skills, capable of articulating technical details clearly to both technical and non-technical stakeholders. 

• Legal authorization to work in the European Union. 

You will be a great fit if you: 

• Are passionate about building scalable, resilient data infrastructures and pipelines. 

• Have an engineering mindset, adept at abstracting complex problems into generalized, reusable solutions. 

• Thrive in structured problem-solving environments, naturally decomposing complex challenges into manageable components. 

• Adhere to best practices and emphasize code quality and maintainability. 

• Enjoy collaborative environments and actively seek pragmatic solutions to business challenges. 

• Feel comfortable leveraging data to guide business decisions and strategic directions. 

• Are enthusiastic about continuous learning and exploring innovative data engineering solutions. 

Application: Please click on “Apply” to submit your personal details, motivation letter, and CV. 

• No agency enquiries * 

We believe diversity drives innovation. The variety of nationalities, cultures, religions and ethnic backgrounds enrich our workforce by bringing together new ideas, innovations and thinking styles that lead to business success. Integrity, honesty and ethical behavior are at the core of our business. When we have a vacancy, we welcome everyone who has the potential, skills, commitment and honest way of working into our TIP family.