Senior Data Engineer - Databricks

Empowered by our motto, "Making Data Matter", Keyrus stands at the forefront of global consultancy in Data & Analytics, AI & Machine Learning, and Digital Transformation. With a presence in 27 countries across 4 continents, we're on a mission to elevate the impact of data.

We are data experts, guiding our clients through their data journey regardless of their level of maturity in analytics. As an end-to-end partner, we address varied challenges that our clients face, from Advanced Analytics, Cloud, Data Governance, Visualisation to Enterprise Performance Management, from advisory to delivery.

With more than 3200 employees in all corners of the world, Keyrus is dedicated to helping businesses taking advantage of the Data and Digital paradigm to enhance their performance, facilitating, and accelerating their transformation, and generating new drivers of growth, competitiveness, and sustainability.

Job Summary 

Keyrus is looking for an Senior Databricks / Data Engineer. The ideal candidate embodies technical prowess in Databricks and Azure, coupled with a fervent commitment to making every piece of data matter. We value individuals who are detail-oriented, independent contributors with exceptional communication and problem-solving skills, ensuring that together, we continue to transform possibilities into reality.

This position is remote.

Note: All applications/CV’s must be submitted in English.

Key Responsibilities

• Collaborate on the design, implementation, and automation of the CI/CD process for seamless deployment.
• Fully automate the promotion of project solutions, code, and dependent assets (e.g., jobs, workflows, and other dependencies) between DEV, TEST, and PROD environments.
• Ensure smooth deployments by implementing efficient CI/CD pipelines in real-world customer scenarios.
• Provide guidance and best practices for managing applications on Azure Databricks, including Compute and Unity Catalog.
• Stay current with the latest Azure Databricks releases and continuously improve deployment processes based on new features and updates.

Requirements for the role

• Proven experience in designing and automating CI/CD processes in complex environments.
• Expertise in Azure Databricks, including hands-on experience with Compute, Unity Catalog, and other platform features.
• Ability to provide guidance and advisory services on best practices for deployment and automation.
• Up-to-date knowledge of the latest Azure Databricks releases and capabilities.
• Strong experience in promoting project solutions and assets across multiple environments (DEV to TEST to PROD).
• Strong skills in scripting languages (e.g., Python, PowerShell, Bash) for automation.
• Experience with Git and integrating it into CI/CD pipelines.
• Familiarity with other Azure services like Data Lake, Storage, and Key Vault.
• Ability to implement monitoring and logging for pipeline performance and troubleshooting.
• Understanding of security practices in CI/CD and data platforms.
• Experience working in Agile/Scrum environments.
• Good communication skills to collaborate with cross-functional teams.
• Fluent in English
• Must be a Portuguese or European citizen or have a work permit for Portugal

What we offer at Keyrus Portugal:

• Competitive salary based on your skills & experience and according to the Data market practice
• Meal allowance of €8.32 per day
• Flexible benefits option
• Private Medical Insurance
• 22 days of annual leave (increasing every 3 years up to a maximum of 25 days)
• Training Program through KLX (Keyrus Learning Experience) Platform

Why Keyrus?

Joining Keyrus means joining a market leader in the Data Intelligence field and an (inter)national player in Management Consultancy and Digital Experience.

Keyrus Portugal operates on five guiding pillars that shape our approach to work and collaboration – Diversity; Trust; Flexibility; Ownership & Innovation - we're dedicated to cultivating a team as diverse as the challenges we take on. 

We embrace and celebrate the rich variety of backgrounds, perspectives, and talents that each individual brings. We firmly believe that diversity fuels innovation, ignites creativity, and propels us towards greatness. 

Regardless of race, ethnicity, gender, sexual orientation, disability, age, or any other dimension of diversity, everyone is not only welcome but valued here. 

Join us in shaping a future where everyone can thrive!