Expert Consultant in Unity Catalogue on Databricks with Purview (Lisbon)

About our company

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

Your role

We are looking for a Databricks Specialist Consultant with a deep focus on Unity Catalog and Microsoft Purview, responsible for migrating files in Parquet format stored in Azure Storage Account containers to Delta Table format, with the implementation of a layered architecture (Bronze, Silver, Gold) in Databricks. The consultant will also be responsible for integrating these Delta Tables into Unity Catalog with centralised governance via Microsoft Purview, ensuring that the data is accessible and well governed while being used for dynamic reporting in Power BI.

Responsibilities:

• Expertise in Unity Catalog;
• Advanced integration with Microsoft Purview;
• Implementation of Layered Data Architecture;
• Notebook Conversion and Delta Table Optimisation;
• Reports and Visualisations with Power BI.

Your profile

• Expertise in Unity Catalog in Databricks;
• Advanced experience with Microsoft Purview for data governance and auditing;
• Proven ability to migrate and optimise data in Delta Tables and register in Unity Catalog;
• In-depth knowledge of data manipulation in Azure Storage Accounts and Databricks;
• Experience with data integration in Power BI for dynamic reports and visualisations.

Nice to Have:

• Microsoft Azure certifications, such as Azure Data Engineer or Azure Solutions Architect.
• Experience with PySpark for task automation and optimisation in Databricks.

What you'll love about working here

• Join a multicultural and inclusive team environment;
• Enjoy a supportive atmosphere promoting work-life balance;
• Engage in exciting national and international projects;
• Hybrid work;
• Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities;
• Training and certifications programs;
• Referral program with bonuses for talent recommendations;
• Great office locations.

Why Capgemini?

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Apply now!