Data Engineer (Databricks/Gen AI)

Keyrus is an international consulting firm, specializing in the integration of data intelligence and Digital solutions. With over 3,500 employees spread across 25 countries, Keyrus continues to deliver on such projects to a wide range of clients from various industries including but not limited to Banking/Finance, Healthcare/pharmaceuticals, FMCG, Oil & Gas, and more.

As part of Keyrus’ solution delivery, we are also in a position to recruit and place technical consultants to complement on existing client projects with their expertise. As such, we seek innovative and agile people to support ambitious and forthcoming technological challenges.

We're seeking a Data Engineering Consultant with expertise in Databricks and Generative AI to build scalable data pipelines and integrate LLMs into enterprise workflows. This role combines modern data engineering with AI innovation to support advanced analytics and GenAI solutions.

Responsibilities:

• Build and optimize ETL/ELT pipelines using Databricks and Apache Spark.
• Design and manage Delta Lake architectures and medallion data models.
• Develop and deploy GenAI workflows, including LLM integration, embeddings, and vector databases.
• Collaborate with data scientists to support prompt engineering and RAG pipelines.
• Ensure best practices in data quality, governance, and CI/CD.
• Document data architecture, pipelines, and lineage.

Requirements:

• 4+ years in Data Engineering with strong Databricks and Spark experience.
• Proficient in Python, SQL, and cloud platforms (Azure, AWS, or GCP).
• Experience with LLMs, LangChain, vector DBs, and embedding models.
• Solid understanding of data modeling, pipeline orchestration, and AI integration.
• Familiarity with tools like Hugging Face, OpenAI, or Azure OpenAI.

What we offer

Keyrus offers a working environment and projects that attract the best people working in business intelligence, data analytics, and digital transformation. Working on diverse and challenging projects, you will have the opportunity to develop multi-disciplinary IT/business skills to help you build a strong career path.

You will be part of a young and ever learning enterprise with an established international network of thought leading professionals driven by bridging the gap between innovation and business. You get the opportunity to meet specialised and professional consultants in a multicultural ecosystem.

Who we are

Keyrus, creator of value in the era of Data and Digital.

Keyrus is dedicated to helping enterprises take advantage of the Data and Digital paradigm to enhance their performance, facilitating and accelerating their transformation, and generating new drivers of growth, competitiveness, and sustainability.

Keyrus in APAC employs more than 220 highly skilled consultants and is part of the international Keyrus Group, an international player in consulting and technologies and a specialist in Data and Digital. Created in 1996, listed on Euronext's Eurolist, with consolidated revenues of US$400m in 2023 and with more than 3,500 employees in 27 countries, the Keyrus Group offers the performance, solidity and know-how of a large professional services organisation, whilst preserving the agility of a young company.