Data Platform Engineer (f/m/d)

Big Data & Advanced Analytics provides data platform and services to enable the development of data science, analytics by the businesses across the value chain served by Deutsche Börse Group. We standardize and automate processes with modern technologies and frameworks.

As part of our cloud migration and digital transformation journey, we are looking for an experienced and passionate Data Platform Engineer with a diverse range of skills who brings fresh and innovative ideas and enjoys designing and building big data solutions with positive attitude.

In this role you will join a growing and diverse big data experts to cover topics ranging from contributing to defining and deploying the overall cloud data architecture including cloud services evaluation, platform design and configuration, to support the implementation of business use cases in the big data and data science fields in one of the biggest exchanges in the world.

• Provision and configure Databricks workspaces using Terraform, CLI & SDK
• Set up workspace-level settings including clusters, libraries, and compute policies
• Define and manage catalogs, schemas, and tables across workspaces
• Ensure the data platform is operational, secure, scalable, and reliable
• Contribute to define Data Mesh paradigm with different data domains
• Act as a technical advisor to data scientists, analysts, and business users
• Write and maintain technical documentation and perform tasks in Agile methodology

• Hands on experience with cloud native big data technologies, Azure/GCP
• Experience in building data pipelines such as Data Factory, Apache Beam, or Apache Airflow
• Familiarity with at least one data platforms and processing frameworks such as Kafka, Spark, Flink; Delta Lake and Databricks is a big plus
• Demonstrated experience in one or more programming languages, preferably Python
• Knowledge in CI/CD tools such as GitHub Actions is a plus
• Knowledge of data management, monitoring, security, and privacy
• Strong team player willing to cooperate with colleagues across office locations and functions
• Very strong English language skills are a must