Senior Data Engineer (Databricks) - UK

At DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and Data Science consulting company, recognized for our innovation and rapid growth. We have been named Databricks EMEA Emerging Business Partner of the Year and have achieved a second consecutive appearance on the Financial Times FT1000 list.

At DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and Data Science consulting company recognized for innovation and rapid growth. We have been named Databricks EMEA Emerging Business Partner of the Year and have achieved a second consecutive appearance on the Financial Times FT1000 list.

We are currently looking for a Senior Data Engineer to join us remotely in the UK. We plan to set up a hub in the UK in the following 12-18 months to enable our GTM strategy, and this would be our first hire in the region. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles.

"As a Data Engineer at DATAPAO, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it never gets boring! Sorting out a complex technical puzzle, setting up a new data architecture from scratch, or guiding our customers through adopting the latest technologies is our routine here. Hence, we'd expect you to be more than just a (data) engineer. We'd expect you to breathe and live data, to thrive for knowledge and excellence, and to be keen to build something enduring and impactful for our customers. We'd expect you to be a (data) Paoneer!"  (Máté Gulyás, CEO)

What will you do?

As a Senior Data Engineer, you are expected to deliver (across industries) on some of our most complex projects - individually or by leading small delivery teams. Although we work for the biggest multinational companies where years-long behemoth projects are the norm, our projects are fast-paced, typically 2 to 4 months long. Most are delivered using Apache Spark/Databricks on AWS/Azure and require you to directly manage the customer relationship alone or in collaboration with a Project Manager. Additionally, at this seniority level, we expect you to compound your impact across the team and the organization - by supporting our pre-sales process, mentoring more junior engineers, and contributing to hiring best-in-class data talent.

What does it take to fit the bill?

Technical Expertise

• You (ideally) have 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP).

• You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog).

• You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.)

• You’re proficient in SQL and Python, using them to transform and optimize data like a pro.

• You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep)

• You’ve hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker)

 Consulting & Client-Facing Skills

• Ideally, you bring a proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. If you bring a product company background with you, that's also fine as long as you can show a good consulting mindset and desire to be customer-facing.

• You’ve successfully delivered projects like Data Lakehouse buildouts and cloud data migrations.

• You excel in explaining technical concepts to non-technical audiences and drive decision-making.

Operational Readiness & Soft Skills

• You’re (almost) ready to hit the ground running, immediately contributing to live client projects.

• In a fast-paced consulting environment, where no two days are the same, flexibility and problem-solving comes naturally to you. Furthermore, resilience and thriving on challenges are essential traits in our industry.

• Your communication skills are on point—whether you’re writing, speaking, or collaborating with stakeholders, you know how to keep everyone in the loop.

What do we offer?

• You'll have the rare opportunity to join DATAPAO at a time when you can still meaningfully impact our growth trajectory and organizational success. Furthermore, as our first-ever UK hire, you’ll also get to spearhead our regional expansion.

• Surely, we know everyone needs a little something to do their best work. Here is a list of some other extras we offer:  

• The chance to work remotely. As we don't have a physical office in the UK yet, we offer a fully remote setup for the time being. However, given our strong community emphasis, we'd expect you to spend one month in our Budapest hub during onboarding and visit the office for one week every quarter. 

• World-class educational benefits - there’s no shortage of learning opportunities at DATAPAO, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library; 

• Flexible PTO days - We’re flexible with how many days you take off if that does not conflict with customer success and the work getting done!

• 4 weeks of paternity leave - Because we think it’s important for both parents to be there when it matters the most;

• Employee Assistance Program (EAP) - Life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person.

• Pension scheme enrolment and a comprehensive private health insurance plan. Offered via our EOR (Employer of Record) provider, Remote.com. Remote will be your official employer in the UK for the foreseeable future until we establish our own legal entity in the UK.

• Top-notch working equipment. Working comfortably means working well. You will get a MacBook Pro, a phone, and a sign-up bonus of 1000 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best.

• The chance to make an impact in a high-transparency culture. Open feedback and no politics are things we value a lot at DATAPAO. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company.

IMPORTANT NOTE: Given that we are still sorting our ways out in the UK, this list will likely get an update in the following months, and we're also committed to growing it with us over time.

The gross salary for this position ranges from 70.000 to 100.000 GBP/year, depending on your assessed seniority level during the selection process.

About DATAPAO

At DATAPAO, we are delivery partners and the preferred training provider for Databricks, the creators of Apache Spark. Additionally, we are Microsoft Gold Partners in delivering cloud migration and data architecture on Azure. Our delivery partnerships enable us to work in a wide range of industries and with some of the most prominent global companies such as Norsk-Hydro, Richter, Bayer, Schufa, GetYourGuide, TechnoAlpin and Logically to name just a few.

As a training provider, we deliver onsite and online courses globally for Databricks and on our own. We have been teaching professionals at Apple, Amazon, Uber, Microsoft, T-Mobile, GE, Ericsson, and many more to improve their impact with data.

For more insights into DATAPAO, check the below links:

• Designing and Implementing a Real-time Data Lake with Dynamically Changing Schema (EN) by Máté Gulyás (2021, Spark AI Summit)
• Productionising Machine Learning models (EN) by Máté Gulyás (2023, Mndwrk Event)
• "Ha a data governance jól működik, az olyan, mint egy láthatatlan szupererő” (HU) by Máté Gulyás (2023, Com-Forth Zóna Podcast)

You can also follow us on LinkedIn for all the good stuff or just hit our recruitment team at jobs@datapao.com

We’re strong believers in scaling up a team without judgment or prejudice. What we really care about is working with the best people out there, no matter their background. And you should also not worry if you don't tick every box in the requirements. If you’re passionate about data and learning new things, you’ll fit right in, and we'd love to hear back from you.

When we hear back from you, we'd like you to know that we are committed to your privacy and keeping your data safe. We do not share your data with any third parties (except the ones we use to run our recruitment process) and keep your application for two years unless you ask us otherwise. We use your data solely for recruitment purposes, such as letting you know about new career opportunities at DATAPAO and/or managing your application.