Databricks Engineer

Job Title

Databricks Engineer

Location(s)

United Kingdom - Remote Horizon

About Us

Revvity is a developer and provider of end-to-end solutions designed to help scientists, researchers, and clinicians solve the world’s greatest health challenges. We pair the enthusiasm of an industry disruptor with the experience of a longtime leader. Our diverse team of 11,000+ colleagues from around the globe are vital to our success and the reason we’re able to push boundaries in pursuit of better human health.

Find your future at Revvity 

We are seeking an experienced and skilled Databricks Engineer with data engineering expertise using the Azure tech stack to join us at a pivotal moment in our digital transformation journey. The ideal candidate will be instrumental in the move from multiple legacy systems to a modern data environment utilising the medallion architecture principles. The role involves designing, building, and maintaining efficient and scalable data pipelines to ensure smooth data integration and transformation. The candidate will also be responsible for setting up and managing connections between Databricks and various other services. You will work closely with other data engineers, analysts, architects, third-party vendors, and cross-functional teams. As a company, we strive to empower scientists to improve healthcare for all, so this is your chance to contribute to that aim.

Tech Stack / Tools

• Databricks (essential)
• PySpark/Python (essential)
• SQL (essential)
• Azure data platform (Azure Data Factories, Synapse, Data Lake, Azure SQL DB, OpenAI) (highly desirable)
• Microsoft Dynamics 365 / Microsoft Dynamics AX / SAP / Other ERP Systems (desirable)
• Microsoft Power Platform (PowerApps, Power Automate - Flow) (desirable)
• CDC tools like Qlik Replicate and Fivetran HVR (desirable)
• CI/CD, Azure Devops, Github (desirable)
• AI tools (desirable)
• API for gathering data from external sources (desirable)
• Power BI (desirable)
• Other databases (PostgreSQL, MySQL, Cosmos DB) (desirable)

Key Responsibilities

• Working on the design and implementation of the core business Unified Data Platform (UDAP)
• Developing Databricks scripts and data pipelines as well as enhancing a robust framework to ensure consistency in the code and deployments
• Connect Databricks to other services to pull in data from disparate source
• Liaise with third-party vendors to allow rapid scaling of resources
• Migration of the legacy business data onto the new platform and then retiring older systems
• Supporting the legacy business in all data-related requirements, whilst on the transformation journey, to ensure continuity of business-critical reporting
• Document processes and implement best practices
• Be an active member of a global team

About You

• 3-5 years of proven commercial Databricks experience
• 7+ years’ experience of working with data warehouses/data lakes
• Proven experience working in a senior data engineering role using cloud technology
• Strong understanding of modern data architecture, including medallion architecture, data warehousing concepts and dimensional modelling
• Ability to architect data solutions and influence senior management based on sound reasoning as well as the ability to direct and work with third-party consultants and vendors and evaluate their offerings and completed work.
• Excellent communication skills with the confidence to challenge and defend design decisions.
• Attention to detail and methodical approach
• Ability to work autonomously, be self-motivated and results-driven
• Creative and able to solve business problems
• Industry certifications
• A degree or equivalent experience in a related discipline