Senior Data Engineer
United Kingdom
Spire Healthcare
Experts In Private Healthcare. Over 3,700 Consultants and 38 Award Winning Private Hospitals · Long Visiting Hours · Wide Range of TreatmentsKey Responsibilities
• Data Engineering & Integration: Design and build robust, reusable data pipelines (ETL/ELT) from diverse sources (on-prem, cloud, third-party) into Microsoft Fabric.
• Data Transformation & Storage: Implement scalable data processing across medallion architecture layers, ensuring alignment with data modelling and storage standards.
• Data Quality & Security: Enforce data quality checks, lineage, and role-based access controls using tools like Microsoft Purview and Azure RBAC.
• Collaboration & Insights: Partner with analysts, scientists, and business stakeholders to deliver actionable insights and support advanced analytics and ML workloads.
• Operational Excellence: Develop CI/CD pipelines (Azure DevOps), implement monitoring and alerting, and maintain documentation and training for stakeholders.
• Governance & Leadership: Uphold architectural standards, mentor junior engineers, and contribute to continuous improvement and innovation.
Required Experience & Skills
• 7+ years in data engineering, BI, or database architecture roles.
• Proven expertise in Microsoft Fabric, Azure Data Factory, Data Lake, SQL Server, and Power BI.
• Strong coding skills in SQL, Python, and PySpark.
• Experience with data integration (batch, streaming, event-driven) for structured, semi structured and unstructured data, data quality frameworks, and CI/CD practices.
• Familiarity with Azure security tools (RBAC, Key Vault) and configuration management.
Desirable Qualifications
• Certifications: Azure DP-700, Azure Data Engineer Associate, Power BI Data Analyst Associate.
• Experience with Agile/SAFe, FHIR/OMOP data standards, and data modelling tools.
Personal Attributes
• Strong leadership and mentoring capabilities, with collaboration focus.
• Excellent communication and stakeholder engagement skills.
• Passion for quality, innovation, and continuous learning.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Azure CI/CD Data pipelines Data quality DevOps ELT Engineering ETL Machine Learning OMOP Pipelines Power BI PySpark Python Security SQL Streaming Unstructured data
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.