Lead Data Engineer

Overview:

We are seeking a Lead Data Engineer to join our data function. The ideal candidate will possess strong expertise in data engineering and data warehousing, driving forward our Quantum modelling efforts. There are large amounts of data available internally and externally to model for the purposes of Quantification and this role will be key in structuring the data for reporting and analytics.

The role is working primarily on our Latin American cases. The data engineering team will build out Quantification data marts on our Azure data platform, sourcing data from our Case Management system (Litify/Salesforce), from Client questionnaires and evidence submissions, and from third party data sources.

You will work closely with the global Technology & Data team, leveraging the existing data platform architecture and Pogust Goodhead datasets. The wider team will share best practices, data governance and business knowledge helping both teams deliver more for our colleagues.

Key Responsibilities:

· Data Pipeline Development: Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other Azure data services.

· Database Management: Implement and manage scalable data storage solutions, including Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake.

· Data Integration: Integrate data from various sources, ensuring data consistency, quality, and security across different systems.

· Performance Optimisation: Monitor and optimise data processes for performance, scalability, and reliability. Troubleshoot and resolve any data-related issues.

· Collaboration: Work closely with data scientists, data analysts, and other stakeholders to understand data needs and provide technical solutions. Ensure seamless data flow and accessibility for analytical and reporting purposes.

· Data Governance: Implement and maintain data governance practices, ensuring data privacy, security, and compliance with relevant regulations.

· Documentation: Document data processes, architectures, and workflows to ensure knowledge sharing and maintainability.

· Team management: Coach and mentor a team of data analysts, and data engineers.

Requirements

Experience: Minimum of 5-7 years of experience in data engineering/data warehousing.

· Technical Skills:

o Proficiency in SQL and experience with relational databases (Azure SQL Database, SQL Server).

o Experience with big data technologies and frameworks (Azure Synapse Analytics, Azure Data Lake, Hadoop, Spark, Azure Databricks).

o Proficiency in CI/CD (Azure DevOps)

o Version Control (GIT)

o Strong programming skills in SQL, Python/Pyspark, Java, or Scala.

o Familiarity with data integration tools and platforms (Azure Data Factory, Apache NiFi).

o Knowledge of cloud computing and data services, particularly Azure.

· Analytical Skills: Strong problem-solving skills with the ability to analyse complex data systems and processes.

· Communication Skills: Excellent verbal and written communication skills, with the ability to collaborate effectively with both technical and non-technical stakeholders.

· Attention to Detail: High attention to detail and a commitment to data quality and accuracy.

· Team Player: Ability to work collaboratively in a team environment and manage multiple projects simultaneously.

Qualifications:

· Education: Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field.

Please note that this role is only open to individuals who already have the legal right to work in the UK. Unfortunately, we are unable to offer visa sponsorship, and applications from candidates without existing UK work authorisation will not be considered and will be automatically disqualified from the process.

Benefits

Pogust Goodhead is an equal opportunities employer. We passionately believe that our team should represent the diverseness of the clients that we support, not least because it’s the diversity of perspective, thought, background and cultures that helps make us one of the leading global law firms in the class actions space. We are committed to providing a place of work that provides fair and equitable career growth, with learning opportunities for all our employees. We do not tolerate discrimination of any kind within our firm, and we strive to create a culture that offers opportunity for all, regardless of race, culture, gender, age, sexual orientation, socio-economic background, disability, veteran status, or religious belief.