Lead Data Engineer
Any UK Office Hub (Bristol / London / Manchester / Swansea)
GBP 80K-96K Senior-level Full Time
Tasks
- Apply data transformation at scale
- Build data pipelines
- Contribute to recruitment
- Create batch and streaming transformations
- Define data strategies
- Design data platforms
- Develop reusable data libraries
- Document data processing diagrams
- Guide DevOps approach
- Implement data storage
- Implement unit integration and data quality tests
- Improve project resilience with testing
- Integrate error handling in pipelines
- Own cloud infrastructure using DevOps
- Present system architecture diagrams
- Provide line management
- Work with agile teams using Scrum XP Kanban
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Azure | Batch Processing | C4 model | CI/CD | CSV | Cloud Architecture | Cloud platform | DRY | Data Lake | Data Pipelines | Data Quality | Data Transformation | Data Warehouse | Data analytics | Data integration | Data mesh | DataOps | Databricks | DevOps | Docker | Git | GitHub Actions | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Integration Testing | JSON | Kanban | Orchestration | Reusable libraries | SOLID | Scrum | Streaming processing | TDD | Test-Driven | Test-Driven Development | UML | Unit Testing | XP | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Inclusive workplace | Remote-friendlyMid-level Full TimeCambridge, United Kingdom20h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeReading, United Kingdom20h ago
-
Data Engineer GBP 70K-70KBusiness Intelligence | DBT | Data Modeling | Data Pipelines | Data QualityAnnual company offsite | Learning and development stipend | Monthly co-working stipend | Social travel stipendMid-level Full TimeUnited Kingdom R20h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Impact on learning accessibility | Remote workMid-level Full TimeCardiff, United Kingdom20h ago
-
Data Engineer GBP 34K-34KAgile | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataCelebration day | Employee discount | Employee sample sales | Paid annual leave | Personalised learningEntry-level Full TimeLondon, England, United Kingdom20h ago
-
Data Engineer GBP 60K-65KAWS Lambda | Airbyte | Amazon S3 | Amazon Web Services | DBT24 days holiday | Bank holidays | Birthday off | Coaching access | Company retreatMid-level Full TimeZinc - London R21h ago
-
Senior-level Full TimeLondon, United Kingdom21h ago
-
Senior GenAI Engineer GBP 90K-115KCI/CD | Cloud infrastructure | Docker | Embeddings | Integration TestingFlexible schedule | Hybrid work | Knowledge sharing sessions | Professional developmentSenior-level Full TimeManchester, United Kingdom21h ago
-
Data Engineer - Protect (South) GBP 33K-41KData Engineering | Data Governance | Data Quality | Data Security | Data WarehousingAnnual bonus | Buy As You Earn Scheme | Colleague discount | Holiday allowance | Hybrid workMid-level Full TimeReigate -The Omnibus Building, Lesbourne Road, …21h ago
-
Senior Data Analytics Engineer GBP 75K-109KAgile | Alerting | Azure Data | Azure Data Platform | CI/CDAdditional paid holiday | Cycle to work scheme | Eye care support | Generous holiday package | Hybrid workingSenior-level Full TimeSouthampton, ENGLAND, United Kingdom1d ago
-
Staff Applied Scientist GBP 225K-325KBlack | Cloud Platforms | Complex Planning | Deep learning | Explainable AISenior-level Full TimeLondon1d ago
-
AI Data Engineer GBP 111K-133KAgent memory | Amazon Web Services | Audio Processing | Batch Processing | Cloud infrastructureAccess to AI tools | Equity | OwnershipMid-level Full TimeLondon1d ago
-
Lead Data Platform Engineer GBP 84K-110KAmazon Web Services | Continuous Delivery | Continuous Integration/Continuous Delivery | Continuous integration | DatabricksSenior-level Full TimeLondon, UK, United Kingdom1d ago
-
Senior Analytics Engineer GBP 60K-70KCommon table expressions | DBT | Data Quality | Data Testing | Data WarehousingOn-going training | Skills for lifeSenior-level Full TimeLondon, GB1d ago
-
Principal Data Engineer GBP 70K-89KAWS | AWS Glue | Airflow | ArgoCD | AvroAutonomy | Influence | Mentorship | Professional growthSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Lead AI Engineer GBP 72K-120KAPI | AWS | Amazon Bedrock | CI/CD | DockerAnnual leave | Bank holidays | Employee assistance program | Flexible benefits | Hybrid work modelSenior-level Full TimeLondon, United Kingdom R1d ago
-
Financing Quantitative Analyst GBP 84K-93KArtificial Intelligence | Azure | Azure Data | Azure Data Bricks | C plus plusCareer development opportunities | Disability inclusion support | Flexible working options | Inclusive cultureMid-level Full TimeLondon, United Kingdom1d ago
-
Principal Data Engineer GBP 90K-109KADLS Gen2 | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake StorageHybrid workingSenior-level Full TimeManchester, United Kingdom1d ago
-
Data Platform Engineer GBP 60K-70KAzure | Data Contracts | Data Governance | Data Lineage | Data ModelingMid-level Full TimeManchester, United Kingdom1d ago
-
Mid-level Full TimeUK113 - Newcastle UK (UK113), United …1d ago
-
Senior Tech Lead, Quantitative Analytics Engineering GBP 72K-109KAPI Development | Agile delivery | Autogen | Azure | C#Healthcare | Hybrid work arrangement | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Analysis | Data Generation | Data Quality | Human-in-the-loop | Language ProcessingSenior-level Full TimeLondon, England, GBR1d ago
-
Insights Product Manager - Analytics Engineering GBP 50K-68KAmplitude | Anomaly alerting | CI/CD | DBT | Data CatalogAnnual leave | Counselling access | Employee assistance program | Free Economist content access | Moving home supportMid-level Full TimeLondon - Commercial R1d ago
-
Agent Orchestration | Authentication | Backend Development | CI/CD | Frontend DevelopmentBPSS clearance | Hybrid workSenior-level Contract Full TimeSheffield, England, United Kingdom1d ago
-
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 70K-100KAI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial IntelligenceHybrid work schedule | Travel for customer visits and events | Workshops seminars and community buildingSenior-level Full TimeLondon, United Kingdom; Paris, France R1d ago