Lead Data Engineer
Any UK Office Hub (Bristol / London / Manchester / Swansea)
GBP 80K-96K Senior-level Full Time
Tasks
- Apply data transformation at scale
- Build data pipelines
- Contribute to recruitment
- Create batch and streaming transformations
- Define data strategies
- Design data platforms
- Develop reusable data libraries
- Document data processing diagrams
- Guide DevOps approach
- Implement data storage
- Implement unit integration and data quality tests
- Improve project resilience with testing
- Integrate error handling in pipelines
- Own cloud infrastructure using DevOps
- Present system architecture diagrams
- Provide line management
- Work with agile teams using Scrum XP Kanban
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Azure | Batch Processing | C4 model | CI/CD | CSV | Cloud Architecture | Cloud platform | DRY | Data Lake | Data Pipelines | Data Quality | Data Transformation | Data Warehouse | Data analytics | Data integration | Data mesh | DataOps | Databricks | DevOps | Docker | Git | GitHub Actions | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Integration Testing | JSON | Kanban | Orchestration | Reusable libraries | SOLID | Scrum | Streaming processing | TDD | Test-Driven | Test-Driven Development | UML | Unit Testing | XP | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Mid-level Full TimeLondon, United Kingdom2h ago
-
Embedded Software Engineer GBP 45K-60KARM | Agile | Bare Metal | Bitbucket | CANAnnual bonus scheme | Bank holidays | Enhanced maternity pay | Enhanced paternity pay | Flexible working optionsMid-level Full TimeGuildford, United Kingdom3h ago
-
Senior Data Engineer GBP 80K-95KAWS | Apache Airflow | Apache Spark | Data Modeling | Databricks25 days annual leave | Bank holidays | Birthday day off | Cycle to work scheme | Enhanced parental leaveSenior-level Full TimeLondon, United Kingdom16h ago
-
Data Engineer GBP 80K-105KAWS | Airflow | Data Architecture | Data Ingestion | Data TransformationCycle to work scheme | Enhanced parental leave | Holidays | Hybrid working | Learning and development budgetSenior-level Full TimeLondon, United Kingdom R21h ago
-
Senior Data Engineer - AWS GBP 70K-80KAWS | AWS Lake Formation | Amazon Kinesis | Apache Spark | CI/CDAdoption leave | Backup care sessions | Critical illness cover | Cycle to work | Dental insuranceSenior-level Full TimeUK - Glasgow22h ago
-
Principal AWS Data Engineer GBP 80K-100KAWS | AWS Lake Formation | Amazon Kinesis | Apache Hadoop | Apache KafkaBackup care sessions | Competitive pension | Critical illness cover | Cycle to work | Dental insuranceSenior-level Full TimeUK - Glasgow22h ago
-
AWS Data Engineer GBP 63K-80KAWS | AWS Glue | Amazon Kinesis | Apache Airflow | Apache KafkaAnnual leave | Backup care sessions | Business coach | Critical illness cover | Cycle to workSenior-level Full TimeUK - Glasgow22h ago
-
Digital Analytics Engineer GBP 65K-80KA/B | A/B Testing | Apache Spark | Attribution Modeling | B testingEmployee discount | Employee sample sales | Paid annual leave | Personalised learning opportunities | Private medical careSenior-level Full TimeLondon, England, United Kingdom22h ago
-
Senior Analytics Engineer GBP 50K-60KAmazon Redshift | BI | BigQuery | Data Engineering | Data ModelingAnnual leave | Charitable time off | Healthcare | Parental leave | PensionSenior-level Full TimeLondon - The River Building HQ22h ago
-
AI Engineer GBP 61K-73KAPIs | AWS | Asynchronous processing | CI/CD | CloudWatch25 days holiday per year | Cycle garage and showers | Dental scheme | Free soft drinks | Hybrid workingMid-level Full TimeUnited Kingdom, London23h ago
-
Machine Learning Engineer GBP 97K-130KAWS | Autonomous Agents | Computer Vision | Continuous integration | Deep learningSenior-level Full TimeLondon, United Kingdom1d ago
-
Software Engineer (Inference Platform) GBP 80K-127KAlerting | Asynchronous programming | CI/CD | Continuous Deployment | Continuous integrationHybrid workingMid-level Full TimeLondon R1d ago
-
Senior ML Engineer, Computer Vision GBP 75K-111KAWS EKS | AWS Lambda | Amazon S3 | CI/CD | DETREquity | Health benefits | Professional developmentSenior-level Full TimeUK, United Kingdom1d ago
-
Conversational Analytics Engineer - GCP GBP 70K-90KAPI Orchestration | Agentic AI | Artificial Intelligence | BigQuery | Cloud platformCareer advancement | Hybrid work option | Learning and development training access | Professional development programs | Remote work optionMid-level Full TimeLondon1d ago
-
Data Engineer (GCP) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformEntry-level Full TimeManchester, England, United Kingdom1d ago
-
Data Engineer GCP (Remote) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformCareer growth | Remote workMid-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
Mid-level Full TimeStoke-on-Trent, England, United Kingdom1d ago
-
AI Engineer GBP 45K-50KAI Search | Azure AI | Azure AI Search | Azure OpenAI | DatabricksAbility to purchase additional annual leave | Annual leave | Discretionary bonus scheme | Employee assistance program | Employee share purchase planMid-level Full TimeLondon, United Kingdom1d ago
-
Batch Processing | Deep learning | Evaluation Methodologies | Language Models | Language ProcessingWork from home flexibilitySenior-level Full TimeLondon1d ago
-
Junior Data Engineer GBP 30K-34KCyber Security | Data Assurance | Data Engineering | Data Governance | Data IngestionEntry-level Full TimeManchester, Greater Manchester, United Kingdom1d ago
-
Tech Lead MLOps - Decision Technology GBP 100K-160KCI/CD | Data Pipelines | Event Sourcing | Feature Service | Feature StoreAccess to learning platforms | Company retreats | Cycle to work scheme | Discounted gym membership | Electric car schemeSenior-level Full TimeLondon1d ago
-
Agentic AI Engineer, AI Automation GBP 70K-89KAI Search | AWS | Agents SDK | Autogen | AzureAdditional paid time off | Employee resource groups | Flexible working hours | Hybrid work model | Modern Health App accessMid-level Full TimeLondon1d ago
-
Senior Data Engineer GBP 80K-103KAWS | Apache Spark | Data Modeling | Data Monitoring | Data QualityDental insurance | Equity | Fully remote | Healthcare insurance | Learning and development stipendSenior-level Full TimeUnited Kingdom / Netherlands - Remote R1d ago
-
Software Engineer – Backend GBP 57K-78KAudit Logging | Authentication | Authorization | Automated testing | C++Mid-level Full TimeBristol, UK1d ago
-
Reporting & Analytics Lead GBP 61K-61KAnalytics Cloud | Analytics Strategy | Data Governance | Data Quality | DatabricksAccident insurance | Annual leave | Family-friendly leave | Flexible benefits | Life assuranceSenior-level Full TimeLancaster House, United Kingdom1d ago