Lead Data Engineer
Any UK Office Hub (Bristol / London / Manchester / Swansea)
GBP 80K-96K Senior-level Full Time
Tasks
- Apply data transformation at scale
- Build data pipelines
- Contribute to recruitment
- Create batch and streaming transformations
- Define data strategies
- Design data platforms
- Develop reusable data libraries
- Document data processing diagrams
- Guide DevOps approach
- Implement data storage
- Implement unit integration and data quality tests
- Improve project resilience with testing
- Integrate error handling in pipelines
- Own cloud infrastructure using DevOps
- Present system architecture diagrams
- Provide line management
- Work with agile teams using Scrum XP Kanban
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Azure | Batch Processing | C4 model | CI/CD | CSV | Cloud Architecture | Cloud platform | DRY | Data Lake | Data Pipelines | Data Quality | Data Transformation | Data Warehouse | Data analytics | Data integration | Data mesh | DataOps | Databricks | DevOps | Docker | Git | GitHub Actions | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Integration Testing | JSON | Kanban | Orchestration | Reusable libraries | SOLID | Scrum | Streaming processing | TDD | Test-Driven | Test-Driven Development | UML | Unit Testing | XP | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Principal Data Engineer | Digital Services GBP 51K-55KAPIs | Azure | Data Lake | Data Modeling | Data PipelinesBenefits | Flexible working | Hybrid working | Local government pension schemeSenior-level Full TimePreston, Lancashire, United Kingdom7h ago
-
MLOps Engineering Specialist GBP 55K-58KAWS | AWS CDK | AWS CloudFormation | Alerting | Amazon SageMakerDiscounted mobile and broadband | Equalized maternity paternity adoption leave | Gym memberships | Holiday purchase scheme | Online private GP 24 7Mid-level Full TimeLondon, GB, E1 8EP R8h ago
-
Data Engineer GBP 31K-34KAPI | AWS | Apache Spark | Data Lake | Data WarehouseAnnual leave | Hybrid working | Mentoring and coaching | Pension scheme | Performance bonusMid-level Full TimeBelfast, United Kingdom8h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous work culture | Entrepreneurial team | Hands-off management | Inclusive workplace | Opportunity to make impactMid-level Full TimeLondon, United Kingdom11h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Life-changing product impact | Remote/distributed workMid-level Full TimeLondon, United Kingdom11h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Entrepreneurial team | Remote/distributed workMid-level Full TimeManchester, United Kingdom11h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Flexible management approach | Opportunity for impact | Remote/distributed workMid-level Full TimeEdinburgh, United Kingdom11h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote workMid-level Full TimeBristol, United Kingdom11h ago
-
Bash | Data Ingestion | Data Ingestion Pipelines | Data Processing | DockerAsynchronous culture | Friendly atmosphere | Remote workMid-level Full TimeBirmingham, United Kingdom11h ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous work culture | Career growth opportunity | Remote/distributed work | Supportive team environmentMid-level Full TimeGlasgow, United Kingdom11h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingMid-level Full TimeLeeds, United Kingdom11h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive salary | Entrepreneurial team support | Friendly laid-back atmosphereMid-level Full TimeNewcastle, United Kingdom11h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Collaborative team environment | Flexible management approach | Impactful mission | Remote-first workMid-level Full TimeNottingham, United Kingdom11h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Remote-friendlyMid-level Full TimeBrighton, United Kingdom11h ago
-
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 74K-103KAI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial IntelligenceHybrid schedule | Travel opportunities | Workshops and community engagementSenior-level Full TimeLondon, United Kingdom R13h ago
-
Forward Deployed Solution Engineer – Applied AI FDE GBP 90K-110KAWS | Angular | Azure | CI/CD | ContainersAgile sprint delivery | Remote or flexible work options | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom20h ago
-
Lead Analytics Engineer (6 Month FTC) GBP 60K-70KCI/CD | DBT | Data Modelling | Data Quality | Data TestingDiscounted private healthcare | Employee assistance programme | Enhanced family leave | Free onsite gym | Health cash planSenior-level Contract Full Time TemporaryManchester / Hybrid, England, United Kingdom R1d ago
-
Director, Generative AI Experience Engineering GBP 61K-80KAI Observability | AWS | Agent systems | Azure | CI/CDHybrid work flexibility | In office days requirementExecutive-level Full TimeLondon1d ago
-
Senior Data Engineer GBP 53K-70KAgile | Apache Airflow | BigQuery | CI/CD | Cloud ComposerBirthday off | Cycle2Work | Dental insurance | Discounts on broadband TV mobile | Electric vehicle leaseSenior-level Full TimeLondon1d ago
-
Forward Deployed Engineer, Google Cloud Consulting GBP 111K-125KAPIs | Agent systems | Cloud platform | Cost Optimization | CrewAIMid-level Full TimeLondon, UK1d ago
-
DataOps Engineer GBP 70K-81KAzure DevOps | Azure SQL | Azure SQL Database | Backup/Restore | CI/CD27 days holiday per year | Contributory pension scheme | Cycle to work scheme | Death in service | Digital health app accessSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Lead Software Engineer - Python and kdb+ / AI data integration, Alt Data & Data Ingestion GBP 80K-109KAI | AWS | Agile | Analytics | Automated testingCareer growth | Collaboration | Inclusive environment | Mentorship | Technical excellenceSenior-level Full TimeLONDON, United Kingdom1d ago
-
Mid-level Full TimeLondon, United Kingdom1d ago
-
Senior Analytics Engineer GBP 85K-105KData Governance | Data Modelling | Data Quality | Data Security | Data WarehouseAllocated learning and development budget | Enhanced parental leave | Flexible benefits | Free meals and snacks | Prayer meditation and breastfeeding roomSenior-level Full TimeLondon (Shoreditch) R1d ago
-
Data Engineer - Kids Planet Central Support GBP 30K-33KAPI | AWS | Azure | Cloud Platforms | Data GovernanceAnniversary Awards | Birthday leave | Career progression | Discounted childcare | Employee assistance programmeMid-level Full TimeLymm, England, WA13 0RN, GB1d ago