Lead Data Engineer
Any UK Office Hub (Bristol / London / Manchester / Swansea)
GBP 80K-96K Senior-level Full Time
Tasks
- Apply data transformation at scale
- Build data pipelines
- Contribute to recruitment
- Create batch and streaming transformations
- Define data strategies
- Design data platforms
- Develop reusable data libraries
- Document data processing diagrams
- Guide DevOps approach
- Implement data storage
- Implement unit integration and data quality tests
- Improve project resilience with testing
- Integrate error handling in pipelines
- Own cloud infrastructure using DevOps
- Present system architecture diagrams
- Provide line management
- Work with agile teams using Scrum XP Kanban
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Azure | Batch Processing | C4 model | CI/CD | CSV | Cloud Architecture | Cloud platform | DRY | Data Lake | Data Pipelines | Data Quality | Data Transformation | Data Warehouse | Data analytics | Data integration | Data mesh | DataOps | Databricks | DevOps | Docker | Git | GitHub Actions | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Integration Testing | JSON | Kanban | Orchestration | Reusable libraries | SOLID | Scrum | Streaming processing | TDD | Test-Driven | Test-Driven Development | UML | Unit Testing | XP | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Data Engineer GBP 70K-70KAgile | Behavior-Driven Development | CI/CD | Code review | Data EngineeringDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 57K-57KAgile | Alteryx | Automated testing | Behavior-Driven Development | CI/CDDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceMid-level Full TimeLondon, United Kingdom1d ago
-
Principal Data Engineer GBP 50K-60KAWS | AWS CDK | AWS Glue | AWS Lake Formation | AWS LambdaFlexible working | Hybrid work options | Learning and development | Remote work options | Supportive cultureSenior-level Full Timeleeds, Manchester1d ago
-
Lead Data Engineer GBP 50K-60KAWS | AWS CDK | AWS Glue | AWS Lambda | Amazon AthenaFlexible working | Hybrid options | Professional growth | Remote options | Supportive cultureSenior-level Full Timeleeds, Manchester1d ago
-
Senior Machine Learning Engineer GBP 72K-85KBatch Machine Learning | CI/CD | Containerization | Data Pipelines | Data parallelismDisability accommodations during hiring process | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer GBP 51K-55KApache Airflow | Azure Data | Azure Data Factory | Azure Functions | C#Hybrid work options | Knowledge sharing culture | Professional growth opportunities | Work flexibilityMid-level Full TimeBristol, 3 RIVERGATE, United Kingdom1d ago
-
Manager, Data Science GBP 57K-68KBayesian statistics | Cloud platform | Data Preparation | GCP | Google CloudMid-level Full TimeUnited Kingdom1d ago
-
Senior Ai Engineer (AI/ML/R&D) GBP 84K-109KAWS | CI/CD | Infrastructure as Code | LLM | Machine LearningAnnual leave | Company share scheme | Health insurance | Home-office allowance | Pension planSenior-level Full TimeManchester, United Kingdom1d ago
-
Entry-level Full Time17th Floor, 5 Aldermanbury Square, London, …1d ago
-
Junior Engineer (Graduate) GBP 32K-32KAWS | Azure | CI/CD | Docker | Feature EngineeringCareer development | Training and certificationEntry-level Full Time17th Floor, 5 Aldermanbury Square, London, …1d ago
-
Lead Ai Engineer (AI/ML/R&D) GBP 85K-120KAWS | Artificial Intelligence | CI/CD | Cloud Native | Information RetrievalAnnual leave | Company share scheme | Health insurance | Home-office allowance | Pension planSenior-level Full TimeManchester, United Kingdom1d ago
-
Software Engineering III - AI/ML Engineer GBP 80K-109KAWS | Automation | Databricks | Datadog | Disaster RecoverySenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Data Engineer GBP 80K-110KAirflow | Anomaly Detection | BigQuery | CDC | CI/CDEquity | Health insurance | Income protection | Life cover | Pension planSenior-level Full TimeGreater Manchester, England, United Kingdom1d ago
-
Principal Machine Learning Engineer GBP 84K-115KCloud Computing | Containerization | Data Science | Docker | KubernetesCoaching | Enhanced parental leave | Family-friendly flexibility | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
Senior Machine Learning Engineer GBP 80K-87KAWS | Behavior-Driven Development | CloudFormation | DVC | Data orchestrationGrowth plan | Gym discounts | Learning resources | Mental health support | MentorshipSenior-level Full TimeLondon R1d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Remote-friendly | Supportive teamMid-level Full TimeManchester, United Kingdom1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeNewcastle, United Kingdom1d ago
-
Staff Applied Scientist GBP 110K-160KCloud Computing | Complex Planning | Data Analysis | Deep learning | Explainable AIEMI share option scheme | Generous share options | Hybrid work schedule | Mentoring and coaching cultureSenior-level Full TimeLondon1d ago
-
Senior Applied Scientist GBP 100K-120KBlack | Cloud Computing | Deep learning | Git | GitHubEMI share option scheme | Remote work hybrid scheme | Share options | Tax efficient equity scheme | Team days in personSenior-level Full TimeLondon1d ago
-
365 Admin Center | Access Control | Admin Center | Data Cleansing | Data GovernanceEntry-level Contract Full Time TemporaryCanary Wharf, 1 Churchill Place, United …1d ago
-
Senior AWS Data Platform Developer GBP 72K-85KAWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS Lake FormationSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
ML/AI Engineer GBP 70K-85KAutoscaling | Blue/green | CI/CD | CUDA | CanaryAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeManchester Westminster House, United Kingdom1d ago
-
Responsible AI Lead GBP 90K-110KAgent Builder | BigQuery | CI/CD | Cloud Run | Cloud SQLAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeManchester Westminster House, United Kingdom1d ago
-
Lead AI Scientist GBP 90K-131KAI Ops | Agentic AI | Artificial Intelligence | Bias Mitigation | Cloud platformAnnual bonus | Discounted shopping | Flexible working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom1d ago
-
AI Engineer / AI Analyst GBP 60K-80KAI Evaluation | Agent systems | CI/CD | Cloud Computing | ComplianceCycle to work scheme | Employee Assistance Programme (EAP) | Employer pension contributions | Health related time off | Hybrid workingMid-level Full TimeUK-London-Chiswick Bldg 5 Floor 4, United …1d ago