Lead Data Engineer (Contract, Full-Time) [HR208] (UK)
Greater London
R
A GBP 70K-80K (estimate) Senior-level Contract Full Time
Tasks
- Architect data pipelines and infrastructure
- Build and optimize vector search retrieval and machine learning data pipelines
- Contribute to technical architecture decisions and data strategy
- Define data team culture standards and hiring bar
- Design data ingestion transformation and storage architectures
- Develop and manage batch and real time data pipelines
- Ensure data reliability security and governance
- Implement monitoring observability and data quality frameworks
- Optimize performance of large scale datasets and query systems
- Support training inference and product features
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Spark | Batch data | Batch data pipelines | Data Governance | Data Modeling | Data Pipelines | Data Quality | Distributed Systems | Elasticsearch | Event Driven | Event-driven architecture | Kafka | Machine Learning | Machine learning data | Machine learning data pipelines | Milvus | MongoDB | Monitoring | MySQL | NoSQL | Observability | OpenSearch | PGVector | Pandas | Polars | PostgreSQL | Python | Qdrant | Real Time | Real-time Data | Real-time data pipelines | Stream processing | Vector Databases
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Analytics Engineer GBP 53K-60KAWS | AWS Glue | Airflow | Amazon Redshift | DBTAnnual Holiday Vouchers | Company bonus scheme | Discounted flights | Flexible benefits | Free easyJet Plus membershipMid-level Full TimeUnited Kingdom-London-London Luton Airport R19h ago
-
Data Engineer GBP 51K-51KAgile | Cognos | Data Modeling | Data Warehousing | Data virtualizationBalanced lifestyle | Flexible working arrangements | Hybrid working | Learning opportunities | Support for financial wellbeingMid-level Full TimeGB-ENG-LAN-Warton R19h ago
-
Analytics Engineer GBP 45K-60KDBT | Data Documentation | Data Modeling | Data Observability | Data TestingDiscounts via Cobens Extras | Dog-friendly office | Duvet Day | Financial coaching | Flexible workEntry-level Full TimeLondon, England, United Kingdom R20h ago
-
Senior Research Data Engineer GBP 91K-120KAWS | Batching | DPO | Data Generation | Data PipelinesHybrid work options | Virtual interviews | Work from home optionSenior-level Full TimeLondon, England, United Kingdom R1d ago
-
Senior-level Full TimeEdinburgh R1d ago
-
Staff Software Engineer (Agentic Engineering) GBP 113K-170KAgentic Workflows | Amazon Web Services | Context Management | Distributed Systems | DockerSenior-level Full TimeUnited Kingdom R1d ago
-
Senior Software Engineer - Applied AI GBP 94K-120KC++ | CI/CD | Cybersecurity | FDA | GitFree meals | Fresh fruit | Group life assurance | Lunch vouchers | Mental health supportSenior-level Full TimeLondon, UK R1d ago
-
Applied AI Architect, Industries GBP 165K-190KClaude API | Cloud Architecture | Data Science | Enterprise Integration | EvaluationSenior-level Full TimeLondon, UK R1d ago
-
Senior Engineer, Data Infrastructure GBP 86K-103KAI/ML | AWS | Access Control | Access Management | AirflowHybrid work | Operational support involvement | UK work authorizationSenior-level Full TimeCambridge, UK R1d ago
-
Benchmarking | Bioinformatics | Data Modeling | Language Models | Large Language ModelsEmployee assistance program | Flexible schedule | Hybrid work schedule | Mentorship | Onsite internshipEntry-level InternshipLondon R1d ago
-
Technical Deployment Lead GBP 165K-230KAI Agents | Artificial Intelligence | Change Management | Enterprise Architecture | KPI DevelopmentFlexible working hours | Generous vacation | Hybrid work policy | Parental leave | Visa sponsorshipSenior-level Full TimeLondon, UK R1d ago
-
Platform Data Engineer - Cardiff GBP 65K-75KAWS | AWS Glue | Airflow | Amazon Redshift | Apache SparkAdoption leave | Annual leave | Annual research credit | Bank holidays | Flexible workingMid-level Full TimeCardiff, Wales, UK R1d ago
-
Data Science GBP 75K-200KCloud platform | Data Exploration | Docker | Google Cloud | Google Cloud PlatformBi-Annual retreats | Enhanced parental leave | Equity | Hybrid workingMid-level Full TimeLondon R1d ago
-
Analytics Engineer GBP 75K-200KAnalytics engineering | Data Modeling | Data Pipelines | Data Quality | PythonBi-Annual retreats | Enhanced parental leave | Equity compensation | Hybrid workingMid-level Full TimeLondon R1d ago
-
Agentic Architectures | Agile | Artificial Intelligence | CI/CD | Event DrivenFlexible work hours | Hybrid work | Inclusive workplaceSenior-level Full TimeStaines-upon-Thames, England, United Kingdom R1d ago
-
Data Engineer GBP 38K-45KAPI Integration | AWS | AWS Glue | AWS Lambda | Amazon DynamoDBAnnual leave | Community initiatives | Pension scheme | Private healthcare | Tax efficient benefitsMid-level Full TimeLondon, England, United Kingdom R1d ago
-
Data Engineer GBP 38K-45KAPIs | AWS | Apache Spark | Data Lakes | Data WarehousingAnnual leave | Coaching | Community involvement | Hybrid working | Learning budgetMid-level Full TimeManchester, United Kingdom R1d ago
-
Data Engineer GBP 38K-45KAPI Integration | AWS | AWS Glue | AWS Lambda | Amazon AthenaAnnual leave | Community initiatives | Company pension | Cycle to work | Give as you earnMid-level Full TimeBristol, England, United Kingdom R1d ago
-
Machine Learning Engineer GBP 55K-55KAzure Machine Learning | Clustering | Data Monitoring | Decision Trees | DevOpsHybrid working | Opportunities for mentoring and coaching | Training and developmentMid-level Full TimeManchester, Greater Manchester, United Kingdom R1d ago
-
Data Engineer GBP 52K-75KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureAbility to make impact | Flexible work schedule | Opportunity to work on cutting-edge technology | Remote work one day per week | Team collaborationMid-level Full TimeLondon R2d ago
-
Engineering Lead – Data, Analytics & AI GBP 92K-109KAI Governance | Amazon Web Services | Apache Beam | CI/CD | CloudDiscounted shopping | Flexible working | Hybrid working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom R2d ago
-
Chief AI Engineer GBP 137K-172KAI Agents | Agentic AI | Artificial Intelligence | Chatbots | Conversational AIDiscounted shopping | Hybrid working | Job share | Paid time off | Parental leaveExecutive-level Full TimeLondon 25 Gresham Street, United Kingdom R2d ago
-
Lead Data Scientist GBP 92K-109KAnomaly Detection | Cybersecurity | Data Science | Deep learning | Fine TuningAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeEdinburgh Sighthill North, United Kingdom R2d ago
-
Lead Data Engineer GBP 92K-109KAI Governance | AWS | Automated testing | Azure | Best practicesBonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeEdinburgh Sighthill North, United Kingdom R2d ago
-
Data Product Delivery Lead GBP 78K-93KAWS | Agile | Apache Iceberg | Artificial Intelligence | Azure3 Days Per Week In Office | Hybrid workSenior-level Full TimeGlasgow Campus, United Kingdom R2d ago