Data Engineering Lead (Data Acquisition)
London York Road, United Kingdom
GBP 60K-63K (estimate) Senior-level Full Time
Tasks
- Build batch and streaming pipelines
- Define target state ingestion patterns
- Drive resilience recoverability and cyber hygiene
- Implement CI/CD and automated testing
- Industrialize onboarding of data sources
- Lead Azure data platform design and build
- Lead data engineers and conduct design reviews
- Lead incident, change, and problem management
- Maintain SLAs observability and runbooks
- Manage data lifecycle and audit trail
- Measure and report service health and user satisfaction
- Own ingestion strategy
- Shape epics and stories with acceptance criteria
- Standardize connectors schemas contracts controls
- Steward data definitions ownership lineage metadata quality KPIs access policies
- Translate business requirements into acquisition backlog
Perks/Benefits
Skills/Tech-stack
API Integration | Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | Azure Synapse Analytics | CI/CD | Change Data Capture | Data Capture | Data Factory | Data Lake Storage | Data Lineage | Data Modeling | DevOps | Event Hubs | Infrastructure as Code | Kafka | Metadata Management | PySpark | Python | SQL | Schema management | Synapse Analytics | Test automation | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Responsible AI Lead GBP 90K-110KAgent Builder | BigQuery | CI/CD | Cloud Run | Cloud SQLAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeManchester Westminster House, United Kingdom1d ago
-
Lead AI Scientist GBP 90K-131KAI Ops | Agentic AI | Artificial Intelligence | Bias Mitigation | Cloud platformAnnual bonus | Discounted shopping | Flexible working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom1d ago
-
Lead AI Engineer (AI Systems & Automation) GBP 78K-109KAlerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetSenior-level Full TimeUnited Kingdom R1d ago
-
Lead Data Scientist GBP 72K-82KAnomaly Detection | Bayesian Methods | C# | Cross-validation | Data VisualizationHybrid working | Life assurance | Pension contribution | Private medical insurance | Professional certifications supportedSenior-level Full TimeLeeds, England, United Kingdom3d ago
-
Lead Data Scientist GBP 72K-82KAnomaly Detection | Apache Spark | Bayesian analysis | Bias Mitigation | C#Employee resource groups | Flexible working | Hybrid working | Life assurance | Pension contributionSenior-level Full TimeLondon, England, United Kingdom3d ago
-
Lead Data Scientist GBP 72K-82KAnomaly Detection | Bayesian Inference | C# | Cross-validation | Decision Trees25 days holiday | Employee resource groups | Flexible working | Hybrid working | Life assuranceSenior-level Full TimeBirmingham, England, United Kingdom3d ago
-
Lead Software Engineer - Python, Databricks, AWS GBP 72K-100KAWS | AWS Step Functions | Agile | Airflow | Apache SparkSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom3d ago
-
Head of Data Platform GBP 70K-75KAnalytics engineering | Cloud Computing | Cost Optimization | DBT | Data GovernanceExecutive-level Full TimeLondon, England, United Kingdom3d ago
-
API Design | Agile | Airflow | Application Resiliency | Automated testingCareer growth | Diversity inclusion respect | MobilitySenior-level Full TimeLONDON, LONDON, United Kingdom3d ago
-
Agile | Azure Data | Azure Data Factory | DBT | Data EngineeringContinuous learning | Discounts and promotions | Flexible working | Health and well-being | InsuranceMid-level Full TimeEdinburgh, GB, EH3 8EX4d ago
-
Senior-level Full TimeHomeworker - UK, United Kingdom4d ago
-
Lead Data Analyst GBP 70K-90KDashboard Development | Data Analysis | Data Interpretation | Data Modeling | Data VisualizationSenior-level Full TimeHomeworker - UK, United Kingdom4d ago
-
Data Engineering Manager GBP 81K-85KAirflow | Amazon Web Services | CI/CD | DBT | Data CatalogCareer development opportunities | Flexible office attendance | Wellbeing support | Work-life balance supportMid-level Full TimeStratford (2 Redman Place), United Kingdom4d ago
-
Lead Data Analyst - Pricing GBP 75K-115KApache Superset | DBT | Data Modeling | Data Visualization | LightdashSenior-level Full TimeLondon, United Kingdom4d ago
-
Lead Data Scientist – Energy Domain GBP 75K-85KAzure | Azure Machine Learning | Data Quality | Databricks | Feature EngineeringBackup care sessions | Career coaching | Critical illness cover | Gympass | Health insuranceSenior-level Full TimeUK - London4d ago
-
Data Science Lead - AML Risk GBP 75K-115KData Pipelines | Experiment design | Generative AI | Machine Learning | Model retrainingSenior-level Full TimeLondon, United Kingdom4d ago
-
Lead Data Scientist - Fraud Prevention GBP 75K-111KDashboards | Data Analysis | Data Preprocessing | Feature Engineering | Fraud DetectionSenior-level Full TimeLondon, United Kingdom4d ago
-
Lead Data Scientist - Trust and Safety GBP 75K-115KAnomaly Detection | Autoencoders | Clustering | Data Pipelines | Deep learningSenior-level Full TimeLondon, United Kingdom4d ago
-
Lead Data Analyst GBP 28K-28KBI infrastructure | Business Intelligence | Dashboarding | Data Analysis | Data QualityCompany pension | Cycle to work scheme | Dental coverage | Dog-friendly office | Employee assistance programmeSenior-level Full TimeLondon, England, United Kingdom4d ago
-
Lead Data Scientist GBP 95K-130KA/B | A/B Testing | B testing | Data Governance | Data ModelingFlexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R4d ago
-
Lead Data Engineer GBP 60K-80KAzure | CI/CD | Data Architecture | Data Governance | Data LakehouseHoliday-buy scheme | Hybrid working flexibility | Life insurance | Microsoft certification support | Ongoing professional developmentSenior-level Full TimeBillericay, United Kingdom4d ago
-
Advanced Analytics Lead GBP 75K-100KCausal Inference | Experimental Design | Factor Analysis | Index construction | Multivariate analysisHybrid working | MentoringSenior-level Full TimeLondon, 160 Old Street, United Kingdom5d ago
-
Data Engineer Lead GBP 86K-106KAWS | Cloud Architecture | Data Lakes | Data Pipelines | Data SecuritySenior-level Full TimeGlasgow Campus, United Kingdom5d ago
-
Technical Lead – Enterprise Data Platforms GBP 70K-80KAPI | Automation | CI/CD | Cloud Platforms | Data TransformationAccess to online courses | Health and wellbeing benefits | Hybrid and flexible working | Paid time offSenior-level Full TimeManchester, Greater Manchester, United Kingdom; Preston, …5d ago
-
Engineering Manager (Data & Analytics) GBP 100K-110KAI | Agile | Analytics engineering | Best practices | Data EngineeringFlexible working | Life assurance | Mental health support | Paid time off | Pension salary sacrificeMid-level Full TimeUnited Kingdom - Remote R5d ago