Data Engineering Lead
Tasks
- Build asset based pipelines in Dagster
- Deliver API backed feeds and enrichment pipelines
- Develop Terraform infrastructure as code
- Enable customer pipelines and reverse ETL workflows
- Implement CI CD for infra and data code
- Implement data quality checks and observability
- Improve ingestion across Airbyte OSS and DLT
- Lead team coaching mentoring code reviews and testing
- Manage BigQuery partitioning clustering and query performance
- Own data platform roadmap
Perks/Benefits
- Equity options
- Flexible working arrangements
- Group life assurance
- Hybrid working
- Income protection
- Paid parental leave
- Paid sabbatical
- Paid sick leave
- Paid sick leave with income protection
- Private medical insurance
- Professional development budget
- Work abroad
Skills/Tech-stack
API | AWS | Airbyte | BigQuery | CI/CD | Checkpointing | Cloud Storage | DLT | Dagster | Data Validation | ECS | Fargate | GCP | GCS | GCS Cloud Storage | Idempotency | Incident Management | Integration Testing | Monitoring | Observability | Pydantic | Python | RDS | Rate Limiting | S3 | SQL | Schema evolution | Terraform | Unit Testing
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Lead Analytics Engineer GBP 85K-125KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working | Paid annual leave | Paid sabbatical | Parental leave | Restricted stock unitsSenior-level Full TimeLondon, United Kingdom23h ago
-
Lead Machine Learning Engineer GBP 72K-95KAWS | Azure | Cloud Computing | Docker | Google CloudCoaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeLondon1d ago
-
AWS | Automation | Azure | Cisco | FortinetSC Security Clearance eligibilityMid-level Full TimeBelfast, GB, BT1 3BT1d ago
-
AI | Acceptance Testing | Angular | Cloud | Data LineageEmployee assistance program | Employee discounts | Hybrid work | Learning and development resources | Paid parental leaveSenior-level Full Time33 CANADA SQUARE CANARY WHARF LONDON, …1d ago
-
Digital and AI Solution Lead GBP 58K-70KAgentic AI | Automation | Cause analysis | Data Engineering | Data platformCycle scheme | Flexible working | Life assurance | Pension scheme | Perk At Work Discount SchemeSenior-level Full TimeCheshire-Warrington, UK1d ago
-
Digital and AI Solution Lead GBP 58K-70KAgentic AI | Automation | Cause analysis | Data Engineering | Data ManagementCycle scheme | Flexible working | Life assurance | Pension scheme | Recommend a Friend bonusSenior-level Full TimeCheshire-Warrington, UK1d ago
-
Member of Technical Staff (Robotics Research Lead) GBP 250K-270K3D Perception | 3D Reconstruction | C++ | Computer Vision | Deep learningSenior-level Full TimeUK, Remote R1d ago
-
Lead Data Scientist, Sports GBP 72K-80KCloud Computing | Machine Learning | Model Validation | Predictive Modeling | Probability theoryHybrid workingSenior-level Full TimeManchester, England, United Kingdom2d ago
-
Lead Data Scientist, Sports GBP 72K-80KCloud Computing | Computational Efficiency | Data Science | Machine Learning | Model ValidationHybrid workingSenior-level Full TimeStoke-on-Trent, England, United Kingdom2d ago
-
Lead Machine Learning Engineer GBP 72K-80KArtificial Intelligence | Cloud Computing | Cloud platform | Google Cloud | Google Cloud PlatformHybrid workSenior-level Full TimeLondon, UK R2d ago
-
Lead Data Scientist GBP 52K-65KAzure Machine Learning | Data Analysis | Data Governance | Data Preparation | ExperimentationAnnual performance-related bonus | Contributory pension scheme | Development days | Flexible buy sell holiday options | Hybrid workingSenior-level Full TimeGuildford, ENG, GB, GU2 8XG2d ago
-
Senior-level Full TimeLondon, United Kingdom3d ago
-
Senior Data Analyst GBP 51K-75KAutomation | Continuous Improvement | Data Quality | Data queries | Data reportingEmployee assistance programme | Employee discounts | Flexible benefits | Learning and development | Life assuranceSenior-level Full TimeUK - Remote, United Kingdom R3d ago
-
Applied AI Analytics Lead 14 Months FTC GBP 70K-90KAzure Foundry | Copilot Studio | DBT | Data Modeling | Microsoft FabricHybrid work modelSenior-level ContractLondon, England, United Kingdom R4d ago
-
Data Engineering Manager GBP 85KAgile | Azure | Azure Synapse | CI/CD | Data EngineeringContributory pension scheme | Development days | Flexible buy sell holiday options | Flexible working options | Hybrid workingMid-level Full TimeGuildford, ENG, GB, GU2 8XG4d ago
-
Agile | Cloud Platforms | Data Architecture | Data Observability | Data QualityHybrid workingSenior-level Full TimeUnited Kingdom, United Kingdom4d ago
-
Senior Manager - Data Engineering GBP 45K-62KBigQuery | CI/CD | Click | Cloud Build | Cloud FunctionsFlexible working | Hybrid workingSenior-level Full TimeLondon R4d ago
-
Data Science Lead - Logistics GBP 62K-80KArtificial Intelligence | Big Data | Cloud | IoT | JavaAnnual leave | Buy As You Earn Scheme | Cycle to work scheme | Employee assistance programme | Employee discountsSenior-level Full TimeLondon, United Kingdom R5d ago
-
AI Engineer / Machine Learning Engineer GBP 85K-100KAlgorithms | Cloud Computing | Data Science | Data Structures | DockerSenior-level Full TimeLondon, England, United Kingdom5d ago
-
Lead Data Analyst - Marketing Analytics GBP 70K-78KA/B | A/B Testing | Airflow | B testing | BigQueryCycle to work scheme | Discounts and deals | Employee assistance plan | Flexible working options | Health cash planSenior-level Full TimeLondon5d ago
-
Lead Data Analyst - Marketing Analytics GBP 70K-80KA/B | A/B Testing | Airflow | B testing | BigQueryCycle to work scheme | Employee assistance plan | Flexible working options | Health cash plan | Learning and development supportSenior-level Full TimeEdinburgh5d ago
-
Risk Analytics Lead, VP GBP 85K-114KAsset-backed finance | Concentration risk | Data Modeling | Data Pipelines | Data QualityCharity Giving Options | Cycle to work scheme | Dental insurance | Enhanced parental leave | Enhanced pensionSenior-level Full TimeLondon, England, United Kingdom5d ago
-
Head of Fraud Analytics GBP 40K-50KAnalytics | Data Science | Fraud analytics | Model Deployment | PythonAnniversary rewards | Annual learning budget | Cycle to work scheme | Dog-friendly offices | Enhanced parental leaveExecutive-level Full TimeLondon6d ago
-
Associate Data Engineer GBP 40K-50KAWS | Data Modeling | Data Transformation | Data Warehouse | Data pipelineCafé | Career development opportunities | Continuous learning culture | Cycle to work scheme | Electric vehicle schemeMid-level Full TimeCrewe, England, United Kingdom7d ago
-
Lead Data Scientist - Fraud Prevention GBP 75K-100KData Preprocessing | Feature Engineering | Fraud Detection | Machine Learning | Model EvaluationSenior-level Full TimeLondon, United Kingdom8d ago