Data Engineering Lead
Tasks
- Build asset based pipelines in Dagster
- Deliver API backed feeds and enrichment pipelines
- Develop Terraform infrastructure as code
- Enable customer pipelines and reverse ETL workflows
- Implement CI CD for infra and data code
- Implement data quality checks and observability
- Improve ingestion across Airbyte OSS and DLT
- Lead team coaching mentoring code reviews and testing
- Manage BigQuery partitioning clustering and query performance
- Own data platform roadmap
Perks/Benefits
- Equity options
- Flexible working arrangements
- Group life assurance
- Hybrid working
- Income protection
- Paid parental leave
- Paid sabbatical
- Paid sick leave
- Paid sick leave with income protection
- Private medical insurance
- Professional development budget
- Work abroad
Skills/Tech-stack
API | AWS | Airbyte | BigQuery | CI/CD | Checkpointing | Cloud Storage | DLT | Dagster | Data Validation | ECS | Fargate | GCP | GCS | GCS Cloud Storage | Idempotency | Incident Management | Integration Testing | Monitoring | Observability | Pydantic | Python | RDS | Rate Limiting | S3 | SQL | Schema evolution | Terraform | Unit Testing
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Data Engineering Lead GBP 92K-109KAWS | Apache Beam | Apache Flink | Apache Kafka | Apache SparkDiscounted shopping | Flexible working | Hybrid working | Job share | Paid holidaySenior-level Full TimeBristol Harbourside, United Kingdom22h ago
-
Digital Marketing Data Scientist (COE) GBP 60K-90KAnomaly Detection | Artificial Intelligence | Attribution Modeling | Causal Inference | Data PipelinesComprehensive benefits package | Hybrid work model | Work from home flexibilitySenior-level Full TimeLondon, United Kingdom R22h ago
-
API | Cloud pipelines | DBT | Data Governance | Data LineageAdoption leave | Commuting allowance | Employee assistance program | Employee discounts | Family care leaveSenior-level Full TimeUK - London (London Wall), United …22h ago
-
AWS Glue | AWS Lambda | Agentic Systems | Amazon S3 | CalculusEntry-level Full TimeLONDON, United Kingdom1d ago
-
Engineering Lead - Analytics Platform GBP 45K-60KAWS | Airflow | CI/CD | CircleCI | DBTAutonomy | Career growth | Employee benefitsSenior-level Full TimeLondon (GB)1d ago
-
Member of Technical Staff, Robotics Research Lead GBP 225K-300K3D Perception | C++ | Computer Vision | Embodied AI | Generative ModelsFully Distributed Async First Culture | Hardware setup of your choice | Internet stipend | Meals stipend | Pension contributionSenior-level Full TimeLondon R2d ago
-
Applied AI Research Lead GBP 225K-325KC++ | Cross-Encoders | Deep learning | Embeddings | Evaluation FrameworksCollaborative work environment | Comprehensive benefits package | Flexible working arrangements | Professional growth opportunitiesSenior-level Full TimeAmsterdam, Netherlands; London, United Kingdom; Remote … R2d ago
-
Data Engineering Manager GBP 47K-66KBigQuery | CI/CD | DBT | Data Modeling | Data VaultDiscount on services | Discounted private health insurance | Electric car salary sacrifice | Employee assistance program | Family-friendly policiesMid-level Full TimeLondon, England, United Kingdom2d ago
-
Lead AI Engineer GBP 90K-100KAPI Design | AWS | Agent Orchestration | Airflow | AnthropicHealth insurance | Income protection | Learning and development budget | Life insurance | Paid time offSenior-level Full TimeLondon, England, United Kingdom2d ago
-
Treasury AI Engineering Lead GBP 90K-109KAgile | Architecture Design | Automated testing | Capital optimization | Cloud ComputingHybrid workSenior-level Full TimeLondon, United Kingdom2d ago
-
Data Engineering Manager GBP 41K-52KBigQuery | CI/CD | DBT | Data Vault | Data meshDiscount on services | Discounted private health insurance | Electric car salary sacrifice | Employee assistance | Flexible remote workingMid-level Full TimeLondon, England, United Kingdom5d ago
-
Cloud Computing | Data Architecture | Data Governance | Data Pipelines | Data WarehousingBonus | Car allowance | Hybrid work flexibility | PensionMid-level Full TimeMilton Keynes, United Kingdom5d ago
-
Anomaly Detection | Cloud platform | Data Cleansing | Data Governance | Data ModelingFlexible working | In-person collaboration daysSenior-level Full TimeUnited Kingdom5d ago
-
Digital Data Engineering Manager GBP 50K-60KAdobe Experience | Adobe Experience Platform | Airflow | CI/CD | CRMAnnual bonus | Car allowance | Company paid dental insurance | Company paid private medical insurance | Contributory pension schemeMid-level Full TimeSOUTHAMPTON, HAMPSHIRE, United Kingdom5d ago
-
Mid-level Full TimeBolingbrook, Illinois, United States5d ago
-
Senior Data Engineer GBP 60K-80KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employee clubs and events | Employer pension schemeSenior-level Full TimeLeeds5d ago
-
Lead Data Engineer GBP 86K-95KAgile | CSV | DBMS | Data Governance | Data ModelingAnnual leave | Buy and sell holiday | CPD training | Contributory pension | Cycle to work schemeSenior-level Full TimeLeeds, England, United Kingdom5d ago
-
Lead Analytics Engineer GBP 85K-110KAirflow | Analytics Pipelines | Business Intelligence | DBT | Data ModelingFlexible working | Paid annual holiday | Paid sabbatical | Paid sick days | Parental leaveSenior-level Full TimeLondon, United Kingdom6d ago
-
Senior-level Full TimeHolborn - London, United Kingdom6d ago
-
Data Engineering Technical Lead GBP 80K-100KAd hoc querying | Ad-Hoc | Batch Processing | Data Modeling | Data QualityEmployee development | Hybrid work model | MentorshipSenior-level Full TimeLondon, GBR, United Kingdom6d ago
-
AI Development Lead GBP 50K-65KAutomated testing | Azure | CI/CD | Cloud Computing | Copilot StudioFlexible working | Job share | Option to Buy Additional Holiday | Pension scheme | Private medical insuranceSenior-level Full TimeFareham, GB-HANTS, GB6d ago
-
Lead Data Analyst - CRM Analytics GBP 75K-100KA/B | A/B Testing | B testing | Customer Segmentation | DBTHybrid working | Paid annual holiday | Paid leave | Paid sabbatical | Paid sick daysSenior-level Full TimeLondon, United Kingdom7d ago
-
Lead Growth Analyst - Marketing Analytics GBP 85K-110KAI Automation | DBT | Data Modeling | Data Warehousing | Financial ModelingSenior-level Full TimeLondon, United Kingdom7d ago
-
Vice President - Evergreen Analytics Lead GBP 65K-80KAnalytics | Data Engineering | Data Quality | Data Visualization | Investment riskSenior-level Full TimeLondon, Greater London, England, United Kingdom8d ago
-
Embedded Linux Software Team Lead GBP 46K-70KC plus plus | C# | CI/CD | GDB | GitDisability income protection | Employee assistance program | Life insurance | Pension plan | Private healthcareSenior-level Full TimeFarnborough, Hampshire, United Kingdom8d ago