Data Engineering Lead
Tasks
- Build asset based pipelines in Dagster
- Deliver API backed feeds and enrichment pipelines
- Develop Terraform infrastructure as code
- Enable customer pipelines and reverse ETL workflows
- Implement CI CD for infra and data code
- Implement data quality checks and observability
- Improve ingestion across Airbyte OSS and DLT
- Lead team coaching mentoring code reviews and testing
- Manage BigQuery partitioning clustering and query performance
- Own data platform roadmap
Perks/Benefits
- Equity options
- Flexible working arrangements
- Group life assurance
- Hybrid working
- Income protection
- Paid parental leave
- Paid sabbatical
- Paid sick leave
- Paid sick leave with income protection
- Private medical insurance
- Professional development budget
- Work abroad
Skills/Tech-stack
API | AWS | Airbyte | BigQuery | CI/CD | Checkpointing | Cloud Storage | DLT | Dagster | Data Validation | ECS | Fargate | GCP | GCS | GCS Cloud Storage | Idempotency | Incident Management | Integration Testing | Monitoring | Observability | Pydantic | Python | RDS | Rate Limiting | S3 | SQL | Schema evolution | Terraform | Unit Testing
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Lead Software Engineer - MLOps Platform GBP 72K-80KAWS | Amazon SageMaker | Ansible | Azure | BentoMLSenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Pricing Analytics Lead EMEA GBP 55K-70KBehavior Analysis | Competitor Analysis | Customer Behavior Analysis | Customer behavior | DashboardsSenior-level Full TimeGillingham - Medcare North, UK, United …1d ago
-
Mechanical Engineering Manager Spine Robotics GBP 45K-60KAgile | Controls integration | DFMEA | DOORS | Design for AssemblyInclusive work environment | Reasonable accommodationSenior-level Full TimeGB012 Leeds - Beeston, United Kingdom1d ago
-
Lead Analytics Engineer GBP 90K-110KAccess Control | Amazon Redshift | Apache Superset | CI/CD | ClickHouseSenior-level Full TimeBristol, UK2d ago
-
Senior-level Full TimeBristol, UK2d ago
-
Mid-level Full TimeLondon, United Kingdom2d ago
-
Senior-level Full TimeLondon, GB2d ago
-
Lead Data Analyst - Treasury (FX Markets) GBP 75K-100KDBT | Data Analysis | Data Modeling | Data Visualization | Data WarehousingHybrid working | Paid annual holiday | Paid sick days | Parental leave | SabbaticalSenior-level Full TimeLondon, United Kingdom3d ago
-
Data Science Lead - AML Risk GBP 75K-100KExperiment design | Machine Learning | OOP | Precision-recall | PythonSenior-level Full TimeLondon, United Kingdom3d ago
-
Senior Analytics Manager - FinCrime GBP 75K-100KAnalytics Strategy | Business Intelligence | Data Analysis | Data Modeling | Data QualitySenior-level Full TimeLondon, United Kingdom3d ago
-
Lead Data Architect GBP 86K-106KData Architecture | Data Engineering | Data Governance | Data Lineage | Data ModelingHybrid workingSenior-level Full TimeNewbury, England, United Kingdom4d ago
-
API Design | Agile | Apache Airflow | Application Resiliency | C#Senior-level Full TimeLONDON, United Kingdom7d ago
-
Partnership Analytics Lead - 14 Months FTC GBP 62K-80KAzure | Copilot Studio | DBT | Microsoft Fabric | Power AutomateHybrid work modelSenior-level ContractLondon, England, United Kingdom R7d ago
-
Data Engineering Manager GBP 45K-56KBigQuery | CI/CD | DBT | Data Vault | Data meshFlexible benefits | Flexible working | Learning and development budget | Life assurance | Matched contribution pension schemeMid-level Full TimeLondon, England, United Kingdom R7d ago
-
AI Solutions Lead GBP 24K-24KAWS | Artificial Intelligence | Azure | Cloud Architecture | Cloud platformCollaborative & Inclusive Culture | Continuous learning and development | Professional growthSenior-level Full TimeLondon, United Kingdom7d ago
-
Lead Data Engineer GBP 45K-60KAPIs | Analytics | Ansible | Azure | Cloud platformHybrid work environment | Learning and developmentSenior-level Full TimeUK - Hook, United Kingdom7d ago
-
Azure Databricks Engineering Lead GBP 78K-109KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid work | Learning and development opportunities | Wellbeing programsSenior-level Full TimeLondon, GB7d ago
-
Engineering - Data Engineer - Vice President - London GBP 121K-146KApache Iceberg | Apache Spark | Avro | CI/CD | ContainerizationExecutive-level Full TimeLondon, Greater London, England, United Kingdom8d ago
-
Lead AI Analyst GBP 64K-80KAPI Integration | Anomaly Detection | Azure AI | Code review | Computer VisionSenior-level Full TimeLeicester, Leicestershire, United Kingdom8d ago
-
Lead Data Scientist GBP 46K-52KAgile | Computer Vision | Data Engineering | Data Visualization | Ethical AIFlexible work schedule | Hybrid working | Professional developmentSenior-level Full TimeLeeds, United Kingdom8d ago
-
Lead Data Engineer GBP 80K-95KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employee clubs and events | Employee feedback and performance reviewsSenior-level Full TimeEdinburgh8d ago
-
Lead Practitioner Robotics GBP 65KAudit and review | Care planning | Clinical Protocol | Clinical Protocol Development | Clinical guideline developmentAnnual leave | Bicycle Loan Scheme | Company pension scheme | Employee assistance programme | In-house trainingSenior-level Full TimeKing Edwards VII Hospital, United Kingdom8d ago
-
Lead Data Analyst - Treasury (FX Markets) GBP 75K-100KDBT | Data Modeling | Data Visualization | Experimental Design | PythonHybrid working | Paid annual leave | Paid sabbatical | Paid sick leave | Parental leaveSenior-level Full TimeLondon, United Kingdom9d ago
-
Lead Data Scientist GBP 78K-100KAWS | Agentic AI | Azure | Data Pipelines | EmbeddingsDiverse team culture | Growth opportunities | Inclusive culture | International careersSenior-level Full TimeLondon9d ago
-
Data Science Manager, Supply Marketplace GBP 45K-57KAllocation | Causal Inference | Experimentation | Forecasting | Liquidity modelingBenefits | Remote work within UKMid-level Full TimeLondon or Remote within UK R9d ago