Lead Data Engineer
Tasks
- Build batch and streaming pipelines
- Build data models and platform components
- Collaborate cross functionally on platform delivery
- Design data pipeline architecture
- Embed data quality and privacy by design
- Embed observability and alerting in pipelines
- Enforce engineering standards
- Ensure alignment with data strategy
- Evaluate and recommend data tools
- Facilitate knowledge sharing
- Lead design sessions and code reviews
- Lead technical interviews and onboarding
- Maintain technical documentation
- Mentor and coach engineers
- Partner on team development planning
- Resolve technical debt
- Support complex data engineering problems
- Uphold data governance security and compliance
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Anomaly Detection | Batch Processing | BigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | Data Modeling | Data Quality | Data Vault | Dataflow | Dataform | Dimensional Modeling | Git | Google Cloud | Google Cloud Platform | Infrastructure as Code | Monitoring | Observability | PubSub | Python | SQL | Streaming | Terraform | Testing | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Data Analytics Engineer GBP 85K-95KAggregate Functions | BigQuery | CI | CTE | DBTRemote-flexible work | Team in person London every 6 to 8 weeksSenior-level Full TimeLondon, United Kingdom R1d ago
-
Commodity Trading Analytics Internship Program GBP 50K-60KData Analysis | Data Visualization | Excel | Financial Modeling | ForecastingCohort based learning | Mentorship | On-site internshipEntry-level InternshipLondon, United Kingdom1d ago
-
Senior Data Engineer GBP 65K-77KAutomation | Azure Data | Azure Data Services | CI/CD | Cloud ComputingSenior-level Full TimeLondon, Greater London, United Kingdom1d ago
-
DVP Data Engineer GBP 45K-55KAccelerometer | Automotive Engineering | Data Analysis | Data Visualization | Data acquisitionCareer development opportunities | Company events | Company pension | Free refreshments | On-site parkingMid-level Full TimeDaventry, England, GB1d ago
-
Senior Software Engineer - AI Solutions GBP 58K-85KDeveloper experience | Django | LLM | Python | Retrieval-Augmented GenerationFlexible work environment | Interview accommodations | Mentorship culture | Relocation supportSenior-level Full TimeLondon (GB)1d ago
-
Data Engineering | Dataset curation | Evaluation | Experimentation | Language ModelsSenior-level Full TimeUnited Kingdom, London, London1d ago
-
Senior Machine Learning Engineer GBP 28K-30KAlerting | Algorithms | Apache Spark | BigQuery | Cloud ComputingAnnual bonus scheme | Bank holidays | Employee assistance programme | Free 247 virtual GP service | Holiday Starting At 25 DaysSenior-level Full TimeWelwyn Garden City, United Kingdom of …1d ago
-
Applied AI ML Data Scientist, Vice President - Payments GBP 100K-186KAPIs | AWS | Agent systems | Audit documentation | Automated testingExecutive-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Science Lead - AML Risk GBP 75K-115KData Pipelines | Data labeling | Experiment design | GenAI | Machine LearningSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Embedded Software Engineer GBP 60K-65KAgile | C# | C++ | CAN | CI/CDCareer growth | Health and wellbeing support | Inclusive workplace | On-site flexibility | Training opportunitiesSenior-level Full TimeHemel Hempstead, England, United Kingdom2d ago
-
Research Engineer - Data Infrastructure GBP 100K-180KData Augmentation | Data Curation | Data Deduplication | Data Pipelines | Data QualityAnnual company offsite | Learning and development stipend | Monthly co-working stipend | Social travel stipendMid-level Full TimeUnited Kingdom R2d ago
-
AWS | Airflow | Application design | Automated testing | CI/CDExecutive-level Full TimeLONDON, United Kingdom2d ago
-
Head of Data Governance - C2 GBP 52K-59KAI Governance | Compliance Management | Data Catalog | Data Governance | Data QualityFlexible working | Hybrid working | Supportive work environmentSenior-level Full TimeGalashiels, United Kingdom2d ago
-
Data Platform Engineer, London GBP 71K-73KBioinformatics | Cloud platform | Computational Chemistry | DBT | Data EngineeringHybrid workMid-level Full TimeLondon2d ago
-
Embedded Electronics & Firmware Engineer GBP 45K-50KATEX | Altium | Analog design | C# | C++Additional birthday leave | Cash plan | Death in service | Employee assistance programme | Flexible work hoursMid-level Full TimeWitney, United Kingdom2d ago
-
Data Engineer GBP 50K-70KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | AzureIn office collaboration 4 days per week | Opportunity to work on cutting-edge technology | Remote work flexibility | Team of talented engineers | Work-life flexibilityMid-level Full TimeLondon R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeManchester, United Kingdom2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeNewcastle, United Kingdom2d ago
-
Azure Databricks Developer EUR 56KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlex benefits program | Income protection | Life assurance | Paid time off | Pension matchingMid-level Full TimeUK Wide, GB R2d ago
-
Entry-level ContractLeeds, England, United Kingdom2d ago
-
Data Engineer GBP 26K-26KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultAnnual discretionary bonus | Annual leave | Bank holidays | Cycle to work initiative | Discounted gym membershipMid-level Full TimeSkipton - The Bailey, United Kingdom R2d ago
-
Sr Advisor, Commercial Data Engineering GBP 60K-85KAzure Data | Azure Data Factory | Azure DevOps | DBT | DashSenior-level Full TimeLondon, GB2d ago
-
AWS | Advanced Analytics | Databricks | Deployment | Machine LearningEntry-level Full TimeGlasgow Campus, United Kingdom2d ago
-
AI Engineer GBP 100K-131KAgents | Embeddings | Evaluation | LLM | MCPCoaching | Equity participation program | Family leave plus | Health benefits | Language trainingSenior-level Full TimeLondon, England, United Kingdom (Hybrid) R2d ago
-
BI Publisher | Business Intelligence | DAX | Data Modeling | Data VisualizationAnnual leave | Cycle to work scheme | Dog-friendly office | Employee discounts | Free parkingSenior-level Full TimeKeynsham, Bristol, England2d ago