Lead Data Engineer
Tasks
- Build batch and streaming pipelines
- Build data models and platform components
- Collaborate cross functionally on platform delivery
- Design data pipeline architecture
- Embed data quality and privacy by design
- Embed observability and alerting in pipelines
- Enforce engineering standards
- Ensure alignment with data strategy
- Evaluate and recommend data tools
- Facilitate knowledge sharing
- Lead design sessions and code reviews
- Lead technical interviews and onboarding
- Maintain technical documentation
- Mentor and coach engineers
- Partner on team development planning
- Resolve technical debt
- Support complex data engineering problems
- Uphold data governance security and compliance
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Anomaly Detection | Batch Processing | BigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | Data Modeling | Data Quality | Data Vault | Dataflow | Dataform | Dimensional Modeling | Git | Google Cloud | Google Cloud Platform | Infrastructure as Code | Monitoring | Observability | PubSub | Python | SQL | Streaming | Terraform | Testing | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
APIs | Agent systems | Cloud Security | Cloud platform | CrewAISenior-level Full TimeLondon, UK2h ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure Machine LearningEmployer pension matching | Hybrid work | Paid time off | Private medical insuranceSenior-level Full TimeAlderley Edge, GB6h ago
-
Senior AI Solution Engineer GBP 65K-75KAPI Integration | Bias Mitigation | CI/CD | Cloud Computing | ContainerizationBenefits package | Career growth | Hybrid working | Mentorship | Ongoing developmentSenior-level Full TimeWarminster, Wiltshire, United Kingdom R14h ago
-
Senior-level Full Timesolihull15h ago
-
Lead Data Scientist GBP 70K-80KAWS | Classification | Cloud Computing | Cloud platform | ClusteringFlexible benefits | Flexible working hybrid attendance | Funded Healthcare | Gym membership | Life assuranceSenior-level Full TimeSolihull, England, United Kingdom R15h ago
-
Lead Data Engineer GBP 70K-85KAirflow | Anomaly Detection | Batch Processing | BigQuery | BigQuery cost optimizationCoffee bars | EV charge points available | Employee discount | Flexible benefits programme | Funded healthcare benefitSenior-level Full TimeSolihull, England, United Kingdom R16h ago
-
Lead Data Scientist - Liquidity GBP 75K-115KAWS | Azure | Big Data | GCP | HadoopHybrid working | Personal development budget | Stock options | Visa and relocation supportSenior-level Full TimeLondon, United Kingdom R22h ago
-
Quantum Algorithms Lead GBP 58K-68KClient consulting | Fault Tolerant Quantum | Fault-tolerant | Fault-tolerant quantum computation | Open SourceSenior-level Full TimeUnited Kingdom22h ago
-
Lead Data Scientist - Personalisation/CRM GBP 90K-127KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDevelopment opportunities | Flexible working | Generous parental leave | Paid sabbatical | Paid social activities and eventsSenior-level Full TimeLondon, United Kingdom R22h ago
-
Lead Data Analyst - Wise Platform Pricing GBP 75K-115KCost Allocation | DBT | Data Modeling | Data Quality | Data VisualizationAnnual self-development budget | Cycle to work scheme | Discounted gym memberships | Flexible working | Life insuranceSenior-level Full TimeLondon, United Kingdom23h ago
-
Lead Machine Learning Scientist, Customer Operations GBP 93K-120KAgile | Deep learning | Graph Neural Networks | Human-in-the-loop | LLMsDistributed working within the UK | Flexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R1d ago
-
API | Accessibility | Alternative data | Backtesting | CloudSenior-level Full TimeLondon1d ago
-
Forward Deployed Engineer III, GCC (French, German) GBP 100K-163KAPIs | Computer Vision | CrewAI | Data Processing | GenAISenior-level Full TimeLondon, UK1d ago
-
Data Platform Engineer GBP 55K-75KApache Flink | Apache Kafka | BigQuery | Cloud Spanner | Cloud platformHybrid work from home policyMid-level Full TimeManchester, England, United Kingdom R1d ago
-
Data Platform Engineer GBP 55K-75KApache Flink | Apache Kafka | Automation | BigQuery | Cloud SpannerHybrid work from homeEntry-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
Analytics Engineer GBP 65K-75KAWS | Airflow | Amazon QuickSight | Amazon Redshift | CI/CDCompany events | Employee resource groups | Extended parental leave | Health coverage | Learning pathsSenior-level Full TimeEdinburgh, United Kingdom1d ago
-
Python Analytics Engineer GBP 40K-54KDBT | Data Pipelines | ETL | Python | SQLCycle to work scheme | Electric vehicle salary sacrifice | Employee referral bonus | Flexible working | Office meals and snacksEntry-level Full TimeLondon R1d ago
-
Data Engineer GBP 42K-54KDBT | Data Pipelines | ETL | Python | SQLCycle to work scheme | Electric vehicle salary sacrifice | Employee referral bonus | Flexible working | Office meals and snacksEntry-level Full TimeLondon R1d ago
-
Analytics Engineer GBP 40K-54KDBT | Data Pipelines | ETL | Python | SQLCycle to work scheme | Electric vehicle salary sacrifice scheme | Employee referral programme | Flexible working | Office meals and snacksMid-level Full TimeLondon R1d ago
-
Data Science & AI Specialist GBP 28K-28KAWS | Advanced Analytics | Artificial Intelligence | Cloud platform | Data PipelinesDiscounted products | Gym membership | Holiday purchase scheme | Paid carer’s leave | Pension schemeMid-level Full TimeIpswich, GB, IP5 3RE1d ago
-
Data Engineering | Deep learning | Distributed Training | GPU | MLOpsEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalized learningSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer - Data Science Platform GBP 60K-70KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer - Core Engineering GBP 58K-71KAzure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactoryAnnual leave | Bank holidays | Employer pension matching | Hybrid work | Private medical insuranceEntry-level Full TimeEdinburgh, GB1d ago
-
Data Engineer GBP 52K-75KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformOnsite office work 4 days per week | Remote work flexibility | Team collaborationMid-level Full TimeLondon R1d ago
-
Entry-level Full TimeGlasgow Campus, United Kingdom1d ago