Data Engineering Lead
London, England, United Kingdom
GBP 59K-80K (estimate) Senior-level Full Time
Tasks
- Collaborate with AWS and external partners for complex integrations and data flows
- Collaborate with architecture information security quality assurance and other teams for integration and compliance
- Ensure high availability resilience and performance of data platform
- Establish engineering practices code standards testing and DataOps approaches
- Implement monitoring controls and operational processes
- Lead and mentor data engineers
- Lead development operation and improvement of AWS data platform
- Maintain engineering standards for data quality testing documentation
- Make decisions on data models storage approaches tooling and engineering techniques
- Oversee batch and streaming data pipelines integrations and transformations
- Provide technical guidance for data engineering design and tools
- Serve as primary technical escalation for complex data engineering issues
Perks/Benefits
- Discounted gym membership
- Discounted rail travel
- Enhanced family leave
- Mental health support
- Paid annual leave
- Pension contribution
- Private medical insurance
- Season ticket loan
- Wellbeing programmes
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon Kinesis | Amazon Kinesis Firehose | Amazon Redshift | Amazon S3 | Apache Spark | Bash | Batch Processing | CI/CD | Data Lake | Data Modeling | Data Warehouse | Data integration | DataOps | Distributed Systems | Key-Value Stores | Key-value | Kinesis Firehose | Monitoring | Python | REST API | Relational databases | SQL | Streaming Data
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Career growth opportunity | Friendly work environment | Impact on consumer and enterprise products | Remote friendly 100% distributed settingMid-level Full TimeLondon, United Kingdom20h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Entrepreneurial environment | Flexible management structure | Friendly laid-back atmosphereMid-level Full TimeBrighton, United Kingdom21h ago
-
Internal Audit AVP - Data Analytics GBP 47K-58KAWS | Alteryx | Audit Testing | Cloud Computing | DashboardsEntry-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
Platform Data Engineer GBP 91K-110KAnalytical Databases | Batch Processing | ClickHouse | Compression | Data ModelingCompany retreats | Family leave | Flexible hours | Generous paid time off | Remote-first setupSenior-level Full TimeUnited Kingdom - Remote R1d ago
-
AI/ML/Data Science Engineer GBP 50K-60KAnomaly Detection | Cloud Platforms | Computer Vision | Computer Vision Video Analytics | Data PreprocessingAnnual leave | Bank Holiday Leave | Dental care | Discounts | Enhanced maternity/paternity leaveMid-level Full TimeBiggin Hill, United Kingdom1d ago
-
LLM Specialist / AI Developer GBP 59K-65KAPI Security | Azure OpenAI | Copilot Studio | Evaluation | GroundingFixed term position | Hybrid working | Working permit sponsorshipMid-level Full TimeLondon, Greater London, United Kingdom1d ago
-
Senior GenAI Software Engineer GBP 76K-100KA/B | A/B Testing | B testing | Debugging | Diffusion ModelsDental insurance | Equity | Health insurance | Vision insurance | Wellness stipendsSenior-level Full TimeLondon, UK R1d ago
-
Senior-level Full TimeUnited Kingdom (Remote) R1d ago
-
Agile | Cloud Platforms | Data Architecture | Data Observability | Data QualityHybrid workingSenior-level Full TimeUnited Kingdom, United Kingdom1d ago
-
Senior Manager - Data Engineering GBP 45K-62KBigQuery | CI/CD | Click | Cloud Build | Cloud FunctionsFlexible working | Hybrid workingSenior-level Full TimeLondon R1d ago
-
Data Science Lead - Logistics GBP 62K-80KArtificial Intelligence | Big Data | Cloud | IoT | JavaAnnual leave | Buy As You Earn Scheme | Cycle to work scheme | Employee assistance programme | Employee discountsSenior-level Full TimeLondon, United Kingdom R1d ago
-
Senior Data Engineer BI Hub GBP 62K-77KAWS | Agile | Alerting | Azure | CI/CDAnnual holiday allowance | Buy additional holiday | Colleague discount | Cycle to work scheme | DiscountsSenior-level Full TimeLondon, London, United Kingdom1d ago
-
AWS | Amazon Bedrock | Azure | Azure OpenAI | DockerMid-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Applied AI ML Lead - LLM Suite Engineering GBP 72K-95KAPIs | AWS | AWS Bedrock | Agent communication | Agent to AgentSenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Senior AI Engineer GBP 75K-75KAWS | Agent systems | Artificial Intelligence | Azure | CI/CDAnnual bonus | Discounted gym membership | Electric vehicle leasing | Experience days | Hybrid workSenior-level Full TimeLondon, United Kingdom R1d ago
-
Full Stack AI Engineer GBP 78K-80KAlembic | Application Insights | Asynchronous programming | Auditability | AuthenticationMid-level Full TimeBelfast1d ago
-
Principal Computer Vision Engineer GBP 67K-109K3D Object Tracking | ARM | C# | C++ | Camera ModelsHybrid work | Mentoring | Professional developmentSenior-level Full TimeLondon, UK1d ago
-
Senior Data Engineer GBP 77K-80KAWS | AWS Glue | AWS Lambda | AWS S3 | Access ControlAnnual bonus programme | Annual learning stipend | Birthday day off | Collaborative Agile culture | Flexible working hoursSenior-level Full TimeLondon, United Kingdom1d ago
-
System Engineer - PostgreSQL GBP 150KDebian | Linux | MySQL | PostgreSQL | PythonBonus pay | Hybrid workMid-level Full TimeLondon, England, United Kingdom1d ago
-
Senior HPC Storage Engineer GBP 65K-80KCephFS | GPFS | Linux | Lustre | NASHybrid working | Quarterly bonuses | Signing bonusSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior HPC Software Engineer GBP 65K-80KC++ | Cloud Storage | Databases | Deployment Monitoring | Distributed SystemsFlexible budgetSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Mart | Data Modeling | Data Warehousing | HDFS | Hadoop100 percent remote | Outside IR35Mid-level Full TimeCoventry, England, United Kingdom R1d ago
-
Data Engineer GBP 60K-70KAPI | AWS | ETL | Python | SnowflakeCareer development | Health insurance | Life insurance | Paid time off | Paid volunteering leaveMid-level Full TimeManchester, England, United Kingdom1d ago
-
AI Engineer / Machine Learning Engineer GBP 85K-100KAlgorithms | Cloud Computing | Data Science | Data Structures | DockerSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer (GCP) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeManchester, England, United Kingdom1d ago