Data Engineering Lead
London, England, United Kingdom
GBP 59K-80K (estimate) Senior-level Full Time
Tasks
- Collaborate with AWS and external partners for complex integrations and data flows
- Collaborate with architecture information security quality assurance and other teams for integration and compliance
- Ensure high availability resilience and performance of data platform
- Establish engineering practices code standards testing and DataOps approaches
- Implement monitoring controls and operational processes
- Lead and mentor data engineers
- Lead development operation and improvement of AWS data platform
- Maintain engineering standards for data quality testing documentation
- Make decisions on data models storage approaches tooling and engineering techniques
- Oversee batch and streaming data pipelines integrations and transformations
- Provide technical guidance for data engineering design and tools
- Serve as primary technical escalation for complex data engineering issues
Perks/Benefits
- Discounted gym membership
- Discounted rail travel
- Enhanced family leave
- Mental health support
- Paid annual leave
- Pension contribution
- Private medical insurance
- Season ticket loan
- Wellbeing programmes
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon Kinesis | Amazon Kinesis Firehose | Amazon Redshift | Amazon S3 | Apache Spark | Bash | Batch Processing | CI/CD | Data Lake | Data Modeling | Data Warehouse | Data integration | DataOps | Distributed Systems | Key-Value Stores | Key-value | Kinesis Firehose | Monitoring | Python | REST API | Relational databases | SQL | Streaming Data
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Software Engineer - Developer Experience GBP 54K-81KAWS | Agentic AI | Build Automation | CI/CD | DockerCompany equity | Flexible working | Life insurance | Mental health support | Paid volunteering leaveMid-level Full TimeManchester14h ago
-
AI Engineer - Nexus Black GBP 78K-109KBackend Development | CI/CD | Cloud services | Embeddings | EvaluationHybrid workSenior-level Full TimeLondon, England, United Kingdom14h ago
-
Access Control | Apache Spark | Azure ML | Azure OpenAI | DAX23 days holiday plus bank holidays | Company pension | Cycle to work scheme | Electric vehicle scheme | Employee assistance programmeSenior-level Full TimeManchester, England, United Kingdom15h ago
-
Senior-level Full TimeLondon15h ago
-
kdb+ Contractor (Capital Markets) GBP 70K-87KAWS | Capital Markets | Cloud platform | Electronic Trading | Google CloudContract opportunity | Permanent opportunitySenior-level ContractLondon, England, United Kingdom17h ago
-
Senior-level ContractBelfast, Northern Ireland, United Kingdom17h ago
-
Amazon S3 | Data Ingestion | Data Modeling | Data Pipelines | Data TransformationSenior-level Full TimeLondon19h ago
-
Senior Associate, IT, AI Engineer (Mid Level) GBP 70K-90KAWS | AWS Strands | Agent Frameworks | Agent Service | Azure AIHybrid working | Learning and development | Supportive team environmentMid-level Full TimeLondon, England, United Kingdom20h ago
-
Senior Data Engineer (Databricks) GBP 72K-80KAWS | AWS DMS | Amazon S3 | CI/CD | ComplianceHybrid workingSenior-level Full TimeLondon, England, United Kingdom20h ago
-
Principal Software Engineer - Data Infrastructure GBP 70K-110KApache Iceberg | Apache Kafka | Architecture | Batch Processing | Big DataSenior-level Full TimeRemote - United Kingdom R20h ago
-
Lead Data Scientist GBP 75K-75KAzure DevOps | CI/CD | Data Lakes | Data Warehousing | Distributed ComputingAnnual leave | Career breaks | Income protection | Life assurance | PensionSenior-level Full TimeEdinburgh, Scotland, United Kingdom21h ago
-
Data Engineer GBP 30K-30KAI tools | AWS | AWS CDK | AWS Cloud | AWS cloud infrastructureBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Free onsite gymEntry-level Full TimeManchester / Hybrid, England, United Kingdom R22h ago
-
Senior Data Engineer GBP 70K-70KAzure | Databricks | Databricks Lakeflow | Databricks Lakeflow Connect | ELTCycle to work scheme | Dental care | Employee discount platform | Free broadband | Health cash fundSenior-level Full TimeDroitwich Spa, GB R1d ago
-
Data Engineer GBP 65K-65KAccess Control | Alerting | Automation | Azure | Azure InfrastructureCycle to work | Dental care | Employee discounts | Free broadband | Health cash fundMid-level Full TimeDroitwich Spa, GB1d ago
-
Software Engineer, Embedded UI - C++ GBP 70K-88KC++ | CI/CD | Concurrency | Continuous integration | Debugging401k retirement options | Health benefits | Hybrid work option | Paid time off | Remote work flexibilitySenior-level Full TimeCambridge, United Kingdom1d ago
-
AWS | Ansible | Azure | Blue-Green Deployment | Blue/greenEquity | Flexible working | Home office stipend | Paid vacation | Remote workSenior-level Full TimeLondon, England, United Kingdom - Remote R1d ago
-
Data Engineering Team Lead GBP 74K-82KAWS | Data Ingestion | Data Quality | Data pipeline | Event DrivenContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Generous time offSenior-level Full TimeUK - LONDON - 1 LONDON …1d ago
-
Senior Data Engineer GBP 70K-80KAWS | Amazon Redshift | DBT | Data Governance | Data LakeHybrid work modelSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer GBP 40K-49KApache Spark | Cloud infrastructure | Data Architecture | Data Lineage | Data ModelingFlexible first working arrangement | Growth opportunities | Hybrid work | Total rewards for health and wellbeingMid-level Full TimeUK - Leicester - Spinneyside, United …1d ago
-
Senior Data Engineer GBP 43K-52KAWS | Azure | Data Architecture | Data Modeling | Data QualityCareer development | Flexible work | MentorshipSenior-level Full TimeUK - Leicester - Spinneyside, United …1d ago
-
Applied AI Engineer GBP 100K-125KASR | Adversarial Testing | Azure | Barge In | ElevenLabsHybrid work | In-person work | Remote workMid-level Full TimeRemote (UK), United Kingdom R1d ago
-
Data Engineer GBP 64K-74KAccess Control | Alerting | Batch Processing | Data Contracts | Data GovernanceSenior-level Full TimeLeeds, United Kingdom1d ago
-
Dashboarding | Data Modeling | Data Pipelines | Data Quality | Data WarehousingSenior-level Full TimeLondon, England, GBR1d ago
-
Auto-regressive models | Custom Kernels | Data Engineering | DeepSpeed | Distributed TrainingSenior-level Full TimeLondon, UK1d ago
-
Staff Machine Learning Engineer, Simulation GBP 155K-163KData Analysis | Data Science | Deep learning | Evaluation metrics | Experiment designAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid work environmentSenior-level Full TimeLondon, UK1d ago