Senior Data Engineer
London - GBR, United Kingdom
GBP 70K-80K (estimate) Senior-level Full Time
Tasks
- Build and test data pipeline code
- Cleanse and validate data quality
- Collaborate to improve team process
- Define data governance documentation
- Design data repositories
- Document datasets in data catalog
- Ensure GDPR compliant data ownership and stewardship
- Implement reactive pipeline changes
- Ingest data from multiple sources
- Lead data engineering activities
- Model data for single source of truth
- Monitor and optimize data pipelines
- Perform ad hoc analysis of structured and unstructured data
- Plan sprints and refine backlog
- Support data platforms operations
- Translate user requirements into technical requirements
Perks/Benefits
Skills/Tech-stack
Apache Kafka | Apache Kafka Streams | Azure CLI | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure Logic | Azure Logic Apps | Azure Resource | Azure Resource Manager | Azure Stream | Azure Stream Analytics | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Delta Lake | GDPR | Integration Testing | Kafka Streams | Kimball data modeling | Logic Apps | Non PII | PII | Powershell | PySpark | Pytest | Python | REST API | Resource manager | SQL | Single Source | Single Source of Truth | Snowflake Schema | Source of Truth | Star Schema | Stream Analytics | Terraform | Unit Testing | Unittest | Unity Catalog
Education
N/A
Roles
Related jobs
-
Scientific Data Engineer GBP 41K-44KAmazon Web Services | Automated testing | Cloud Computing | Cloud platform | CondaBank holidays | Cycle to work scheme | Flexible working | Group Critical Illness | Group income protectionMid-level Full TimeLondon, England, United Kingdom9h ago
-
UniData/ UniVerse Data Engineer (Remote) GBP 55K-80KAPI Integration | APIs | Batch Processing | Data Modeling | Data integrationRemote workSenior-level Full TimeCambourne, United Kingdom of Great Britain … R11h ago
-
Senior AI Engineer GBP 78K-100KAWS | Agentic architecture | Anthropic API | Azure | C++Annual leave | Community and charity initiatives | Cycle to work | Give as you earn | Hybrid workingSenior-level Full TimeBelfast, Northern Ireland, United Kingdom R16h ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Flexible, hands-off management | Inclusive workplace | Remote/distributed workMid-level Full TimeLondon, United Kingdom18h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous work culture | Career impact | Friendly laid-back atmosphere | Remote-friendly, distributed teamMid-level Full TimeBristol, United Kingdom18h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Friendly work environment | Opportunity to make impact | Supportive teamMid-level Full TimeLeeds, United Kingdom19h ago
-
Senior Data Engineer GBP 72K-80KApache Spark | Automation | Azure | Azure Data | Azure Data LakeCareer development | Medical coverage | Mentoring programs | Paid time off | Reward and recognition programsSenior-level Full Time16-22 Bedford Street, Belfast, United Kingdom1d ago
-
AWS | Azure | Cloud platform | Data Analysis | Data ModelingCycle to work scheme | Employee assistance programme | Eye care | Free breakfast | Gym discountEntry-level Full TimeHavas Village London - 35, United … R1d ago
-
API Design | C# | C++ | Compute efficiency | Data PipelinesEducation reimbursement | Family support programs | Flexible time off | Health and wellbeing resources | Hybrid work modelExecutive-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R1d ago
-
Data Engineering Technical Lead GBP 70K-100KAWS | Agile | Apache Spark | Automated testing | CI/CDHybrid work scheduleSenior-level Full TimeLondon, GBR, United Kingdom1d ago
-
Senior AI/ML Scientist GBP 84K-126KAWS | Azure | BERTScore | BLEU | CI/CDFlexible benefits | Income protection | Life assurance | Paid time off | Pension schemeSenior-level Full TimeLondon - Senator House, United Kingdom1d ago
-
365 Admin Center | Access Control | Admin Center | Compliance | Data CleansingEntry-level Contract Full Time TemporaryCanary Wharf, 1 Churchill Place, United …1d ago
-
Product Engineer - M365 Unified Collaboration & Gen AI GBP 100K-139KAutomation | Azure | CI/CD | DLP | DevOpsExecutive-level Full TimeKnutsford, Radbroke Hall, United Kingdom1d ago
-
Admittance control | Body Dynamics | C plus plus | Contact Force Control | Force controlFlexible work environment | Free meals | Paid time off | Pension scheme | Private healthcareSenior-level Full TimeUK, London1d ago
-
Quantum Engineer - Rotation Programme GBP 31K-33KASIC physical design | Analog IC | Analog IC design | CMOS | Circuit designCycle to work scheme | Flexible working | Select your own laptop kitEntry-level Full TimeLondon, UK1d ago
-
Data Engineer GBP 70K-85KAirflow | Ansible | Argo CD | CI/CD | Dagster35 hour working week | Additional annual leave | Employee assistance programme | Enhanced maternity/paternity pay | MacBook Pro providedSenior-level Full TimeCheltenham, England, United Kingdom - Remote R1d ago
-
Machine Learning Engineer GBP 78K-109KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London R1d ago
-
Mid-level Full TimeVauxhall, London1d ago
-
Mid-level Full TimeLondon R1d ago
-
AI | Advanced Analytics | Data analytics | Deep learning | GenAIDedicated buddy | Flexible work options | Hybrid work | Mentorship | Talent managementEntry-level InternshipBank House, Bank House Square, Newcastle … R2d ago
-
Buildkite | C++ | CI/CD | Camera | Hardware-in-the-loopHybrid work | Work from home daysSenior-level Full TimeLondon R3d ago
-
Robotics Engineer GBP 123K-130KAPI Design | Asynchronous programming | Bayesian Inference | C++ | CUDAHybrid work | Work from home optionsSenior-level Full TimeLondon; Sunnyvale R3d ago
-
Data Engineer, Global Client Solutions GBP 77K-77KCloud Computing | Data Engineering | Data Fusion | Docker | GitDental insurance | Hybrid work schedule | Medical insurance | Mental Health Awareness Days | Paid time offMid-level Full TimeLondon, United Kingdom3d ago
-
Forward-Deployed Data Scientist II GBP 90K-134KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewDisability coverage | Donation matching | Employee resource groups | Employee stock purchase plan | Flexible paid time offMid-level Full TimeLondon3d ago
-
Causal Inference | Machine Learning | Model Productionization | Personalization | PythonContinuous learning | Flexible working | Hybrid workingSenior-level Full TimeLondon - The River Building HQ3d ago