Data Engineer (Senior or Principal)
Wellcome Genome Campus, United Kingdom
GBP 50K-73K Senior-level Full Time
Tasks
- Build data models and warehousing
- Deploy and manage data infrastructure with Kubernetes
- Develop data lakehouse platform
- Ensure data quality, reliability, and scalability
- Implement data governance and security
- Ingest and transform heterogeneous datasets
- Lead architectural decisions
- Maintain data integration pipelines
- Manage metadata and catalog systems
- Operate distributed query engines
- Orchestrate data workflows
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Ranger | Apache Spark | Apache Superset | CI/CD | CloudBeaver | DBT | Data Modeling | Data Warehousing | Datahub | Delta Lake | Distributed Computing | Docker | ELT | GitHub Actions | GitLab CI | Helm | Hive Metastore | Keycloak | Kubernetes | Minio | Object storage | Prefect | Python | SQL | Star Schema | Trino | Vault
Education
N/A
Related jobs
-
Accuracy Checking | Alerting | Automation | Cause analysis | Completeness CheckingSenior-level Full TimeLondon7h ago
-
Senior Data Engineer GBP 60K-70KAPI Integration | CI/CD | Cloud Computing | Data Quality | Data ValidationSenior-level Full TimeLondon7h ago
-
MLOps Engineer GBP 55K-55KCI/CD | Cloud Native | Data Governance | GitLab | GrafanaFlexible working arrangements | Hybrid workingMid-level Full TimeGB-ENG-LAN-Preston7h ago
-
Machine Learning Engineer GBP 26K-28KAlerting | Algorithms | Apache Spark | Azure | Cloud ComputingAdoption leave | Annual bonus scheme | Employee assistance programme | Employee wellbeing support | Free 247 virtual GP serviceMid-level Full TimeWelwyn Garden City, United Kingdom of …7h ago
-
Mid-level Full TimeLondon, England, GB9h ago
-
Senior Data Engineer - Data Science Platform GBP 60K-70KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalized learningSenior-level Full TimeLondon, England, United Kingdom10h ago
-
Staff MLOps Engineer (AI/ML Platform) GBP 70K-99KAWS EKS | Apache Spark | Data Drift | Databricks | Experiment trackingSenior-level Full TimeRemote, Remote, United Kingdom R16h ago
-
Power BI Developer GBP 51K-65KALM Toolkit | Active Directory | Azure Active Directory | DAX | DAX StudioFlexible working hours | Hybrid work | Work-life balanceSenior-level Full TimeGBR-Abingdon-Culham (057GB), United Kingdom20h ago
-
DevOps Engineer - ML GBP 58K-58KAI Services | AKS | Application Insights | Azure | Azure AI25 days holiday | Enhanced pension plan | Family-friendly benefits | Flexible working | Health insuranceMid-level Full TimeCentral London, United Kingdom20h ago
-
Senior Data Analytics Engineer GBP 70K-89KBusiness Intelligence | CI/CD | DBT | Data Documentation | Data ObservabilityCollaborative team | Documentation focused culture | Remote-friendly environmentSenior-level Full TimeRemote - United Kingdom R22h ago
-
Senior Machine Learning Engineer GBP 55K-55KAWS | Azure Machine Learning | Clustering | Databricks | Decision TreesHybrid working | Opportunities to lead coaching and mentoringSenior-level Full TimeManchester, Greater Manchester, United Kingdom1d ago
-
Legal Prompt Engineer GBP 50K-70KContract Law | Document Automation | LLM Testing | Language Models | Large Language ModelsMid-level Full TimeHybrid (SW1W 9SH, London, Greater London, … R1d ago
-
Senior AI Engineer GBP 72K-91KAKS | Azure AI | CI/CD | Containerization | GenAIOpsElectric car scheme | Employee discounts | Family leave | Flexible working options | Healthcare planSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior AI Engineer GBP 72K-91KAKS | Azure AI | CI/CD | Containerization | GenAIOpsDiscounts | Electric car scheme | Family leave | Flexible working options | Generous pension contributionSenior-level Full TimeCardiff, Wales, United Kingdom1d ago
-
Senior AI Engineer GBP 72K-91KAI Services | AKS | Azure AI | Azure AI Services | CI/CDElectric car scheme | Employee discounts | Family leave | Flexible working | Healthcare planSenior-level Full TimeBrighton and Hove, England, United Kingdom1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
AI Engineer GBP 72K-93KAI Services | AKS | API | Azure | Azure AIElectric car scheme | Employee discounts | Family leave | Healthcare plan | Life assuranceSenior-level Full TimeCardiff, Wales, United Kingdom1d ago
-
AI Engineer GBP 72K-93KAI Services | AKS | Azure | Azure AI | Azure AI ServicesElectric car scheme | Employee discounts | Family leave | Healthcare plan | Life assuranceSenior-level Full TimeBrighton and Hove, England, United Kingdom1d ago
-
AI Engineer GBP 72K-93KAI Services | AKS | APIs | Agile | AzureFlexible working | Health insurance | Life insurance | Paid time off | Pension contributionSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Machine Learning Engineer GBP 72K-90KAI Foundry | Azure AI | Azure AI Foundry | Azure ML | Batch inferenceHybrid workingSenior-level Full TimeNewbury, England, United Kingdom1d ago
-
Senior Data Engineer GBP 60K-70KAPI Integration | Azure Data | Azure Data Lake | Azure DevOps | Azure Machine LearningHybrid work | Mentorship | Travel for office workSenior-level Full TimeBirmingham, West Midlands, United Kingdom1d ago
-
C plus plus | C# | Cloud Computing | Cloud platform | Data ProcessingSenior-level Full TimeLondon, UK1d ago
-
Machine Learning DSP Engineer GBP 50K-70KAudio Processing | C# | C++ | Digital Signal | Digital Signal ProcessingRelocation support | Visa sponsorshipSenior-level Full TimeMilton Keynes, United Kingdom1d ago
-
Data Engineer - Intermediate Level GBP 42K-50KAWS | Agile | Apache Flink | Apache Storm | AzureAgile environment | Hybrid work | Team cultureMid-level Full TimeLondon, United Kingdom1d ago
-
Mid-level Contract Full TimeNottingham, GB1d ago