Research Data Engineer
Tasks
- Build cloud native data lake or lakehouse
- Design data representations for model training
- Design scalable data pipelines
- Ensure security audit and governance
- Implement data versioning and lineage
- Ingest multi modal scientific data
- Monitor data quality
- Optimize data movement and storage layouts
- Orchestrate production and batch workflows
- Partner with data scientists for data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Spark | Cloud Storage | Dagster | Dask | Data Governance | Data Lineage | Data Quality | Data Versioning | Data quality monitoring | Docker | DuckDB | Fair Principles | Google Cloud | Google Cloud Storage | HDF5 | Infrastructure as Code | Kubernetes | Parquet | Polars | Prefect | Python | Quality monitoring | Terraform | Tiledb | Workflow Orchestration | Zarr | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Data Engineer GBP 70K-80KAgile | Automated testing | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeSalford Quays4h ago
-
Senior ML Engineer GBP 70K-85K3D Vision | AWS | Agile | Computer Vision | Deep learningCoaching | Critical illness insurance | Cycle to work scheme | Dental insurance | Disability insuranceSenior-level Full TimeLondon,England,United Kingdom17h ago
-
Staff AI Engineer - 2nd Horizon | UK | Remote GBP 100K-124KAWS | Agent Frameworks | Agent workflows | Cloud Native | Cloud platformAnnual leave | Remote workSenior-level Full TimeUnited Kingdom (Remote) R21h ago
-
Senior Software Engineer, Identity GBP 97K-125KABAC | AWS | Access Control | Access Control Evaluation | Access ManagementSenior-level Full TimeLondon, UK23h ago
-
AI Engineer (Commercial) GBP 35K-40KAPIs | Anthropic API | Bias Mitigation | CRM | Data Warehouse25 days holiday per year | Career progression opportunities | Early finish Fridays | Enhanced parental leave | Pension with NESTEntry-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer GBP 75K-115KAPI Development | AWS | AWS Glue | AWS Lambda | Amazon AthenaEmployee assistance program | Extensive leave policy | Flexible working | Health insurance | Life insuranceSenior-level Full TimeLondon, England, United Kingdom1d ago
-
AI/ML Computational Scientist Manager GBP 57K-65KAlerting | Big Data | C++ | Cloud Computing | Data PipelinesMid-level Full TimeLondon, 30 Fenchurch Street, United Kingdom1d ago
-
Data Platform Engineer GBP 50K-50KAccess Control | Azure | Data Contracts | Data Governance | Data LineageHybrid working | Permanent contract | Professional learning opportunitiesMid-level Full TimeManchester, United Kingdom1d ago
-
Embedded Software Engineer GBP 50K-70KARM Cortex | ARM microcontrollers | Bare Metal | C# | C++Cycle to work scheme | Electric vehicle scheme | Hybrid working | Income protection insurance | Learning and development opportunitiesSenior-level Full TimeSedgefield, England, United Kingdom1d ago
-
Senior-level Full TimeLondon, 30 Fenchurch Street, United Kingdom1d ago
-
Senior Quantitative Engineer GBP 72K-80KAngular | Classification | Clustering | Data Quality | DataFrameCharity matching | Critical illness cover | Cycle to work | Emotional Wellbeing Helpline | Flexible benefitsSenior-level Full TimeBromley, United Kingdom1d ago
-
Lead AI Engineer GBP 72K-120KAI Services | API Development | AWS | AWS AI | AWS AI ServicesAnnual leave | Bank holidays | Employee assistance program | Flexible benefits | Hybrid workingSenior-level Full TimeLondon, United Kingdom R1d ago
-
Senior Data Engineer GBP 60K-70K.NET | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageAnnual company events | Annual leave plus bank holidays | Canteen | Employee retailer discounts | Hybrid workSenior-level Full TimeBurton on Trent, Staffordshire, United Kingdom; … R1d ago
-
Architecture | C# | C++ | CI/CD | Code reviewSenior-level Full TimeCambridge, England, GBR1d ago
-
Forward Deployed Engineer - AI GBP 90K-115KAI Act | AI Governance | AI Risk Management Framework | AI Security | AWS BedrockTravel opportunitiesSenior-level Full TimeLondon, England, United Kingdom; Munich, Germany1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Senior AI Reliability Engineer (Platform) GBP 90K-115KAI Agents | AWS | Airflow | Alerting | AuditabilityEnglish language fluency | On-call rotationSenior-level Full TimeLondon office1d ago
-
Data Analytics Engineer GBP 35K-39KAPI Integration | Code review | DBT | Data Documentation | Data GovernanceAnnual winter holiday break | Cycle to work scheme | Discounted employee plans | Employee assistance programs | Income protectionMid-level Full TimeBath, England, GB1d ago
-
Agile | Business Intelligence | CI/CD | Data Modeling | Data analyticsCycle to work scheme | Enhanced maternity/paternity pay | Expensed training | Flexible working | Income protectionSenior-level Full TimeBirmingham, West Midlands, United Kingdom1d ago
-
Data Engineer GBP 87K-125KAnalytics engineering | Apache Airflow | Apache Superset | DBT | Data ModelingAnnual self-development budget | Paid 'me days' | Paid parental leave | Paid sabbatical leave | Paternity leaveSenior-level Full TimeLondon, United Kingdom1d ago
-
Junior Quant - Algo Analytics GBP 40K-41KData Visualization | Data sets | Large Data Sets | Large data | Machine Learning401k | Discounted gym membership | Enhanced parental leave | Flexible working | Long service leaveEntry-level Full TimeLondon1d ago
-
Prompt Engineer GBP 35K-50KAI Agents | Compliance | Data Privacy | LLM providers | Language ModelsBike purchase discount | Coaching | Enhanced parental leave | Gym membership | Healthcare coverageEntry-level Full TimeLondon R1d ago
-
Embedded Linux Software Engineer GBP 50K-65KARM | Automation | Buildroot | C# | C++Disability income protection | Employee assistance program | Life insurance | Pension plan | Private healthcareMid-level Full TimeFarnborough, Hampshire, United Kingdom1d ago
-
Analytics Engineer (Contractor) GBP 60K-75KCommon table expressions | DBT | Data Documentation | Data Governance | Data ModelingMid-level ContractLondon1d ago
-
PyTorch Engineer GBP 100K-103KC++ | Compiler development | Integration Testing | JAX | ML kernelsDental plan | Employee assistance programme | Flexible working | Generous annual leave policy | Generous parental leave policySenior-level Full TimeBristol, UK1d ago