Research Data Engineer
Tasks
- Build cloud native data lake or lakehouse
- Design data representations for model training
- Design scalable data pipelines
- Ensure security audit and governance
- Implement data versioning and lineage
- Ingest multi modal scientific data
- Monitor data quality
- Optimize data movement and storage layouts
- Orchestrate production and batch workflows
- Partner with data scientists for data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Spark | Cloud Storage | Dagster | Dask | Data Governance | Data Lineage | Data Quality | Data Versioning | Data quality monitoring | Docker | DuckDB | Fair Principles | Google Cloud | Google Cloud Storage | HDF5 | Infrastructure as Code | Kubernetes | Parquet | Polars | Prefect | Python | Quality monitoring | Terraform | Tiledb | Workflow Orchestration | Zarr | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer GBP 38K-45KAPIs | AWS | AWS Glue | AWS Lambda | Amazon DynamoDBAnnual leave | Company pension | Hybrid work | Learning budget | Performance bonusMid-level Full TimeManchester, United Kingdom R18h ago
-
AI Systems & ML Engineering Industry Expert GBP 92K-120KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible scheduling | Fully remote | Low time commitmentSenior-level Part TimeLondon, Greater London, GB R18h ago
-
Data Engineer GBP 75K-90KAPI Integration | AWS | AWS Glue | AWS Lambda | AgileCourse training | Hybrid working | Learning budget | Mentoring | Private healthcareSenior-level Full TimeBelfast, United Kingdom R19h ago
-
Machine Learning Engineer (Closed Loop) GBP 155K-163KDiffusion Models | Generative Modeling | Latent-video models | Machine Learning | Multi SensorHybrid work | Inclusive work environment | Publication opportunities | Work from homeMid-level Full TimeLondon R21h ago
-
Machine Learning Engineer (Synthetic Data) GBP 155K-163K3D Geometry | Autoregressive Video | Behaviour Cloning | Calibration | Camera GeometryHybrid work policyMid-level Full TimeLondon R21h ago
-
Software Engineer (LLM Engineering), London GBP 77K-109KAgentic coding | Cloud infrastructure | Context Management | Cost Management | Fine TuningHybrid work modelSenior-level Full TimeLondon22h ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSightEmployer pension contribution | Flexible benefits | Life assurance | LinkedIn Learning access | Paid holidaySenior-level Full TimeHybrid, London, England, United Kingdom R1d ago
-
Lead Data Platform Engineer -6 Month Secondment GBP 85K-102KAPI Integration | AWS Glue | AWS Lake | AWS Lake Formation | AWS LambdaAnnual leave | Bank holidays | Healthcare | Pension | SharesaveSenior-level Full TimeNottingham, United Kingdom R1d ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 90K-110KAnomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group personal pension scheme with employer matchMid-level Full TimeRemote - United Kingdom R1d ago
-
Senior Field Specialist - Data Platform GBP 65K-89KAnsible Automation | Apache Airflow | Apache Impala | Apache Ozone | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeUK-Remote, United Kingdom R1d ago
-
GenAI Full-Stack Engineer GBP 60K-72KAPI Design | Cloud Native | Containers | DevSecOps | Distributed SystemsEmployee assistance program | Hybrid work | Life insurance | Paid parental leave | Pension planMid-level Full TimeLocation(s): London, England, United Kingdom1d ago
-
Senior Enterprise Technology Engineer GBP 70K-80KAI SDLC | AWS | Agile | Amazon Web Services | Amazon Web Services IAMFlexible working options | Hybrid office/remote work | No Travel | Paid parental leave | Retirement benefitsSenior-level Full TimeGB: London - 25 North Colonnade, …1d ago
-
Member of Technical Staff, Data Flywheel USD 135K-260KData Curation | Data Pipelines | Data Quality | Data Quality Validation | Data VersioningAnnual wellness allowance | Dental insurance | Happy hours | Health insurance | Life insuranceSenior-level Full TimeNew York, NY1d ago
-
Senior Data Engineer GBP 95K-115KAWS Databricks | AWS Glue | Apache Airflow | Apache Kafka | Data ModelingAnnual leave | Bank holidays | Pension plan | Private health insuranceSenior-level Full TimeLondon R1d ago
-
Applied AI Architect, Digital Natives Business GBP 190K-230KClaude API | Cloud Architecture | Data Science | Evaluation | LLMSenior-level Full TimeLondon, UK R1d ago
-
Data Engineer GBP 50K-55KAPI | AWS | AWS Lambda | DBT | Data ModelingAnnual leave | Birthday off | Company pension | Cycle to work scheme | Employee discountMid-level Full TimeWirral, United Kingdom1d ago
-
Junior Data Engineer GBP 28K-28KAzure | Data Governance | Data Management | Data Modeling | Data SecurityAnnual leave | Flexible working | Free GP consultations | Loans | Mortgage adviceEntry-level Full TimeMilton Keynes, Milton Keynes, MK9 1EA, …1d ago
-
Senior AI / LLM Engineer GBP 70K-85KAI Studio | Agent Orchestration | Azure AI | Azure AI Studio | Azure AKSDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer GBP 65K-85KAccess Controls | Alerting | Apache Airflow | Azure Data | Azure Data FactoryHybrid work options | Industry-leading technology | Remote work options | Well-being programs | Work flexibilitySenior-level Full TimeBasingstoke, United Kingdom R1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Causal Inference | Machine Learning | Model Productionization | Personalization | PythonContinuous learning | Flexible working | High-ownership environment | Hybrid workingSenior-level Full TimeLondon - The River Building HQ1d ago
-
Senior Data Engineer GBP 70K-80KAgile | Automated testing | Azure Data | Azure Data Factory | Azure SQLHealthcare industry experience | Mentoring and team leadership | Mostly remoteSenior-level Full TimeBrighton1d ago
-
Data Engineer GBP 44K-44KAPI Integration | Agile | Azure Data | Azure Data Factory | CI/CDHybrid workingSenior-level Full TimeManchester R1d ago
-
Mid-level Full TimeLondon, UK1d ago
-
APIs | Agent systems | Cloud platform | Evaluation | Google CloudSenior-level Full TimeLondon, UK1d ago