Senior Data Engineer
Dunton, Essex, United Kingdom
GBP 72K-88K (estimate) Senior-level Full Time
Tasks
- Align with global data engineering counterparts on standards
- Architect scalable cost effective data platforms
- Build AI ready data pipelines for LLM applications
- Build LLMOps data layer for model evaluation and fine tuning datasets
- Build and maintain feature stores on Vertex AI
- Contribute to hiring technical interviews and assessments
- Define and document reusable engineering patterns
- Define pipeline SLAs and implement alerting
- Define testing strategies for regulated workloads
- Design CI CD pipelines for data solutions
- Design ML based anomaly detection for monitoring
- Design data models and historical data management
- Design event driven architectures with Pub Sub and Dataflow
- Drive DataOps with automated testing data contracts and observability
- Ensure data security encryption and governance compliance
- Generate embeddings and populate vector stores
- Implement RAG data retrieval layers
- Implement SCD and historical data management patterns
- Lead code reviews and raise quality bar
- Lead end to end design and delivery of data engineering solutions
- Mentor junior engineers through pairing and feedback
- Migrate legacy data structures to GCP
- Monitor and optimize GCP costs
- Provision and govern infrastructure with Terraform
- Translate business requirements into technical solutions
Perks/Benefits
- Campus based work schedule
- Global team collaboration
- Hybrid working
- Pathway to Lead Engineer
- Support for certification and training
Skills/Tech-stack
Apache Airflow | Async Processing | CI/CD | Cloud Build | Cloud Composer | Cloud Composer Airflow | Cloud Storage | Cloud platform | Code Assist | Composer (Airflow) | Cursor | Data Contracts | Data Migration | Data Modeling | Data Security | Data Vault | DataOps | Dataflow | Dataplex | Dimensional Kimball | Embedding Generation | Encryption | Feature Store | GCP BigQuery | Gemini Code Assist | GitHub Copilot | Google BigQuery | Google Cloud | Google Cloud Platform | Governance | Integration Testing | Object-Oriented | Object-oriented programming | Observability | Pub/Sub | Python | RAG | SCD | SQL | Terraform | Third Normal Form | Third Normal Form 3NF | Unit Testing | Vector Database | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI architecture | APIs | Agent systems | Cloud platform | Data PipelinesSenior-level Full TimeLondon, UK10h ago
-
C++ | Data Processing | Data debugging | Data extraction | Distributed ComputingSenior-level Full TimeLondon, UK10h ago
-
Machine Learning Engineer GBP 110K-145KCI/CD | Docker | Feature Engineering | Kubernetes | Model Deployment401k matching | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceSenior-level Full TimeUnited Kingdom R21h ago
-
Airflow | BigQuery | Computer Vision | Deep learning | EmbeddingsBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Income replacement programsSenior-level Full TimeRemote - United Kingdom R22h ago
-
Staff Machine Learning Engineer, ML Efficiency GBP 81K-118KApache Spark | C++ | Caching | Cloud Cost Optimization | Cloud infrastructureBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group pension with employer matchSenior-level Full TimeRemote - United Kingdom R1d ago
-
Senior-level Full TimeLondon1d ago
-
Data Business Engineer GBP 65K-80KAccess Control | Amazon Redshift | BigQuery | COGS Modeling | Data GovernanceMid-level Full TimeLondon, United Kingdom1d ago
-
Senior Robotics Research Engineer GBP 62K-78KC# | C++ | CI/CD | Concurrent programming | Continuous DeploymentAnnual leave | Cycle to work scheme | EAP | Employer pension matching | Exclusive discountsSenior-level Full TimeWelwyn Garden City, United Kingdom R1d ago
-
Senior Robotics Software Engineer GBP 62K-84KAgile | Automated testing | BigQuery | CI/CD | CUDAAnnual leave | Cycle to work scheme | Employee assistance program | Exclusive discounts | Free shuttle busSenior-level Full TimeHatfield, United Kingdom R1d ago
-
Agentic Workflows | Context design | Embeddings | Evaluation | Evaluation datasetsCoaching and mentorship culture | Community of practice events | Hybrid work policy | Learning and development opportunities | Travel for UK and South Africa officesSenior-level Full TimeGateshead, Tyne and Wear, UK, GB …1d ago
-
Applied AI Engineer – Prompting & Evaluation GBP 65K-90K.NET | Automated testing | C# | Context design | Cost OptimizationHybrid work policy | Office collaboration | Remote work optionMid-level Full TimeGateshead, Tyne and Wear, UK, GB …1d ago
-
Data Infrastructure and AI Engineer GBP 35K-40KBenchmarking | C# | C++ | Cloud Native | Concurrency ControlEntry-level Full TimeEdinburgh, United Kingdom1d ago
-
Mid/Senior Solution Architect GBP 80K-110KAmazon Web Services | Azure Machine Learning | CI/CD | Cloud platform | DockerDiscounted lunch | Educational budget | Flexible working hours | Hybrid work | Language classesSenior-level Full TimeLondon, United Kingdom1d ago
-
Mid-level Full TimeManchester, England, United Kingdom1d ago
-
Data Engineer GCP (Remote) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformRemote work environmentMid-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
Data Engineer (GCP) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Data pipelineMid-level Full TimeStoke-on-Trent, England, United Kingdom1d ago
-
Data Engineer GBP 45K-45KAPI | Alerting | Automation | CI/CD | Data AnalysisAgile working | Career development | Family-friendly policies | Holiday | Learning and developmentMid-level Full TimeNorthampton, United Kingdom1d ago
-
Lead Data Engineer GBP 52K-52KBusiness Intelligence | Data Architecture | Data Cataloging | Data Engineering | Data GovernanceFlexible workingSenior-level Full TimeUnited Kingdom1d ago
-
Senior Software Engineer, Embedded UI GBP 70K-85KAPI Design | Artificial Intelligence | BrightScript | Cloud Development | Content ManagementCommuter benefits | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeCambridge, United Kingdom1d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Career growth opportunities | Remote workMid-level Full TimeCambridge, United Kingdom1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Inclusive workplace | Remote-friendly, distributed teamMid-level Full TimeReading, United Kingdom1d ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous work culture | Inclusive workplace | Remote work cultureMid-level Full TimeCardiff, United Kingdom1d ago
-
Junior Python Developer GBP 38K-38KAPI Development | AWS | Data Engineering | FastAPI | Machine LearningEntry-level Full TimeHolborn - London, United Kingdom1d ago
-
Mid-level Full TimeHolborn - London, United Kingdom1d ago
-
Senior Robotics & Lab Automation Engineer GBP 44K-53KAPIs | Automation | Autonomous Systems | Bioprocess | C#Annual leave | Comprehensive onboarding | Cycle to work scheme | Flexible work schedule | Free hot and cold drinksSenior-level Full TimeRoyston York Way, United Kingdom1d ago