Senior Data Engineer (Contract)
Tasks
- Apply CI CD to data pipelines
- Build embedding and retrieval pipelines
- Build testable data pipelines
- Contribute to infrastructure as code environments
- Deploy data systems on cloud storage compute and orchestration
- Develop Databricks notebook to production pipelines
- Implement data contracts and schema evolution
- Implement data quality validation and lineage tracking
- Manage feature tables in Unity Catalog
- Prepare AI ready feature pipelines
- Set up pipeline monitoring and alerting
- Use MLflow for experiment tracking and model registry
Perks/Benefits
Skills/Tech-stack
AI | AWS | Alerting | Apache Spark | Azure | CI/CD | DBT | Data Contracts | Data Lineage | Data Quality | Databricks | Databricks Workflows | Delta Lake | Embedding pipelines | Feature Engineering | Feature Pipelines | Feature Store | Infrastructure as Code | Lakehouse Architecture | MLflow | Machine Learning | Medallion Architecture | Model Registry | Monitoring | Retrieval Pipelines | Schema evolution | Unity Catalog | Vector Stores | Version control | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Data Engineer GBP 70K-70KAgile | Behavior-Driven Development | CI/CD | Code review | Data EngineeringDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceSenior-level Full TimeLondon, United Kingdom15h ago
-
Data Engineer GBP 57K-57KAgile | Alteryx | Automated testing | Behavior-Driven Development | CI/CDDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceMid-level Full TimeLondon, United Kingdom16h ago
-
Senior Machine Learning Engineer GBP 72K-85KBatch Machine Learning | CI/CD | Containerization | Data Pipelines | Data parallelismDisability accommodations during hiring process | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom17h ago
-
Data Engineer GBP 51K-55KApache Airflow | Azure Data | Azure Data Factory | Azure Functions | C#Hybrid work options | Knowledge sharing culture | Professional growth opportunities | Work flexibilityMid-level Full TimeBristol, 3 RIVERGATE, United Kingdom17h ago
-
Software Engineering III - AI/ML Engineer GBP 80K-109KAWS | Automation | Databricks | Datadog | Disaster RecoverySenior-level Full TimeLONDON, LONDON, United Kingdom21h ago
-
Quantitative / AI Specialist GBP 50K-60KAPI Integration | Analytics | Artificial Intelligence | C++ | Electronic PricingEntry-level Full TimeLondon, United Kingdom21h ago
-
365 Admin Center | Access Control | Admin Center | Data Cleansing | Data GovernanceEntry-level Contract Full Time TemporaryCanary Wharf, 1 Churchill Place, United …1d ago
-
Senior AWS Data Platform Developer GBP 72K-85KAWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS Lake FormationSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
ML/AI Engineer GBP 70K-85KAutoscaling | Blue/green | CI/CD | CUDA | CanaryAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeManchester Westminster House, United Kingdom1d ago
-
AI Engineer / AI Analyst GBP 60K-80KAI Evaluation | Agent systems | CI/CD | Cloud Computing | ComplianceCycle to work scheme | Employee Assistance Programme (EAP) | Employer pension contributions | Health related time off | Hybrid workingMid-level Full TimeUK-London-Chiswick Bldg 5 Floor 4, United …1d ago
-
Lead Data Warehousing Engineer GBP 75K-100KArtificial Intelligence | CRM | Data Governance | Data Ingestion | Data LineageCollaborative inclusive team | Employee benefits | Flexible working arrangements | Opportunities for internal mobilitySenior-level Full TimeLN - 25 Cabot Square, United …1d ago
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom1d ago
-
Lead AI Engineer (AI Systems & Automation) GBP 78K-109KAlerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetSenior-level Full TimeUnited Kingdom R1d ago
-
Applied AI Engineer GBP 70K-85KCloud Computing | Data Modeling | Deep learning | Docker | LLM DeploymentFully expensed tech | Meal allowance | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom3d ago
-
Forward Deployed Engineer - Defence GBP 65K-90KAngular | Artificial Intelligence | Full Stack | Full-Stack Development | GitEqual opportunity | Technical training | Travel as neededMid-level Full TimeLondon, Greater London, England, United Kingdom3d ago
-
Consulting Systems Engineer, Data Management (EMEA) GBP 75K-101KAWS | Ansible | Apache Kafka | Azure | Cloud hybridCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeRemote, United Kingdom R3d ago
-
Senior AI/ML engineer GBP 120K-150KAWS | CI/CD | Databricks | Deep learning | Delta LakeAccelerated professional growth | Enhanced parental leave | Female health leave | Fully paid sabbatical | Health pension wellbeing benefitsSenior-level Full TimeLondon R3d ago
-
Lead Software Engineer - Python, Databricks, AWS GBP 72K-100KAWS | AWS Step Functions | Agile | Airflow | Apache SparkSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom3d ago
-
Staff ML Engineer, Gaia GBP 146K-162KData Pipelines | Debugging | Deep learning | Distributed Training | Machine LearningHybrid workSenior-level Full TimeLondon3d ago
-
Software Engineer II - Applied AI GBP 57K-70KAI Applications | AWS | Amazon SageMaker | Azure | Cloud NativeMid-level Full TimeLONDON, LONDON, United Kingdom3d ago
-
Junior Analytics Engineer GBP 30K-35KArtificial Intelligence | DBT | Data Modeling | Data pipeline | ELTCycle to work scheme | Electric vehicle salary sacrifice | Employee referral program | Flexible working | Office meals and snacksEntry-level Full TimeLondon R3d ago
-
Digital Chemist - Lab Automation & Data Science GBP 28K-28KData Analysis | Data Processing | Data Visualization | Hardware Integration | Laboratory automationBonus scheme | Life insurance | Paid time off | Pension plan | Private medical insuranceMid-level Full TimeBracknell, BERKSHIRE, United Kingdom3d ago
-
Analytics Engineer GBP 75K-90KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data ModellingEnglish language at office | In person 3 days per week | Relocation supportMid-level Full TimeLondon R3d ago
-
Research Engineer, Quantum Computing, DeepMind GBP 45K-60KAgentic AI | Algorithms | Data Structures | Language Models | Language ProcessingMid-level Full TimeLondon, UK3d ago
-
Principal Data Engineer GBP 90K-103KCI | CI/CD | DBT | Data Contracts | Data ManagementCareer Development Programs | Collaborative culture | Flexible time off | Flexible work schedules | Health and wellness benefitsSenior-level Full TimeAntrim, Northern Ireland, United Kingdom; Remote- … R3d ago