Senior Data Engineer
Tasks
- Apply LLMs for entity resolution and schema mapping
- Build pipelines for model training and inference workflows
- Create documentation and runbooks
- Create repeatable ELT patterns for schema conflicts
- Define and enforce data quality standards
- Design, build, and maintain data pipelines
- Evaluate and recommend stack tooling improvements
- Implement access controls and privacy preserving access
- Implement ingestion patterns for diverse data sources
- Instrument product features with event data
- Monitor and optimize BigQuery performance and cost
- Onboard acquired firms data into canonical data model
- Own orchestration and pipeline observability
- Partner to deliver clean structured upstream data
- Support self serve analytics with dbt semantic layer
Perks/Benefits
- Annual leave
- Discount on legal fees
- Equity
- MacBook
- Pension contribution
- Team building activities and socials
Skills/Tech-stack
Airflow | Amazon Web Services | BigQuery | Claude Code | Cloud platform | Clustering | Cursor | DBT | Dagster | Data Lineage | Data Modeling | Data Quality | Data Security | Data integration | ELT | Entity Resolution | Google Cloud | Google Cloud Platform | Kubernetes | LLM | Partitioning | Privacy | Python | Schema Contracts | Web Services
Education
N/A
Roles
Related jobs
-
AI Engineer GBP 75K-100KC# | Cloud Computing | MLOps | Machine Learning | NoSQLAnnual leave | Benefit discounts | Healthcare cash plan | Life insurance | Pension matchingSenior-level Full TimeLondon, United Kingdom2h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous work culture | Entrepreneurial team | Hands-off management | Inclusive workplace | Opportunity to make impactMid-level Full TimeLondon, United Kingdom7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Life-changing product impact | Remote/distributed workMid-level Full TimeLondon, United Kingdom7h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Entrepreneurial team | Remote/distributed workMid-level Full TimeManchester, United Kingdom7h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Flexible management approach | Opportunity for impact | Remote/distributed workMid-level Full TimeEdinburgh, United Kingdom7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote workMid-level Full TimeBristol, United Kingdom7h ago
-
Bash | Data Ingestion | Data Ingestion Pipelines | Data Processing | DockerAsynchronous culture | Friendly atmosphere | Remote workMid-level Full TimeBirmingham, United Kingdom7h ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous work culture | Career growth opportunity | Remote/distributed work | Supportive team environmentMid-level Full TimeGlasgow, United Kingdom7h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingMid-level Full TimeLeeds, United Kingdom7h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive salary | Entrepreneurial team support | Friendly laid-back atmosphereMid-level Full TimeNewcastle, United Kingdom7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Collaborative team environment | Flexible management approach | Impactful mission | Remote-first workMid-level Full TimeNottingham, United Kingdom7h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Remote-friendlyMid-level Full TimeBrighton, United Kingdom7h ago
-
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 74K-103KAI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial IntelligenceHybrid schedule | Travel opportunities | Workshops and community engagementSenior-level Full TimeLondon, United Kingdom R9h ago
-
Forward Deployed Solution Engineer – Applied AI FDE GBP 90K-110KAWS | Angular | Azure | CI/CD | ContainersAgile sprint delivery | Remote or flexible work options | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom16h ago
-
Lead Analytics Engineer (6 Month FTC) GBP 60K-70KCI/CD | DBT | Data Modelling | Data Quality | Data TestingDiscounted private healthcare | Employee assistance programme | Enhanced family leave | Free onsite gym | Health cash planSenior-level Contract Full Time TemporaryManchester / Hybrid, England, United Kingdom R23h ago
-
Director, Generative AI Experience Engineering GBP 61K-80KAI Observability | AWS | Agent systems | Azure | CI/CDHybrid work flexibility | In office days requirementExecutive-level Full TimeLondon23h ago
-
Senior Data Engineer GBP 53K-70KAgile | Apache Airflow | BigQuery | CI/CD | Cloud ComposerBirthday off | Cycle2Work | Dental insurance | Discounts on broadband TV mobile | Electric vehicle leaseSenior-level Full TimeLondon1d ago
-
Forward Deployed Engineer, Google Cloud Consulting GBP 111K-125KAPIs | Agent systems | Cloud platform | Cost Optimization | CrewAIMid-level Full TimeLondon, UK1d ago
-
Mid-level Full TimeLondon, United Kingdom1d ago
-
Senior Analytics Engineer GBP 85K-105KData Governance | Data Modelling | Data Quality | Data Security | Data WarehouseAllocated learning and development budget | Enhanced parental leave | Flexible benefits | Free meals and snacks | Prayer meditation and breastfeeding roomSenior-level Full TimeLondon (Shoreditch) R1d ago
-
Data Engineer - Kids Planet Central Support GBP 30K-33KAPI | AWS | Azure | Cloud Platforms | Data GovernanceAnniversary Awards | Birthday leave | Career progression | Discounted childcare | Employee assistance programmeMid-level Full TimeLymm, England, WA13 0RN, GB1d ago
-
Embedded Software Engineer GBP 45K-60KARM | Agile | Bare Metal | Bitbucket | CANAnnual bonus scheme | Bank holidays | Enhanced maternity pay | Enhanced paternity pay | Flexible working optionsMid-level Full TimeGuildford, United Kingdom1d ago
-
Machine Learning Engineer GBP 78K-85KAWS | Apache Airflow | Apache Beam | Apache Kafka | Apache SparkCycle to work scheme | Employee assistance plan | Employee discounts | Flexible working options | Health cash planSenior-level Full TimeEdinburgh1d ago
-
Machine Learning Engineer GBP 78K-90KAWS | Amazon SageMaker | Apache Beam | Apache Spark | CI/CDCycle to work scheme | Employee assistance plan | Flexible working options | Health cash plan | Learning and development opportunitiesSenior-level Full TimeLondon1d ago
-
Senior Agentic AI Engineer GBP 80K-100KAgentic AI | BrightScript | C plus plus | Evaluation | Function CallingFinancial wellness resources | Flexible remote work Fridays | Hybrid work arrangement | Mental health supportSenior-level Full TimeCambridge, United Kingdom R1d ago