Senior II Data Engineer - Ingestion and Enrichment team
Tasks
- Build data lake ingestion foundations
- Collaborate with product backend analytics and ML teams
- Create ingestion templates and reusable platform tooling
- Define data contracts and implement early validation
- Develop enrichment logic for shared definitions
- Implement access control classification and privacy protections
- Instrument ingestion pipelines with observability
- Manage dataset versioning and point in time correctness
- Own batch and streaming ingestion pipelines
- Support SLOs alerting and incident response
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | DBT | Debezium | Flink | GCP | Kafka | Kubernetes | SQL | Spark | Streaming | Terraform
Education
N/A
Roles
Related jobs
-
Access Control | Analysis Services | Authorization | Azure | Azure AnalysisSenior-level Full TimeBirmingham, England, United Kingdom8h ago
-
Mid-level Full TimeGlasgow Campus, United Kingdom17h ago
-
Enterprise Data Engineer GBP 45K-45KAgile | Apache Spark | Automated testing | Azure | Azure DataAnnual leave | Bonus scheme | Flexible benefits | Flexible working | Pension schemeMid-level Full TimeEnterprise House, United Kingdom17h ago
-
Data Engineer - Datacore / IOTT GBP 45K-45KAPI Integration | Apache Spark | Azure | Azure DevOps | Azure SynapseAnnual leave | Bonus scheme | Flexible benefits | Flexible working | Pension schemeMid-level Part TimeLancaster House, United Kingdom17h ago
-
Senior Data Engineer GBP 64K-64KAgile | Apache Spark | Automation | Azure | By DesignAnnual leave | Employee discounts | Enhanced family leave | Flexible benefits | Life assuranceSenior-level Full TimeLancaster House, United Kingdom17h ago
-
AI Solutions Engineer - Associate - London GBP 72K-93KAPI Integration | AWS | Artificial Intelligence | Azure | CI/CDMid-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Applied AI Analytics Lead 14 Months FTC GBP 70K-80KAzure Foundry | Copilot Studio | DBT | Microsoft Fabric | Power AutomateHands on production environment | Hybrid work modelSenior-level ContractLondon, England, United Kingdom R1d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Inclusive workplace | Remote-friendlyMid-level Full TimeCambridge, United Kingdom1d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeReading, United Kingdom1d ago
-
Data Engineer GBP 70K-70KBusiness Intelligence | DBT | Data Modeling | Data Pipelines | Data QualityAnnual company offsite | Learning and development stipend | Monthly co-working stipend | Social travel stipendMid-level Full TimeUnited Kingdom R1d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Impact on learning accessibility | Remote workMid-level Full TimeCardiff, United Kingdom1d ago
-
Data Engineer GBP 60K-65KAWS Lambda | Airbyte | Amazon S3 | Amazon Web Services | DBT24 days holiday | Bank holidays | Birthday off | Coaching access | Company retreatMid-level Full TimeZinc - London R1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Senior GenAI Engineer GBP 90K-115KCI/CD | Cloud infrastructure | Docker | Embeddings | Integration TestingFlexible schedule | Hybrid work | Knowledge sharing sessions | Professional developmentSenior-level Full TimeManchester, United Kingdom1d ago
-
Data Engineer - Protect (South) GBP 33K-41KData Engineering | Data Governance | Data Quality | Data Security | Data WarehousingAnnual bonus | Buy As You Earn Scheme | Colleague discount | Holiday allowance | Hybrid workMid-level Full TimeReigate -The Omnibus Building, Lesbourne Road, …1d ago
-
Senior Data Engineer GBP 75K-105KAWS | Automated testing | CI/CD | Databricks | Infrastructure as CodeCharitable volunteering | Employee assistance programme | Flexible working | Hybrid work | Life assuranceSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer – Python FTC GBP 49K-56KAWS | Amazon Athena | Amazon EMR | Amazon S3 | Apache AirflowFlexible working hours | Free parking | Hybrid working | Public transport access | Secure bike shedMid-level Full TimeManchester, United Kingdom1d ago
-
Senior Data Analytics Engineer GBP 75K-109KAgile | Alerting | Azure Data | Azure Data Platform | CI/CDAdditional paid holiday | Cycle to work scheme | Eye care support | Generous holiday package | Hybrid workingSenior-level Full TimeSouthampton, ENGLAND, United Kingdom1d ago
-
Lead Data Engineer GBP 80K-96KAWS | Apache Spark | Azure | Batch Processing | C4 model30 days holiday | Flexible parental leave | Paid counselling | Pension | Remote WorkingSenior-level Full TimeAny UK Office Hub (Bristol / …1d ago
-
CSS | Data Modeling | ETL | HTML | JavaScriptSenior-level Contract TemporaryRemote or Hybrid (Finchley, North London … R1d ago
-
Lead Data Platform Engineer GBP 84K-110KAmazon Web Services | Continuous Delivery | Continuous Integration/Continuous Delivery | Continuous integration | DatabricksSenior-level Full TimeLondon, UK, United Kingdom1d ago
-
Senior Analytics Engineer GBP 60K-70KCommon table expressions | DBT | Data Quality | Data Testing | Data WarehousingOn-going training | Skills for lifeSenior-level Full TimeLondon, GB1d ago
-
Principal Data Engineer GBP 70K-89KAWS | AWS Glue | Airflow | ArgoCD | AvroAutonomy | Influence | Mentorship | Professional growthSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Lead AI Engineer GBP 72K-120KAPI | AWS | Amazon Bedrock | CI/CD | DockerAnnual leave | Bank holidays | Employee assistance program | Flexible benefits | Hybrid work modelSenior-level Full TimeLondon, United Kingdom R1d ago
-
Financing Quantitative Analyst GBP 84K-93KArtificial Intelligence | Azure | Azure Data | Azure Data Bricks | C plus plusCareer development opportunities | Disability inclusion support | Flexible working options | Inclusive cultureMid-level Full TimeLondon, United Kingdom1d ago