Senior Data Engineer - Data Ingestion and Enrichment team
Tasks
- Apply access control classification and privacy protections
- Build batch and streaming ingestion pipelines
- Collaborate with product backend analytics and ML teams
- Contribute to SLO alerting and incident response
- Create ingestion templates and self service tooling
- Define raw standardized consumption layers
- Design data lake foundations
- Develop enrichment logic and reusable patterns
- Implement data contracts and validation checks
- Instrument observability for freshness latency quality and cost
- Manage dataset versioning and point in time correctness
Perks/Benefits
- Equity
- Free mental health support
- Health insurance
- Learning and development allowance
- Leave allowance
- Time off
Skills/Tech-stack
AWS | Access Control | Alerting | Anomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Batch Processing | Cloud platform | DBT | Data Contracts | Data Engineering | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Validation | Debezium | Google Cloud | Google Cloud Platform | Observability | Orchestration | Privacy Masking | SLO | Schema management | Spark Streaming | Streaming Data
Education
N/A
Roles
Related jobs
-
Senior Machine Learning Engineer GBP 92K-120KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London R1d ago
-
Lead Machine Learning Engineer GBP 84K-115KAWS | Azure | Cloud Computing | Cloud platform | DockerCoaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - Remote R1d ago
-
Lead AI Engineer GBP 75K-90KAWS | Agent Orchestration | Agent systems | Azure | EvaluationCycle to work scheme | Dental insurance | Happy hours | Health insurance | Learning and development budgetSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Analytics Engineer GBP 85K-95KAggregate Functions | BigQuery | CI | CTE | DBTRemote-flexible work | Team in person London every 6 to 8 weeksSenior-level Full TimeLondon, United Kingdom R2d ago
-
Senior Data Engineer GBP 65K-77KAutomation | Azure Data | Azure Data Services | CI/CD | Cloud ComputingSenior-level Full TimeLondon, Greater London, United Kingdom2d ago
-
Data Engineering | Dataset curation | Evaluation | Experimentation | Language ModelsSenior-level Full TimeUnited Kingdom, London, London2d ago
-
Senior Machine Learning Engineer GBP 28K-30KAlerting | Algorithms | Apache Spark | BigQuery | Cloud ComputingAnnual bonus scheme | Bank holidays | Employee assistance programme | Free 247 virtual GP service | Holiday Starting At 25 DaysSenior-level Full TimeWelwyn Garden City, United Kingdom of …2d ago
-
Applied AI ML Data Scientist, Vice President - Payments GBP 100K-186KAPIs | AWS | Agent systems | Audit documentation | Automated testingExecutive-level Full TimeLONDON, United Kingdom2d ago
-
Research Engineer - Data Infrastructure GBP 100K-180KData Augmentation | Data Curation | Data Deduplication | Data Pipelines | Data QualityAnnual company offsite | Learning and development stipend | Monthly co-working stipend | Social travel stipendMid-level Full TimeUnited Kingdom R3d ago
-
AWS | Airflow | Application design | Automated testing | CI/CDExecutive-level Full TimeLONDON, United Kingdom3d ago
-
Data Platform Engineer, London GBP 71K-73KBioinformatics | Cloud platform | Computational Chemistry | DBT | Data EngineeringHybrid workMid-level Full TimeLondon3d ago
-
Data Engineer GBP 50K-70KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | AzureIn office collaboration 4 days per week | Opportunity to work on cutting-edge technology | Remote work flexibility | Team of talented engineers | Work-life flexibilityMid-level Full TimeLondon R3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeManchester, United Kingdom3d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeNewcastle, United Kingdom3d ago
-
Azure Databricks Developer EUR 56KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlex benefits program | Income protection | Life assurance | Paid time off | Pension matchingMid-level Full TimeUK Wide, GB R3d ago
-
Entry-level ContractLeeds, England, United Kingdom3d ago
-
Data Engineer GBP 26K-26KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultAnnual discretionary bonus | Annual leave | Bank holidays | Cycle to work initiative | Discounted gym membershipMid-level Full TimeSkipton - The Bailey, United Kingdom R3d ago
-
Sr Advisor, Commercial Data Engineering GBP 60K-85KAzure Data | Azure Data Factory | Azure DevOps | DBT | DashSenior-level Full TimeLondon, GB3d ago
-
AWS | Advanced Analytics | Databricks | Deployment | Machine LearningEntry-level Full TimeGlasgow Campus, United Kingdom3d ago
-
Software Engineer - Data Platform GBP 55K-79KAWS | Big Data | Big data processing | C++ | Continuous DeliveryWork-life balance programsEntry-level Full TimeLondon3d ago
-
Product - Analytics Engineer GBP 55K-60KApache Spark | Automation | Data Governance | Data Modeling | Data TestingAnnual incentive bonus | Employee discounts | Family BUPA healthcare | Matched pensionMid-level Full TimeHoughton Regis, England, LU5 5XE, GB4d ago
-
Data Engineer GBP 36K-36KAPI documentation | Authentication | Data Governance | Data Modeling | Data MonitoringMid-level Full TimeLondon (GB)4d ago
-
Principal Software Engineer, AI Email App GBP 100K-160KAI workflow | AI workflow design | Backend APIs | Failure handling | Fallback mechanismsSenior-level Full TimeUnited Kingdom R4d ago
-
Lead Software Engineer, AI Email App GBP 100K-150KApplication development | Automated testing | Backend Development | CI/CD | Client Application DevelopmentSenior-level Full TimeUnited Kingdom R4d ago
-
Staff Software Engineer, AI Email App GBP 100K-173KAPI Development | Backend Development | Error Handling | LLM integration | Latency optimizationSenior-level Full TimeUnited Kingdom R4d ago