Principal Data Engineer
London, England, United Kingdom
GBP 80K-110K (estimate) Senior-level Full Time
Tasks
- Build and evolve ingestion frameworks event bus and lakehouse
- Coach engineers and improve hiring process
- Create technical documentation for self serve data access
- Define data quality schema evolution and contract testing standards
- Design data services for scale and operational excellence
- Design entity relationship and event ingestion normalization and merging
- Design petabyte scale batch micro batch and streaming pipelines
- Develop and review production Python code
- Drive cloud data infrastructure and containerized deployment standards
- Implement event sourced streaming patterns with Kafka
- Integrate data platform with services via APIs and event streams
- Lead Data platform architecture
- Own data lineage quality freshness and observability
- Partner with ML engineers for feature engineering and inference pipelines
- Set medium to long term technical direction for data infrastructure
- Support logging monitoring alerting and incident management for data systems
Perks/Benefits
- Annual learning budget
- Enhanced parental leave and childcare benefits
- Equity participation
- Home office budget
- Hybrid work policy
- Life insurance
- Medical coverage
- Pension contribution
- Unlimited time off
Skills/Tech-stack
AWS | Airflow | Alerting | Argo Workflows | ArgoCD | Contract testing | DBT | Data Engineering | Data Lineage | Data Observability | Data Quality | Docker | ELT | ETL | Event Sourcing | Flink | GCP | GRPC | Grafana Cloud | Kafka | Kotlin | Kubernetes | Lakehouse | Logging | Monitoring | PostgreSQL | Python | Schema evolution | Spark | TypeScript | Yugabyte
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
MLOps Engineering Specialist GBP 55K-58KAWS | AWS CDK | AWS CloudFormation | AWS Glue | AlertingDiscounted mobile and broadband | Gym membership discounts | Holiday purchase scheme | Online GP service | Paid Maternity LeaveMid-level Full TimeLondon, GB, E1 8EP R1h ago
-
Senior Machine Learning Engineer GBP 70K-86KAWS | AWS Step Functions | Airflow | Argo | AzureFinancial wellness support | Flexible remote work | Health benefits | Hybrid work | Mental health supportSenior-level Full TimeCambridge, United Kingdom6h ago
-
Sr. AI Engineer GBP 90K-120KAPI Integration | Agentic Workflows | Language Models | Large Language Models | Machine Learning401k match | Charitable giving program | Dental insurance | FSA | HSASenior-level Full TimeUK - Remote R13h ago
-
Senior Data Engineer (Temp) GBP 60K-70KAlerting | Apache Spark | Automated testing | Azure Data | Azure Data FactorySenior-level Full TimeLondon, Greater London, England, United Kingdom15h ago
-
Software engineer, generative AI (UK) GBP 80K-120KAWS | Asyncio | Azure | Continuous Deployment | DockerCancer testing | Company offsites | Dental insurance | Fertility and family planning support | Learning and development stipendSenior-level Full TimeLondon, UK17h ago
-
Junior Quant - Algo Analytics GBP 38K-40KData Analysis | Data Visualization | Data sets | Financial markets | Language ProcessingDiscounted gym membership options | Enhanced parental leave | Flexible working arrangements | Group sick pay | Life insuranceEntry-level Full TimeLondon18h ago
-
Entry-level Full TimeBirmingham, England, United Kingdom19h ago
-
Senior Data Engineer GBP 64K-75KAWS Glue | Apache Airflow | Azure Data | Azure Data Factory | CI/CDHybrid work arrangementSenior-level Full Time17th Floor, 5 Aldermanbury Square, London, …20h ago
-
Senior Data Governance Engineer GBP 79K-106KAWS | Alerting | Apache Kafka | Apache Spark | AzureEmployee resource groups | Equity ownership | Paid time off | Pension contribution | Private health insuranceSenior-level Full TimeBelfast21h ago
-
Senior Data Engineer - Infra GBP 68K-85KApache Airflow | Apache Kafka | ClickHouse | Grafana | JavaSenior-level Full TimeLondon, England, GB22h ago
-
Automation Testing | Bash | CI/CD | Docker | Embedded SystemsCycle scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeMid-level Full TimePlymouth, England, United Kingdom22h ago
-
Embedded Software Engineer GBP 45K-60KAUTOSAR | Abstraction layer | Agile | Bamboo | Build AutomationCareer development | Cycle and tech scheme | Employee assistance programme | Flexible work arrangement | Learning MentoringMid-level Full TimeManchester, England, United Kingdom22h ago
-
Automation | Backtesting | Cloud Computing | Continuous Delivery | Data PipelinesMid-level Full TimeLONDON, LONDON, United Kingdom23h ago
-
AI Engineer GBP 72K-90KAPI Integration | AWS | Agentic AI | Azure | CI/CDEmployee support for caregiving responsibilities | Family-friendly work environment | Flexible working options | Hybrid work environmentSenior-level Full TimeManchester, United Kingdom1d ago
-
.NET | APIs | Angular | Databricks | PythonMid-level ContractLondon, United Kingdom of Great Britain …1d ago
-
Data Engineer GBP 45K-50KAPIs | Access Control | CI/CD | Data Governance | Data ModelingAnnual leave | Flexible hybrid work environment | Gym membership discount | Healthcare cashback | Perks platformMid-level Full TimeLondon, England1d ago
-
Senior Applied Scientist GBP 110K-160KCloud Computing | Data Analysis | Deep learning | Git | GitHubHybrid work schedule | Paid time off | Remote work options | Stock optionsSenior-level Full TimeLondon1d ago
-
Staff Applied Scientist GBP 205K-270KCloud Computing | Complex Planning | Data Analysis | Deep learning | GitCollaborative environment | EMI share option scheme | Hybrid work | Mentoring and coaching | Share optionsSenior-level Full TimeLondon1d ago
-
AWS Data Engineer GBP 45K-45KAWS Batch | AWS Glue | AWS Lambda | AWS Step Functions | Amazon OpenSearchCertifications support | Death in service cover | Electric vehicle leasing | Mentorship | Paid time offMid-level Full TimeLondon, England, United Kingdom1d ago
-
AI Engineer GBP 65K-85KAPI Integration | AWS | Azure | GCP | Language ProcessingDisability programs | Flexible working hours | Hybrid work | Life insurance | Onsite workMid-level Full TimeGB-LONDON-245 HAMMERSMITH ROAD, United Kingdom1d ago
-
Analytics Engineer GBP 70K-70KAWS S3 | CI/CD | DBT | Data Architecture | Data ContractsHybrid work modelSenior-level Full TimeLOC0001450, United Kingdom1d ago
-
API Testing | AWS | Airflow | Autodesk CAD | AzureSenior-level Full TimeEMEA - United Kingdom - London … R1d ago
-
Senior Staff Generative AI Engineer, Vice President GBP 90K-128KCI/CD | Code review | Continuous Delivery | Continuous integration | Distributed SystemsHybrid work | In office collaboration 3 days | Learning resources | Mentorship | Remote work up to 2 daysSenior-level Full Time40 BANK STREET, United Kingdom1d ago
-
Associate, AI Infrastructure Engineer GBP 58K-78KAWS | AWS Bedrock | Access Management | Alerting | AzureEducation reimbursement | Emotional well-being support | Family support programs | Flexible time off | Hybrid work modelMid-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R1d ago
-
Lead Cyber Automation and AI Engineer GBP 84K-109KArchitecture Troubleshooting | Artificial Intelligence | Automation | Cloud | Container InfrastructureEmployee benefits | Flexible working arrangements | Opportunity for internal mobility | Team developmentSenior-level Full TimeWaterloo Street, United Kingdom1d ago