Principal Data Engineer
London, England, United Kingdom
GBP 80K-110K (estimate) Senior-level Full Time
Tasks
- Build and evolve ingestion frameworks event bus and lakehouse
- Coach engineers and improve hiring process
- Create technical documentation for self serve data access
- Define data quality schema evolution and contract testing standards
- Design data services for scale and operational excellence
- Design entity relationship and event ingestion normalization and merging
- Design petabyte scale batch micro batch and streaming pipelines
- Develop and review production Python code
- Drive cloud data infrastructure and containerized deployment standards
- Implement event sourced streaming patterns with Kafka
- Integrate data platform with services via APIs and event streams
- Lead Data platform architecture
- Own data lineage quality freshness and observability
- Partner with ML engineers for feature engineering and inference pipelines
- Set medium to long term technical direction for data infrastructure
- Support logging monitoring alerting and incident management for data systems
Perks/Benefits
- Annual learning budget
- Enhanced parental leave and childcare benefits
- Equity participation
- Home office budget
- Hybrid work policy
- Life insurance
- Medical coverage
- Pension contribution
- Unlimited time off
Skills/Tech-stack
AWS | Airflow | Alerting | Argo Workflows | ArgoCD | Contract testing | DBT | Data Engineering | Data Lineage | Data Observability | Data Quality | Docker | ELT | ETL | Event Sourcing | Flink | GCP | GRPC | Grafana Cloud | Kafka | Kotlin | Kubernetes | Lakehouse | Logging | Monitoring | PostgreSQL | Python | Schema evolution | Spark | TypeScript | Yugabyte
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Staff Machine Learning Engineer (Platform) - Australia based - Full Relocation Provided GBP 97K-120KAWS | Azure | CUDA | CUDA kernels | Data PipelinesCompetitive salary | ESOP | Flexible work environment | Office events | Relocation assistanceSenior-level Full TimeLondon15h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial environment | Remote-friendly, distributed teamMid-level Full TimeOxford, United Kingdom16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed work environment | Supportive teamMid-level Full TimeBelfast, United Kingdom16h ago
-
Data Engineer | London, UK GBP 50K-55KApache Spark | Batch Processing | Cause analysis | Data Analysis | Data LakeMid-level Full TimeUnited Kingdom19h ago
-
Senior-level Full TimeKnutsford, Radbroke Hall, United Kingdom20h ago
-
Senior Data Scientist - ST&S GBP 72K-112KAI Agents | APIs | AWS | Autogen | AutomationFlexible working options | Hybrid work | Paid parental leave | Paid travel up to 10 percent | Retirement benefitsSenior-level Full TimeGB: London - 25 North Colonnade, …20h ago
-
Machine Learning Engineer GBP 25K-25KAzure | Azure DevOps | CI/CD | Containerization | DatabricksFlexible working | Healthcare coverage | Learning and development support | Professional development | Retirement plansMid-level Full TimeYork, United Kingdom20h ago
-
Automated testing | CI/CD | Data Analysis | Functional Programming | Machine LearningMid-level Full TimeCanary Wharf, 1 Churchill Place, United …20h ago
-
Senior Data Engineer GBP 70K-90KAPI Integration | AWS | Airflow | Azure | Cloud platformCompany lunches | Company outings | Continuing education | Flexible PTO | Health and dental benefitsSenior-level Full TimeLondon1d ago
-
Forward Deployed Solution Engineer – Applied AI FDE GBP 80K-110KAWS | Angular | Azure | CI/CD | ContainersFlexible work options | Remote or required in officeSenior-level Full TimeLondon, United Kingdom1d ago
-
Applied AI Engineer GBP 40K-80KAI Agents | API Integration | Docker | Embeddings | JavaScriptCareer development opportunities | High-growth startup | International expansion environment | Ownership and autonomyEntry-level Full TimeZurich1d ago
-
Mid-level Full TimeUnited Kingdom1d ago
-
AI Engineer GBP 70K-108KAPI Development | Agent Frameworks | Application Architecture | Code review | Deployment AutomationDiscounts and vouchers | Hybrid working | Learning and development support | Paid time for charity work | Parental leave policiesSenior-level Full TimeNewbury, England, United Kingdom1d ago
-
Data Engineer GBP 55KAlteryx | CI/CD | Continuous Improvement | Data Governance | Data ModelingBalanced lifestyle | Financial wellbeing support | Flexible working arrangements | Hybrid work | Personal wellbeing supportMid-level Full TimeGB-ENG-LAN-Preston1d ago
-
API Integration | Active Batch | Artificial Intelligence | Azure Active Batch | Azure DataHybrid working | Mentorship | Pair programming supportSenior-level Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Lead AI Engineer GBP 70K-100KAPIs | CI/CD | Computer Vision | DevOps | Distributed SystemsCompany pension scheme | Cycle to work scheme | Enhanced maternity and paternity cover | Group income protection | Healthcare cash planSenior-level Full TimeLondon, England, United Kingdom1d ago
-
AWS | Apache Spark | Cloud platform | Data Architecture | Data EngineeringCareer development | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom1d ago
-
Staff Applied Scientist GBP 110K-160KCloud Computing | Data Analysis | Deep learning | Explainable AI | GitFlexible remote work | Generous share options | Hybrid work | Mentoring & coachingSenior-level Full TimeLondon1d ago
-
AI Engineer GBP 100K-125KAPI Development | AWS | Apache Spark | CI/CD | DatabricksCustom designed offices | Enhanced parental leave | Enhanced pension | Free breakfasts and snacks | Life insuranceMid-level Full TimeLondon, England, United Kingdom1d ago
-
Data and AI Developer GBP 72K-108KAI Governance | AWS | Artificial Intelligence | Cloud Computing | Data EngineeringSenior-level Full TimeNottingham, Eng, United Kingdom1d ago
-
Android | C# | C++ | Caffe | Computer VisionSenior-level Full TimeFarnborough, United Kingdom1d ago
-
Mid-level Full TimeFarnborough, United Kingdom1d ago
-
Principal Software Engineer (AI/ML) GBP 54K-70KAPI Development | Agent planning | Agentic Workflows | Agile | ComplianceBonus scheme | Dental coverage | Employee networks | Employer pension contribution | Financial adviceSenior-level Full TimeGB - Luton - Cap. Green …1d ago
-
Data and AI Developer GBP 84K-119KAI Governance | AWS | Artificial Intelligence | Cloud infrastructure | Data GovernanceSenior-level Full TimeNottingham, England1d ago
-
Principal Software Engineer / Principal AI Engineer GBP 93K-150KAPI Integration | AWS | Agile | Azure | CI/CDComprehensive pension plan | Employee assistance program | Employee discounts | Flexible working hours | Generous vacationSenior-level Full TimeUK - London (London Wall), United …1d ago