Principal Data Engineer
London, England, United Kingdom
GBP 80K-110K (estimate) Senior-level Full Time
Tasks
- Build and evolve ingestion frameworks event bus and lakehouse
- Coach engineers and improve hiring process
- Create technical documentation for self serve data access
- Define data quality schema evolution and contract testing standards
- Design data services for scale and operational excellence
- Design entity relationship and event ingestion normalization and merging
- Design petabyte scale batch micro batch and streaming pipelines
- Develop and review production Python code
- Drive cloud data infrastructure and containerized deployment standards
- Implement event sourced streaming patterns with Kafka
- Integrate data platform with services via APIs and event streams
- Lead Data platform architecture
- Own data lineage quality freshness and observability
- Partner with ML engineers for feature engineering and inference pipelines
- Set medium to long term technical direction for data infrastructure
- Support logging monitoring alerting and incident management for data systems
Perks/Benefits
- Annual learning budget
- Enhanced parental leave and childcare benefits
- Equity participation
- Home office budget
- Hybrid work policy
- Life insurance
- Medical coverage
- Pension contribution
- Unlimited time off
Skills/Tech-stack
AWS | Airflow | Alerting | Argo Workflows | ArgoCD | Contract testing | DBT | Data Engineering | Data Lineage | Data Observability | Data Quality | Docker | ELT | ETL | Event Sourcing | Flink | GCP | GRPC | Grafana Cloud | Kafka | Kotlin | Kubernetes | Lakehouse | Logging | Monitoring | PostgreSQL | Python | Schema evolution | Spark | TypeScript | Yugabyte
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Machine Learning Systems Engineer, Ads ML Platform GBP 74K-100KApache Airflow | Apache Flink | Apache Spark | Google BigQuery | KafkaBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group Personal Pension SchemeSenior-level Full TimeRemote - United Kingdom R11h ago
-
Senior-level Full TimeManchester, United Kingdom15h ago
-
GenAI Platform Lead GBP 84K-120KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional developmentSenior-level Full TimeSheffield, United Kingdom R19h ago
-
AI Cloud | AI SDK | API Design | API Gateway | AWSClient facing technical leadership | Hybrid working environment | Meritocratic culture | Professional developmentSenior-level Full TimeLondon19h ago
-
MLOps Engineer (LLM/GenAI) GBP 27K-27KAWS | Accelerate | Azure | Batching | CUDAContributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations supportEntry-level Full TimeSheffield, United Kingdom R19h ago
-
Senior Machine Learning Engineer GBP 75K-98KAWS | Azure | Cloud Architecture | Docker | Google CloudCoaching | Dental insurance | Enhanced parental leave | Family-friendly flexibility | Flexible workingSenior-level Full TimeUK - London22h ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Agile | Analytics | Azure | Cloud platformHybrid work environmentMid-level Full TimeUnited Kingdom R22h ago
-
Data Analyst - Content GBP 50K-60KBI Dashboards | BigQuery | DBT | Data Modeling | Data QualityCycle to work scheme | Enhanced parental leave | Equity options | Flexible working arrangements | Group life assuranceMid-level Full TimeLondon1d ago
-
Platform Data Engineer - Cardiff GBP 55K-70KAWS | AWS Glue | Airflow | ArgoCD | BigQueryAnnual leave | Dental coverage | Flexible working | Private medical insurance | Private pensionMid-level Full TimeCardiff, Wales, UK1d ago
-
Lead Software Engineer - Cloud/Java-Python/AI-ML GBP 84K-115KAWS | Apache Iceberg | Artificial Intelligence | Automated testing | AzureSenior-level Full TimeBOURNEMOUTH, DORSET, United Kingdom1d ago
-
Senior Specialist Solutions Engineer (AI/ML) GBP 74K-112KAWS | Apache Spark | Artificial Intelligence | Azure | Distributed ComputingHybrid work | Industry conference opportunities | Mentorship | Training support | Travel 30 percentSenior-level Full TimeLondon, United Kingdom1d ago
-
AWS | Application development | Artificial Intelligence | Automated testing | AutomationSenior-level Full TimeLONDON, United Kingdom1d ago
-
Sr. Lead Data Engineer GBP 72K-84KAWS | Anomaly Detection | Automation | BigQuery | Change ManagementSenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Senior Data Engineer - Agents Systems GBP 97K-136KApache Flink | Data Contracts | Data Processing | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom1d ago
-
Senior Data Engineer - AI Infrastructure GBP 101K-136KApache Flink | Data Contracts | Data Pipelines | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom1d ago
-
AI Engineer - Global Strategy Consultant GBP 100K-125KAPIs | Access Control | Agent Orchestration | Anomaly Detection | AuthenticationMid-level Full TimeLondon, 20 Farringdon Road, United Kingdom1d ago
-
Biosensor Algorithm Engineer GBP 24K-24KAnomaly Detection | Classification | Embedded Systems | Git | Machine LearningMid-level Full TimeUnited Kingdom, Cambridge1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
AWS | Apache Flink | Apache Iceberg | Apache Spark | CassandraEmployee networks | Paid adoption leave | Paid parental leave | Professional development opportunities | Remote team collaborationSenior-level Full TimeLondon (Haggerston), United Kingdom R1d ago
-
Executive-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer (Mid‑Level ), Global GBP 70K-90KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlexible work schedule | Health insurance | Paid time off | Retirement benefits | Training and developmentSenior-level Full TimeFAR11, United Kingdom1d ago
-
Data Scientist GBP 78K-109KData Privacy | Docker | Fine Tuning | Git | Hugging FaceHybrid working | Interview support for disabilities | Mental health support | Training and development | Wellbeing appsMid-level Full TimeBelfast, GB1d ago
-
Senior MLOps Engineer GBP 80K-110KCI/CD | Cloud infrastructure | DeepSpeed | Distributed Computing | Distributed TrainingHybrid workSenior-level Full TimeLondon, UK, United Kingdom, Aberdeen City1d ago
-
Lead AI/ML Engineer GBP 90K-126KAPI Development | Agentic Systems | CI/CD | Cloud Native | Deep learningCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
Machine learning Engineer GBP 84K-115KAWS | Azure | Cloud Security | Docker | Google CloudCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago