Principal Data Engineer
London, England, United Kingdom
GBP 80K-110K (estimate) Senior-level Full Time
Tasks
- Build and evolve ingestion frameworks event bus and lakehouse
- Coach engineers and improve hiring process
- Create technical documentation for self serve data access
- Define data quality schema evolution and contract testing standards
- Design data services for scale and operational excellence
- Design entity relationship and event ingestion normalization and merging
- Design petabyte scale batch micro batch and streaming pipelines
- Develop and review production Python code
- Drive cloud data infrastructure and containerized deployment standards
- Implement event sourced streaming patterns with Kafka
- Integrate data platform with services via APIs and event streams
- Lead Data platform architecture
- Own data lineage quality freshness and observability
- Partner with ML engineers for feature engineering and inference pipelines
- Set medium to long term technical direction for data infrastructure
- Support logging monitoring alerting and incident management for data systems
Perks/Benefits
- Annual learning budget
- Enhanced parental leave and childcare benefits
- Equity participation
- Home office budget
- Hybrid work policy
- Life insurance
- Medical coverage
- Pension contribution
- Unlimited time off
Skills/Tech-stack
AWS | Airflow | Alerting | Argo Workflows | ArgoCD | Contract testing | DBT | Data Engineering | Data Lineage | Data Observability | Data Quality | Docker | ELT | ETL | Event Sourcing | Flink | GCP | GRPC | Grafana Cloud | Kafka | Kotlin | Kubernetes | Lakehouse | Logging | Monitoring | PostgreSQL | Python | Schema evolution | Spark | TypeScript | Yugabyte
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Embedded system Test Engineer GBP 45K-50KAgile | Analog I/O | Analog electronics | Analog to Digital | Analog to digital I OMid-level Full TimeGlasgow, Lanarkshire, United Kingdom11h ago
-
Staff Machine Learning Engineer (Platform) - Australia based - Full Relocation Provided GBP 97K-120KAWS | Azure | CUDA | CUDA kernels | Data PipelinesCompetitive salary | ESOP | Flexible work environment | Office events | Relocation assistanceSenior-level Full TimeLondon16h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial environment | Remote-friendly, distributed teamMid-level Full TimeOxford, United Kingdom17h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed work environment | Supportive teamMid-level Full TimeBelfast, United Kingdom17h ago
-
Data Engineer | London, UK GBP 50K-55KApache Spark | Batch Processing | Cause analysis | Data Analysis | Data LakeMid-level Full TimeUnited Kingdom20h ago
-
Senior-level Full TimeKnutsford, Radbroke Hall, United Kingdom21h ago
-
Senior Data Scientist - ST&S GBP 72K-112KAI Agents | APIs | AWS | Autogen | AutomationFlexible working options | Hybrid work | Paid parental leave | Paid travel up to 10 percent | Retirement benefitsSenior-level Full TimeGB: London - 25 North Colonnade, …21h ago
-
Machine Learning Engineer GBP 25K-25KAzure | Azure DevOps | CI/CD | Containerization | DatabricksFlexible working | Healthcare coverage | Learning and development support | Professional development | Retirement plansMid-level Full TimeYork, United Kingdom21h ago
-
Automated testing | CI/CD | Data Analysis | Functional Programming | Machine LearningMid-level Full TimeCanary Wharf, 1 Churchill Place, United …21h ago
-
Machine Learning Quality Engineer GBP 78K-109KEvaluation Frameworks | Integration Testing | LLM | Python | RAGHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeGBR-London-10 Paternoster Square, United Kingdom21h ago
-
Lead ML Engineer GBP 84K-126KAPI Security | Agent Frameworks | Containerization | FastAPI | KubernetesPaid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeGBR-London-5 Canada Square, United Kingdom21h ago
-
Senior ML Engineer GBP 84K-119KContainerization | FastAPI | Kubernetes | LLM | Model Context ProtocolHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeGBR-London-5 Canada Square, United Kingdom21h ago
-
Lead Specialist Solution Engineer - Tableau GBP 72K-95KAmazon SageMaker | Application Integration | Artificial Intelligence | Azure Machine Learning | Business IntelligenceSenior-level Full TimeUnited Kingdom - London21h ago
-
Senior Data Engineer GBP 70K-90KAPI Integration | AWS | Airflow | Azure | Cloud platformCompany lunches | Company outings | Continuing education | Flexible PTO | Health and dental benefitsSenior-level Full TimeLondon1d ago
-
Forward Deployed Solution Engineer – Applied AI FDE GBP 80K-110KAWS | Angular | Azure | CI/CD | ContainersFlexible work options | Remote or required in officeSenior-level Full TimeLondon, United Kingdom1d ago
-
Applied AI Engineer GBP 40K-80KAI Agents | API Integration | Docker | Embeddings | JavaScriptCareer development opportunities | High-growth startup | International expansion environment | Ownership and autonomyEntry-level Full TimeZurich1d ago
-
Mid-level Full TimeUnited Kingdom1d ago
-
AI Engineer GBP 70K-108KAPI Development | Agent Frameworks | Application Architecture | Code review | Deployment AutomationDiscounts and vouchers | Hybrid working | Learning and development support | Paid time for charity work | Parental leave policiesSenior-level Full TimeNewbury, England, United Kingdom1d ago
-
Data Engineer GBP 55KAlteryx | CI/CD | Continuous Improvement | Data Governance | Data ModelingBalanced lifestyle | Financial wellbeing support | Flexible working arrangements | Hybrid work | Personal wellbeing supportMid-level Full TimeGB-ENG-LAN-Preston1d ago
-
API Integration | Active Batch | Artificial Intelligence | Azure Active Batch | Azure DataHybrid working | Mentorship | Pair programming supportSenior-level Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Lead AI Engineer GBP 70K-100KAPIs | CI/CD | Computer Vision | DevOps | Distributed SystemsCompany pension scheme | Cycle to work scheme | Enhanced maternity and paternity cover | Group income protection | Healthcare cash planSenior-level Full TimeLondon, England, United Kingdom1d ago
-
AWS | Apache Spark | Cloud platform | Data Architecture | Data EngineeringCareer development | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom1d ago
-
Staff Applied Scientist GBP 110K-160KCloud Computing | Data Analysis | Deep learning | Explainable AI | GitFlexible remote work | Generous share options | Hybrid work | Mentoring & coachingSenior-level Full TimeLondon1d ago
-
AI Engineer GBP 100K-125KAPI Development | AWS | Apache Spark | CI/CD | DatabricksCustom designed offices | Enhanced parental leave | Enhanced pension | Free breakfasts and snacks | Life insuranceMid-level Full TimeLondon, England, United Kingdom1d ago
-
Data and AI Developer GBP 72K-108KAI Governance | AWS | Artificial Intelligence | Cloud Computing | Data EngineeringSenior-level Full TimeNottingham, Eng, United Kingdom1d ago