Staff Data Engineer
Tasks
- Build and operate batch pipelines for historical backfills and migrations
- Define data quality and governance standards and guardrails
- Define data standards contracts and APIs for data services
- Design and implement streaming pipelines for real time ingestion and transformation
- Design end to end data models and schemas
- Establish DataOps practices for CI CD observability and runbooks
- Implement and maintain end to end data lineage
- Lead data architecture and evolution for ingestion and transformation
- Own platform data services and ETL offerings
- Partner with product and engineering teams to expose data services
- Select and operate ETL ELT workflow orchestration tools
- Serve as technical escalation point for data flow lineage and governance
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Kafka | CI/CD | DBT | Dagster | Data Governance | Data Lineage | Data Modeling | Data Quality | DataOps | Docker | ELT | ETL | Infra-as-code | Kubernetes | Observability | PostgreSQL | Python | Ray | SQL | Spark | Temporal | “as-code”
Education
N/A
Roles
Related jobs
-
MLOps Engineer GBP 48KCI/CD | Data Governance | GitLab CI | GitLab CI/CD | GrafanaBalanced lifestyle | Flexible working arrangements | Hybrid working | Inclusive workplace | Lifelong learningSenior-level Full TimeGB-ENG-LAN-Preston5h ago
-
Software Engineer III - Applied AI GBP 81K-97KAWS | Data Preprocessing | Feature Engineering | Generative AI | Language ModelsSenior-level Full TimeLONDON, LONDON, United Kingdom7h ago
-
Data Engineer GBP 55K-60KAWS | Agile | Azure Data | Azure Data Factory | Azure DatabricksHybrid working | Professional developmentMid-level Full TimeLONDON, LONDON, United Kingdom8h ago
-
NumPy | Pandas | Python | SciPy | Scikit-learnFlexible schedule | Freelance project-based work | Part-time work | Remote workSenior-level FreelanceUnited Kingdom - Remote R18h ago
-
Senior-level Full TimeLondon - Shell Centre, United Kingdom18h ago
-
Data Engineer GBP 45K-68KAgile | Amazon SageMaker | Apache Spark | Azure Machine Learning | CI/CDCo working and collaboration spaces | Flexible working arrangements | Mental health support | Parenting leave | Positive work cultureEntry-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Applied Scientist GBP 230K-340KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningHybrid work schedule | Mentoring and coachingSenior-level Full TimeLondon1d ago
-
Member of Technical Staff - Infrastructure Supercompute GBP 240K-325KAnsible | Containerization | Infrastructure as Code | Kubernetes | PulumiSenior-level Full TimeLondon, UK2d ago
-
Member of Technical Staff - Hardcore Supercompute GBP 240K-325KAnsible | Containers | Debugging | Distributed Systems | DockerSenior-level Full TimeLondon, UK2d ago
-
Mid-level Full TimeWorsley3d ago
-
AWS IAM | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon EC2Senior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom3d ago
-
Agents | Agile | Application development | CI/CD | CloudSenior-level Full TimeLONDON, United Kingdom3d ago
-
Agents | Agile | CI/CD | Cloud | Continuous DeliverySenior-level Full TimeLONDON, United Kingdom3d ago
-
Architecture | Big Data | Continuous integration | Data Pipelines | Distributed SystemsSenior-level Full TimeLondon3d ago
-
Analytics Engineer GBP 60K-72KAWS | Amazon QuickSight | Amazon Redshift | Apache Airflow | CI/CDCompany events | Employee resource groups | Extended parental leave | Health coverage | Learning pathsSenior-level Full TimeLiverpool, United Kingdom R3d ago
-
AI Engineer GBP 125K-165KAWS | Agent Frameworks | Amazon Bedrock | Anthropic Claude | AzureEquity | Learning and development stipend | WFH equipment allowance | Wellbeing benefitMid-level Full TimeCopenhagen, DK; London, UK3d ago
-
Junior Analytics Engineer GBP 30K-35KDBT | Data Modeling | Data Pipelines | Data Quality | LLMInclusive workplace | Private health insurance | Work from home Mondays and FridaysEntry-level Full TimeLondon, United Kingdom3d ago
-
Senior-level Full TimeManchester3d ago
-
Behavior Analysis | C++ | Causal Inference | Causal Learning | Data AnalysisSenior-level Full TimeLondon, UK3d ago
-
Data Engineer (Python, SQL, Microsoft Fabric) GBP 40K-50KETL | Microsoft Fabric | Python | SQLAnnual leave | Hybrid work flexibility | Pension | Personal development opportunities | Private healthcareMid-level Full TimeChester, England and Wales, United Kingdom3d ago
-
Machine Learning Engineer GBP 70K-85KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingMid-level Full TimeLondon3d ago
-
AI systems | Agent systems | Agentic Workflows | Autonomous AI | Autonomous AI systemsRemote-friendly culture | Work-life balanceSenior-level Full TimeUnited Kingdom, REMOTE, United Kingdom R3d ago
-
Analytics Engineer (Mid-level) GBP 50K-65KAI/ML | AI/ML workflows | Apache Spark | Azure | Azure DataHybrid working | Permanent contractMid-level Full TimeLondon Hybrid R3d ago
-
Staff Applied Scientist GBP 230K-340KBlack | Cloud Computing | Deep learning | Git | GitHubHybrid work schedule | Stock options | Team collaboration daysSenior-level Full TimeLondon3d ago
-
AWS | BigQuery | CI/CD | Cypress | Docker25 days holiday | Choice of laptop | Commuter support | Company socials | Cycle to work schemeSenior-level Full TimeLondon3d ago