Staff Data Engineer
Tasks
- Build and operate batch pipelines for historical backfills and migrations
- Define data quality and governance standards and guardrails
- Define data standards contracts and APIs for data services
- Design and implement streaming pipelines for real time ingestion and transformation
- Design end to end data models and schemas
- Establish DataOps practices for CI CD observability and runbooks
- Implement and maintain end to end data lineage
- Lead data architecture and evolution for ingestion and transformation
- Own platform data services and ETL offerings
- Partner with product and engineering teams to expose data services
- Select and operate ETL ELT workflow orchestration tools
- Serve as technical escalation point for data flow lineage and governance
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Kafka | CI/CD | DBT | Dagster | Data Governance | Data Lineage | Data Modeling | Data Quality | DataOps | Docker | ELT | ETL | Infra-as-code | Kubernetes | Observability | PostgreSQL | Python | Ray | SQL | Spark | Temporal | “as-code”
Education
N/A
Roles
Related jobs
-
AES - DE - Generative AI Solution Architect GBP 80K-103KAWS | Agent evaluation | Anthropic | Azure | CI/CDSenior-level Full TimeLondon, United Kingdom3h ago
-
Senior Data Engineer GBP 60K-75KAirflow | Amazon Web Services | Apache Flink | Apache Spark | ArgoAnnual leave | Company socials | Development & training | Enhanced parental leave | Flexible workingSenior-level Full TimeLondon, England, United Kingdom15h ago
-
Senior-level Full TimeLondon, United Kingdom21h ago
-
Data Pipelines | Deep learning | Diffusion Models | Flow matching | Generative ModelsAnnual bonus | Equity Compensation Program | Health benefits | Stock optionsEntry-level ApprenticeshipLondon, England; Montréal, Quebec21h ago
-
Principal Full-Stack Engineer (Java,React,LLMs) GBP 72K-109KAI integration | APIs | AWS | Azure | CI/CDSenior-level Full TimeUnited Kingdom23h ago
-
API Development | Automated testing | CI/CD | Clinical Knowledgebases | ClinvarBlended working | Employee assistance programme | Eye Tests | Flexible working | Flu jabsMid-level Full TimeCambridge, England, United Kingdom23h ago
-
Senior Data Engineer GBP 80K-110KBigQuery | CI/CD | Cloud Functions | Cloud SQL | Cloud StorageFlexible work hours | Income protection insurance | Learning and development budget | Paid time off | Parental leaveSenior-level Full TimeLondon23h ago
-
AI Research Engineer GBP 120K-200KCUDA | Data Analysis | Deep learning | Machine Learning | PyTorchAsync communication | Autonomy | Meeting-free days | Remote workMid-level Full TimeHybrid (UK) R23h ago
-
Software Engineer III - Senior Data Engineer GBP 75K-89KApache Spark | Audit Logging | CI/CD | Data Modeling | Data QualitySenior-level Full TimeLONDON, United Kingdom1d ago
-
Mid-level Full TimeLondon1d ago
-
VP of Research, Machine Learning GBP 195K-280KAgent systems | Alignment | Deep learning | GPU Computing | GuardrailsExecutive-level Full TimeUnited Kingdom1d ago
-
Staff Machine Learning Engineer GBP 90K-120KBias Evaluation | Data Pipelines | Direct Preference Optimization | Fine Tuning | GPU OptimizationSenior-level Full TimeUnited Kingdom1d ago
-
Principal Machine Learning Engineer GBP 90K-130KBias Evaluation | DPO | Deep learning | DeepSpeed | DistillationSenior-level Full TimeUnited Kingdom1d ago
-
Technical Lead, Machine Learning GBP 100K-135KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeUnited Kingdom1d ago
-
Ruby on Rails Developer (AI Focused) USA GBP 70K-90KAPI Integration | Anthropic | Azure | CI/CD | Distributed SystemsIndependent contract environment | Remote workSenior-level ContractCambourne, United Kingdom of Great Britain …1d ago
-
Mid-level Full TimeUnited Kingdom1d ago
-
Senior Machine Learning Engineer GBP 90K-120KData Pipelines | Debugging | Deep learning | GPU Computing | InferenceSenior-level Full TimeUnited Kingdom1d ago
-
Member of Technical Staff, Machine Learning GBP 90K-115KData Pipelines | Deep learning | Fine Tuning | GPU Computing | InferenceSenior-level Full TimeUnited Kingdom1d ago
-
Full Stack Engineer, AI systems GBP 80K-120KAPI Design | Anthropic API | Docker | GraphQL | KubernetesSenior-level Full TimeUnited Kingdom1d ago
-
Backend Engineer, AI (Agent Systems) GBP 110K-170KAlerting | Anthropic | Batching | Caching | DockerSenior-level Full TimeUnited Kingdom1d ago
-
Senior-level Full TimeUnited Kingdom1d ago
-
Senior Analytics Engineer GBP 76K-95KBigQuery | Data Governance | Data Modeling | Data Quality | Data WarehousingFlexible working hours | Learning budget | Relocation assistance | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R1d ago
-
AI Developer GBP 97K-120KC++ | CrewAI | Elixir | Langchain | Language ModelsFully remote | Globally distributed teamMid-level Full TimeAustria; United Kingdom; India; Portugal; Romania; … R1d ago
-
Senior AI Engineer (f/m/d) GBP 70K-100KAPI Design | AWS | Architecture | Azure | CI/CDFlexi-Week | Health insurance | Hybrid remote work | Meal vouchers | Paid special leavesSenior-level Full TimeAmsterdam, North Holland, Netherlands; Berlin, Berlin, …1d ago
-
Senior AI Engineer (f/m/d) GBP 70K-100KAWS | Azure | By Design | CI/CD | Continuous DeploymentFlexi-Week | Health & wellbeing insurance | Meal vouchers | Paid special leaves | Peer to peer appreciation vouchersSenior-level Full TimeAmsterdam, North Holland, Netherlands; Berlin, Berlin, …1d ago