Software Engineer III - Senior Data Engineer
Tasks
- Architect end to end data engineering solutions
- Build data products with data mesh principles
- Create curated data layers and models
- Develop and optimize batch pipelines
- Develop and optimize streaming pipelines
- Establish engineering standards code quality and testing
- Implement CI CD and release governance
- Implement data observability
- Implement data quality checks
- Optimize partitioning file sizing and clustering
- Optimize queries
- Partner to ensure compliance with security and governance policies
- Provide technical leadership mentoring and architecture reviews
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Audit Logging | CI/CD | Data Modeling | Data Quality | Data Retention | Data mesh | Databricks | Delta Lake | Encryption | Git | Integration Testing | Observability | Python | RBAC | SQL | Unit Testing
Education
N/A
Roles
Related jobs
-
AES - DE - Generative AI Solution Architect GBP 80K-103KAWS | Agent evaluation | Anthropic | Azure | CI/CDSenior-level Full TimeLondon, United Kingdom3h ago
-
Senior Data Engineer GBP 60K-75KAirflow | Amazon Web Services | Apache Flink | Apache Spark | ArgoAnnual leave | Company socials | Development & training | Enhanced parental leave | Flexible workingSenior-level Full TimeLondon, England, United Kingdom15h ago
-
Senior-level Full TimeLondon, United Kingdom21h ago
-
Data Pipelines | Deep learning | Diffusion Models | Flow matching | Generative ModelsAnnual bonus | Equity Compensation Program | Health benefits | Stock optionsEntry-level ApprenticeshipLondon, England; Montréal, Quebec21h ago
-
Principal Full-Stack Engineer (Java,React,LLMs) GBP 72K-109KAI integration | APIs | AWS | Azure | CI/CDSenior-level Full TimeUnited Kingdom23h ago
-
API Development | Automated testing | CI/CD | Clinical Knowledgebases | ClinvarBlended working | Employee assistance programme | Eye Tests | Flexible working | Flu jabsMid-level Full TimeCambridge, England, United Kingdom23h ago
-
Senior Data Engineer GBP 80K-110KBigQuery | CI/CD | Cloud Functions | Cloud SQL | Cloud StorageFlexible work hours | Income protection insurance | Learning and development budget | Paid time off | Parental leaveSenior-level Full TimeLondon23h ago
-
AI Research Engineer GBP 120K-200KCUDA | Data Analysis | Deep learning | Machine Learning | PyTorchAsync communication | Autonomy | Meeting-free days | Remote workMid-level Full TimeHybrid (UK) R23h ago
-
Mid-level Full TimeLondon1d ago
-
VP of Research, Machine Learning GBP 195K-280KAgent systems | Alignment | Deep learning | GPU Computing | GuardrailsExecutive-level Full TimeUnited Kingdom1d ago
-
Staff Machine Learning Engineer GBP 90K-120KBias Evaluation | Data Pipelines | Direct Preference Optimization | Fine Tuning | GPU OptimizationSenior-level Full TimeUnited Kingdom1d ago
-
Technical Lead, Machine Learning GBP 100K-135KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeUnited Kingdom1d ago
-
Ruby on Rails Developer (AI Focused) USA GBP 70K-90KAPI Integration | Anthropic | Azure | CI/CD | Distributed SystemsIndependent contract environment | Remote workSenior-level ContractCambourne, United Kingdom of Great Britain …1d ago
-
Mid-level Full TimeUnited Kingdom1d ago
-
Senior Machine Learning Engineer GBP 90K-120KData Pipelines | Debugging | Deep learning | GPU Computing | InferenceSenior-level Full TimeUnited Kingdom1d ago
-
Member of Technical Staff, Machine Learning GBP 90K-115KData Pipelines | Deep learning | Fine Tuning | GPU Computing | InferenceSenior-level Full TimeUnited Kingdom1d ago
-
Full Stack Engineer, AI systems GBP 80K-120KAPI Design | Anthropic API | Docker | GraphQL | KubernetesSenior-level Full TimeUnited Kingdom1d ago
-
Backend Engineer, AI (Agent Systems) GBP 110K-170KAlerting | Anthropic | Batching | Caching | DockerSenior-level Full TimeUnited Kingdom1d ago
-
Senior-level Full TimeUnited Kingdom1d ago
-
Senior Analytics Engineer GBP 76K-95KBigQuery | Data Governance | Data Modeling | Data Quality | Data WarehousingFlexible working hours | Learning budget | Relocation assistance | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R1d ago
-
AI Developer GBP 97K-120KC++ | CrewAI | Elixir | Langchain | Language ModelsFully remote | Globally distributed teamMid-level Full TimeAustria; United Kingdom; India; Portugal; Romania; … R1d ago
-
Senior AI Engineer (f/m/d) GBP 70K-100KAPI Design | AWS | Architecture | Azure | CI/CDFlexi-Week | Health insurance | Hybrid remote work | Meal vouchers | Paid special leavesSenior-level Full TimeAmsterdam, North Holland, Netherlands; Berlin, Berlin, …1d ago
-
Senior AI Engineer (f/m/d) GBP 70K-100KAWS | Azure | By Design | CI/CD | Continuous DeploymentFlexi-Week | Health & wellbeing insurance | Meal vouchers | Paid special leaves | Peer to peer appreciation vouchersSenior-level Full TimeAmsterdam, North Holland, Netherlands; Berlin, Berlin, …1d ago
-
Senior AI Engineer (f/m/d) GBP 90K-109KA/B | A/B Testing | API Design | API Gateway | AWSFlexible work hours | Four-day work week | Health insurance | Hybrid/remote work options | Meal vouchersSenior-level Full TimeAmsterdam, North Holland, Netherlands; Berlin, Berlin, …1d ago
-
Research Engineer, Frontier Safety Mitigations, DeepMind GBP 225K-300KAI Coding Agents | AI coding | Adversarial Machine Learning | Anomaly Detection | Coding AgentsMid-level Full TimeLondon, UK1d ago