Senior Data Engineer - Data Science Platform
London, England, United Kingdom
GBP 60K-70K (estimate) Senior-level Full Time
Tasks
- Build and maintain data platform components
- Collaborate with stakeholders on data requirements
- Design scalable data pipelines
- Develop reusable data engineering templates
- Enable production ready datasets
- Implement CI/CD for data pipelines
- Implement data quality validation testing observability metadata management
- Optimize pipeline performance reliability and cost
- Partner with platform engineering ML engineering and security teams
- Standardise data ingestion transformation and serving
Perks/Benefits
- Employee discount
- Employee sample sales
- Flexible benefits allowance
- Paid annual leave
- Personalized learning
- Private medical care
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CD | DBT | Data Factory | Data Lake Storage | Data Modeling | Data Quality | Data Testing | Databricks | Delta Lake | Metadata Management | Observability | PySpark | Python | Scala | Terraform
Education
N/A
Roles
Related jobs
-
Accuracy Checking | Alerting | Automation | Cause analysis | Completeness CheckingSenior-level Full TimeLondon4h ago
-
Senior Data Engineer GBP 60K-70KAPI Integration | CI/CD | Cloud Computing | Data Quality | Data ValidationSenior-level Full TimeLondon4h ago
-
MLOps Engineer GBP 55K-55KCI/CD | Cloud Native | Data Governance | GitLab | GrafanaFlexible working arrangements | Hybrid workingMid-level Full TimeGB-ENG-LAN-Preston4h ago
-
Machine Learning Engineer GBP 26K-28KAlerting | Algorithms | Apache Spark | Azure | Cloud ComputingAdoption leave | Annual bonus scheme | Employee assistance programme | Employee wellbeing support | Free 247 virtual GP serviceMid-level Full TimeWelwyn Garden City, United Kingdom of …4h ago
-
Mid-level Full TimeLondon, England, GB6h ago
-
Staff MLOps Engineer (AI/ML Platform) GBP 70K-99KAWS EKS | Apache Spark | Data Drift | Databricks | Experiment trackingSenior-level Full TimeRemote, Remote, United Kingdom R13h ago
-
Power BI Developer GBP 51K-65KALM Toolkit | Active Directory | Azure Active Directory | DAX | DAX StudioFlexible working hours | Hybrid work | Work-life balanceSenior-level Full TimeGBR-Abingdon-Culham (057GB), United Kingdom16h ago
-
Senior Data Analytics Engineer GBP 70K-89KBusiness Intelligence | CI/CD | DBT | Data Documentation | Data ObservabilityCollaborative team | Documentation focused culture | Remote-friendly environmentSenior-level Full TimeRemote - United Kingdom R19h ago
-
Senior Machine Learning Engineer GBP 55K-55KAWS | Azure Machine Learning | Clustering | Databricks | Decision TreesHybrid working | Opportunities to lead coaching and mentoringSenior-level Full TimeManchester, Greater Manchester, United Kingdom1d ago
-
Legal Prompt Engineer GBP 50K-70KContract Law | Document Automation | LLM Testing | Language Models | Large Language ModelsMid-level Full TimeHybrid (SW1W 9SH, London, Greater London, … R1d ago
-
Senior AI Engineer GBP 72K-91KAKS | Azure AI | CI/CD | Containerization | GenAIOpsElectric car scheme | Employee discounts | Family leave | Flexible working options | Healthcare planSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior AI Engineer GBP 72K-91KAKS | Azure AI | CI/CD | Containerization | GenAIOpsDiscounts | Electric car scheme | Family leave | Flexible working options | Generous pension contributionSenior-level Full TimeCardiff, Wales, United Kingdom1d ago
-
Senior AI Engineer GBP 72K-91KAI Services | AKS | Azure AI | Azure AI Services | CI/CDElectric car scheme | Employee discounts | Family leave | Flexible working | Healthcare planSenior-level Full TimeBrighton and Hove, England, United Kingdom1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
AI Engineer GBP 72K-93KAI Services | AKS | API | Azure | Azure AIElectric car scheme | Employee discounts | Family leave | Healthcare plan | Life assuranceSenior-level Full TimeCardiff, Wales, United Kingdom1d ago
-
AI Engineer GBP 72K-93KAI Services | AKS | Azure | Azure AI | Azure AI ServicesElectric car scheme | Employee discounts | Family leave | Healthcare plan | Life assuranceSenior-level Full TimeBrighton and Hove, England, United Kingdom1d ago
-
AI Engineer GBP 72K-93KAI Services | AKS | APIs | Agile | AzureFlexible working | Health insurance | Life insurance | Paid time off | Pension contributionSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Machine Learning Engineer GBP 72K-90KAI Foundry | Azure AI | Azure AI Foundry | Azure ML | Batch inferenceHybrid workingSenior-level Full TimeNewbury, England, United Kingdom1d ago
-
Senior Data Engineer GBP 60K-70KAPI Integration | Azure Data | Azure Data Lake | Azure DevOps | Azure Machine LearningHybrid work | Mentorship | Travel for office workSenior-level Full TimeBirmingham, West Midlands, United Kingdom1d ago
-
C plus plus | C# | Cloud Computing | Cloud platform | Data ProcessingSenior-level Full TimeLondon, UK1d ago
-
Machine Learning DSP Engineer GBP 50K-70KAudio Processing | C# | C++ | Digital Signal | Digital Signal ProcessingRelocation support | Visa sponsorshipSenior-level Full TimeMilton Keynes, United Kingdom1d ago
-
Data Engineer - Intermediate Level GBP 42K-50KAWS | Agile | Apache Flink | Apache Storm | AzureAgile environment | Hybrid work | Team cultureMid-level Full TimeLondon, United Kingdom1d ago
-
Mid-level Contract Full TimeNottingham, GB1d ago
-
Staff Applied Scientist GBP 225K-325KAI systems | Cloud deployment | Complex Planning | Deep learning | Explainable AIFlexible collaboration with Slack and Zoom | Hybrid work | Mentoring and coachingSenior-level Full TimeLondon1d ago
-
Data Engineer GBP 45K-50KApache Beam | BigQuery | CI/CD | Cloud Dataflow | Cloud FunctionsEmployee referral bonus | Hybrid work | Profit share bonus | Share purchase plan | Uncapped leaveSenior-level Full TimeBath, England, United Kingdom1d ago