Senior Data Engineer - Data Science Platform
London, England, United Kingdom
GBP 60K-70K (estimate) Senior-level Full Time
Tasks
- Build and maintain data platform components
- Collaborate with stakeholders on data requirements
- Design scalable data pipelines
- Develop reusable data engineering templates
- Enable production ready datasets
- Implement CI/CD for data pipelines
- Implement data quality validation testing observability metadata management
- Optimize pipeline performance reliability and cost
- Partner with platform engineering ML engineering and security teams
- Standardise data ingestion transformation and serving
Perks/Benefits
- Employee discount
- Employee sample sales
- Flexible benefits allowance
- Paid annual leave
- Personalized learning
- Private medical care
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CD | DBT | Data Factory | Data Lake Storage | Data Modeling | Data Quality | Data Testing | Databricks | Delta Lake | Metadata Management | Observability | PySpark | Python | Scala | Terraform
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeStoke-on-Trent, England, United Kingdom11h ago
-
AI Engineer GBP 45K-50KAI Search | Azure AI | Azure AI Search | Azure OpenAI | DatabricksAbility to purchase additional annual leave | Annual leave | Discretionary bonus scheme | Employee assistance program | Employee share purchase planMid-level Full TimeLondon, United Kingdom12h ago
-
Junior Data Engineer GBP 30K-34KCyber Security | Data Assurance | Data Engineering | Data Governance | Data IngestionEntry-level Full TimeManchester, Greater Manchester, United Kingdom13h ago
-
Agentic AI Engineer, AI Automation GBP 70K-89KAI Search | AWS | Agents SDK | Autogen | AzureAdditional paid time off | Employee resource groups | Flexible working hours | Hybrid work model | Modern Health App accessMid-level Full TimeLondon14h ago
-
Mid-level Full TimeCanary Wharf, 1 Churchill Place, United …21h ago
-
Defence Analytics Engineer GBP 40K-71KArtificial Intelligence | C Sharp | Data analytics | Machine Learning | PythonBonus scheme | Coursera access | Financial advice | Flexi days | Flexible benefitsNone Full TimeGB - London - Whitehall, United …21h ago
-
Defence Analytics Engineer GBP 40K-71KAerodynamics | C# | C++ | Computer Modeling | Guidance and controlBonus scheme | Dental coverage | Employee networks | Extra flexi days | Financial adviceEntry-level Full TimeGB - London - Whitehall, United …21h ago
-
Applied AI Engineer GBP 72K-93KAgentic Systems | CI/CD | Drift Detection | Embeddings | Inference PipelinesHybrid workSenior-level Full TimeLondon, United Kingdom21h ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Analytics GA4 | Azure | Cloud Computing | DashboardsHybrid workMid-level Full TimeUnited Kingdom R22h ago
-
Data Engineering Lead - Value & Analytics GBP 38K-46KAWS | Azure | Cloud Architecture | Cybersecurity | Data GovernanceHybrid workSenior-level Full TimeUnited Kingdom R22h ago
-
Software Engineer - Data Infrastructure GBP 45K-52KAWS | Amazon SQS | Batch Processing | BigQuery | Data IngestionMid-level Full TimeLondon1d ago
-
Compliance Governance Data Scientist GBP 53K-81KDashboarding | Data Modeling | Data Pipelines | GRC | Key Risk IndicatorsMid-level Full TimeLondon, United Kingdom1d ago
-
Algorithms | C plus plus | Data Structures | Java | Machine LearningExecutive-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
AWS | Agile | Apache Spark | Azure | BitbucketExecutive-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
API Management | Apache Spark | Azure API | Azure API Management | Azure DataSenior-level Contract Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Mid-level Full TimeTrimble Offices, Morley1d ago
-
AI Engineer GBP 70K-96KAccess Control | Azure | Azure AI | CI/CD | ClaudeCareer follow-up | Certification support | Continuous learning opportunities | Flexible schedule | Remote working policyMid-level Full TimeLondon, England, United Kingdom1d ago
-
Cloud Data Platform Software Engineer II GBP 72K-94KAWS Glue | Agile | Amazon Kinesis | Amazon Redshift | Apache BeamCareer growth opportunities | Diversity and inclusion culture | Learning opportunitiesEntry-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Engineer - Infra GBP 68K-85KApache Airflow | Apache Kafka | Apache Spark | ClickHouse | GrafanaSenior-level Full TimeLondon, England, GB1d ago
-
Mid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer (Crypto) 12mth FTC-1 GBP 53K-73KAWS EventBridge | AWS Glue | AWS Lambda | AWS Redshift | AWS Step FunctionsEmployee assistance program | Flexible benefits | Hybrid work | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R1d ago
-
Entry-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer GBP 39K-39KAmazon Redshift | Amazon Web Services | Apache Spark | CI/CD | Cloud platformEducation grant for private schooling | Flexible working arrangements | Free shuttle bus to work | Generous time off | Hybrid workingMid-level Full TimeHinxton, United Kingdom1d ago
-
DevOps Engineer GBP 80K-109KAWS | Ansible | CloudFormation | Containers | Continuous DeploymentBlameless postmortems | On-call rotationSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Engineer GBP 70K-80KAWS | Agile | CCPA | CI/CD | Cloud platformCharity involvement | Discretionary bonus schemes | Health and well-being support | Learning hub access | Sustainability initiativesSenior-level Full TimeLuton, GB, LU2 9TN1d ago