Senior Data Engineer - Data Science Platform
London, England, United Kingdom
GBP 60K-70K (estimate) Senior-level Full Time
Tasks
- Add observability and metadata management
- Build data platform components
- Collaborate with stakeholders on data requirements
- Design scalable data pipelines
- Ensure secure scalable data infrastructure on Azure
- Implement CI/CD for data pipelines
- Maintain reusable data engineering templates
- Optimize performance and cost of data workflows
- Standardize data ingestion transformation serving
- Validate data quality and test pipelines
Perks/Benefits
- Employee discount
- Employee sample sales
- Flexible benefits allowance
- Flexible work rhythm
- Paid annual leave
- Personalised learning
- Private medical care
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CD | DBT | Data Factory | Data Lake Storage | Data Modeling | Data Pipelines | Data Quality | Databricks | Delta Lake | Infrastructure as Code | Metadata Management | Monitoring | Observability | PySpark | Python | Scala | Terraform | Testing | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Compute Platform Engineer GBP 100K-112KAmazon Athena | Amazon EC2 | Amazon S3 | Apache Airflow | Apache HadoopCode reviews | Knowledge sharing | MentoringSenior-level Full TimeLondon, England, United Kingdom14h ago
-
SAS Data Engineering Consultant GBP 67K-80KAWS | Agile | Alteryx | Apache Spark | Azure25 days holiday | Cycle to work scheme | Employee assistance programme | Holiday buy/sell option | Life coverMid-level Full TimeUnited Kingdom, Any Region , United …16h ago
-
Senior Machine Learning Manager, Borrowing GBP 138K-176KAI | AI Platform | AWS | BigQuery | Cloud platformFlexible working hours | Learning budget | Relocation support | Remote work | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R17h ago
-
Infrastructure and MLOps Engineer GBP 91K-110KAWS | CI/CD | Distributed Systems | Docker | GitHub ActionsDental plan | Employee assistance programme | Flexible working | Generous annual leave | Generous parental leaveMid-level Full TimeLondon, UK17h ago
-
Infrastructure and MLOps Engineer GBP 91K-110KAWS | CI/CD | Docker | GitHub Actions | GrafanaAnnual leave | Dental plan | Employee assistance programme | Flexible working | Health cash planMid-level Full TimeCambridge, UK17h ago
-
Staff ML Performance Engineer (Inference Optimisation) GBP 132K-162KBenchmarking | C++ | CUDA | Debugging | OpenCLHybrid work | Work from home optionSenior-level Full TimeLondon18h ago
-
Staff MLOps Engineer (AI/ML Platform) GBP 90K-115KAWS | AWS EKS | Apache Spark | Batch Processing | DatabricksRemote work optionsSenior-level Full TimeRemote, Remote, United Kingdom R19h ago
-
Analytics Engineer GBP 57K-75KBig Data | BigQuery | Business Intelligence | Cloud Cost Optimization | Cost OptimizationFlexible working hours | Learning budget | MacBooks provided | Visa sponsorship | Work from home supportEntry-level Full TimeCardiff, London or Remote (UK) R21h ago
-
Senior AI Engineer (AI Platform) GBP 72K-90KAPI Management | APIs | Active Directory | Alerting | Automated testingDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom21h ago
-
Staff Analytics Engineer GBP 121K-121KBatch Processing | BigQuery | CI/CD | DBT | Data ArchitectureDistributed working options | Flexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R22h ago
-
Algorithms | Automated testing | Benchmarking | C++ | Cloud ComputingCollaborative team | Hybrid work environment | MentorshipSenior-level Full TimeOXFORDSHIRE, United Kingdom22h ago
-
AI Engineer GBP 58K-90KAWS | Azure | CI/CD | Databricks | DockerBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountMid-level Full TimeLondon, Birmingham, Manchester, Newcastle upon Tyne, …23h ago
-
Staff Applied Scientist GBP 110K-160KBlack | Cloud Computing | Complex Planning | Deep learning | Explainable AIHybrid work | Mentoring and coachingSenior-level Full TimeLondon1d ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 74K-100KApache Airflow | Apache Flink | Apache Spark | Google BigQuery | KafkaBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group Personal Pension SchemeSenior-level Full TimeRemote - United Kingdom R1d ago
-
Mid-level Full TimeCambridge1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
Senior Quantitative Software Engineer GBP 72K-94KC++ | Data Analysis | Functional Programming | Java | Operational RiskEmployee benefits | Flexible working arrangementsSenior-level Full Time20 Bank St - HQ1, United …1d ago
-
Product Engineering Data Analyst GBP 46K-46KCorrelation | DOE | Dashboarding | Data Quality | Data ValidationMid-level Full TimeUnited Kingdom - Towcester Northamptonshire1d ago
-
Data Scientist/Engineer GBP 43K-65KAPI Integration | AWS | Data Pipelines | Data Transformation | Data VisualizationAnnual leave | Bank holidays | Contributory pension | Dental care plans | EV car leaseEntry-level Full TimePeterborough, United Kingdom1d ago
-
Senior-level Full TimeManchester, United Kingdom1d ago
-
Analytics Engineer / Data Engineer GBP 60K-80KCI/CD | DBT | Databricks | Entity Resolution | Fuzzy Matching30 days annual leave | Development training opportunities | Discount card | Flexible working | One volunteering day per yearSenior-level Full TimeRemote, United Kingdom R1d ago
-
GenAI Platform Lead GBP 84K-120KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional developmentSenior-level Full TimeSheffield, United Kingdom R1d ago
-
Forward Deployed Engineer (EU) GBP 120K-170KAPI Integration | End to End | End-to-End Development | Go | Machine LearningTravel opportunitiesEntry-level Full TimeLondon, UK, Remote, UK, Munich, GER R1d ago
-
AI Cloud | AI SDK | API Design | API Gateway | AWSClient facing technical leadership | Hybrid working environment | Meritocratic culture | Professional developmentSenior-level Full TimeLondon1d ago
-
MLOps Engineer (LLM/GenAI) GBP 27K-27KAWS | Accelerate | Azure | Batching | CUDAContributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations supportEntry-level Full TimeSheffield, United Kingdom R1d ago