Senior Data Engineer - Data Science Platform
London, England, United Kingdom
GBP 60K-70K (estimate) Senior-level Full Time
Tasks
- Add observability and metadata management
- Build data platform components
- Collaborate with stakeholders on data requirements
- Design scalable data pipelines
- Ensure secure scalable data infrastructure on Azure
- Implement CI/CD for data pipelines
- Maintain reusable data engineering templates
- Optimize performance and cost of data workflows
- Standardize data ingestion transformation serving
- Validate data quality and test pipelines
Perks/Benefits
- Employee discount
- Employee sample sales
- Flexible benefits allowance
- Flexible work rhythm
- Paid annual leave
- Personalised learning
- Private medical care
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CD | DBT | Data Factory | Data Lake Storage | Data Modeling | Data Pipelines | Data Quality | Databricks | Delta Lake | Infrastructure as Code | Metadata Management | Monitoring | Observability | PySpark | Python | Scala | Terraform | Testing | “as-code”
Education
N/A
Roles
Related jobs
-
SAS Data Engineering Consultant GBP 67K-80KAWS | Agile | Alteryx | Apache Spark | Azure25 days holiday | Cycle to work scheme | Employee assistance programme | Holiday buy/sell option | Life coverMid-level Full TimeUnited Kingdom, Any Region , United …15h ago
-
Staff MLOps Engineer (AI/ML Platform) GBP 90K-115KAWS | AWS EKS | Apache Spark | Batch Processing | DatabricksRemote work optionsSenior-level Full TimeRemote, Remote, United Kingdom R17h ago
-
Senior AI Engineer (AI Platform) GBP 72K-90KAPI Management | APIs | Active Directory | Alerting | Automated testingDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom20h ago
-
Algorithms | Automated testing | Benchmarking | C++ | Cloud ComputingCollaborative team | Hybrid work environment | MentorshipSenior-level Full TimeOXFORDSHIRE, United Kingdom20h ago
-
AI Engineer GBP 58K-90KAWS | Azure | CI/CD | Databricks | DockerBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountMid-level Full TimeLondon, Birmingham, Manchester, Newcastle upon Tyne, …21h ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 74K-100KApache Airflow | Apache Flink | Apache Spark | Google BigQuery | KafkaBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group Personal Pension SchemeSenior-level Full TimeRemote - United Kingdom R1d ago
-
Mid-level Full TimeCambridge1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
Senior Quantitative Software Engineer GBP 72K-94KC++ | Data Analysis | Functional Programming | Java | Operational RiskEmployee benefits | Flexible working arrangementsSenior-level Full Time20 Bank St - HQ1, United …1d ago
-
Product Engineering Data Analyst GBP 46K-46KCorrelation | DOE | Dashboarding | Data Quality | Data ValidationMid-level Full TimeUnited Kingdom - Towcester Northamptonshire1d ago
-
Senior-level Full TimeManchester, United Kingdom1d ago
-
Analytics Engineer / Data Engineer GBP 60K-80KCI/CD | DBT | Databricks | Entity Resolution | Fuzzy Matching30 days annual leave | Development training opportunities | Discount card | Flexible working | One volunteering day per yearSenior-level Full TimeRemote, United Kingdom R1d ago
-
GenAI Platform Lead GBP 84K-120KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional developmentSenior-level Full TimeSheffield, United Kingdom R1d ago
-
Forward Deployed Engineer (EU) GBP 120K-170KAPI Integration | End to End | End-to-End Development | Go | Machine LearningTravel opportunitiesEntry-level Full TimeLondon, UK, Remote, UK, Munich, GER R1d ago
-
AI Cloud | AI SDK | API Design | API Gateway | AWSClient facing technical leadership | Hybrid working environment | Meritocratic culture | Professional developmentSenior-level Full TimeLondon1d ago
-
MLOps Engineer (LLM/GenAI) GBP 27K-27KAWS | Accelerate | Azure | Batching | CUDAContributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations supportEntry-level Full TimeSheffield, United Kingdom R1d ago
-
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Apache AirflowSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 75K-98KAWS | Azure | Cloud Architecture | Docker | Google CloudCoaching | Dental insurance | Enhanced parental leave | Family-friendly flexibility | Flexible workingSenior-level Full TimeUK - London1d ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Agile | Analytics | Azure | Cloud platformHybrid work environmentMid-level Full TimeUnited Kingdom R1d ago
-
Batch Machine Learning | CI/CD | Causal Inference | Cluster computing | ContainerizationEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom1d ago
-
CI/CD | CRM | CrewAI | Evaluation | GitContract role | Flexible working schedule | Hybrid work | Outside IR35Senior-level ContractLondon, United Kingdom R1d ago
-
Data Analyst - Content GBP 50K-60KBI Dashboards | BigQuery | DBT | Data Modeling | Data QualityCycle to work scheme | Enhanced parental leave | Equity options | Flexible working arrangements | Group life assuranceMid-level Full TimeLondon1d ago
-
Platform Data Engineer - Cardiff GBP 55K-70KAWS | AWS Glue | Airflow | ArgoCD | BigQueryAnnual leave | Dental coverage | Flexible working | Private medical insurance | Private pensionMid-level Full TimeCardiff, Wales, UK1d ago
-
Lead Software Engineer - Cloud/Java-Python/AI-ML GBP 84K-115KAWS | Apache Iceberg | Artificial Intelligence | Automated testing | AzureSenior-level Full TimeBOURNEMOUTH, DORSET, United Kingdom1d ago
-
Senior Specialist Solutions Engineer (AI/ML) GBP 74K-112KAWS | Apache Spark | Artificial Intelligence | Azure | Distributed ComputingHybrid work | Industry conference opportunities | Mentorship | Training support | Travel 30 percentSenior-level Full TimeLondon, United Kingdom1d ago