Senior Data Engineer - Data Science Platform
London, England, United Kingdom
GBP 60K-70K (estimate) Senior-level Full Time
Tasks
- Build reusable data engineering templates
- Collaborate with stakeholders on data requirements
- Design scalable data pipelines
- Enable production ready datasets
- Implement CI/CD for data pipelines
- Optimize data workflows for performance and cost
- Partner with ML engineering and security on Azure infrastructure
- Perform data quality validation testing observability and metadata management
- Standardize data ingestion transformation and serving
Perks/Benefits
- Discretionary bonus scheme
- Employee discount
- Employee sample sales
- Flexible benefits allowance
- Paid annual leave
- Personalized learning
- Private medical care
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CD | DBT | Data Factory | Data Ingestion | Data Lake Storage | Data Modeling | Data Quality | Data Testing | Data Transformation | Data serving | Databricks | Delta Lake | Infrastructure as Code | Metadata Management | Observability | PySpark | Python | Scala | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Data Science & AI Specialist GBP 28K-28KAWS | Advanced Analytics | Artificial Intelligence | Cloud platform | Data PipelinesDiscounted products | Gym membership | Holiday purchase scheme | Paid carer’s leave | Pension schemeMid-level Full TimeIpswich, GB, IP5 3RE5h ago
-
Data Engineer - Core Engineering GBP 58K-71KAzure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactoryAnnual leave | Bank holidays | Employer pension matching | Hybrid work | Private medical insuranceEntry-level Full TimeEdinburgh, GB6h ago
-
AI Engineer, Enablement (London) GBP 110K-150KAWS | Agent architecture | Azure | Docker | Evaluation401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceMid-level Full TimeLondon15h ago
-
AI Research Engineer USD 200K-400KAgent systems | Constrained decoding | Data Curation | Evaluation Harness | Hugging FaceMid-level Full TimeNew York City16h ago
-
Staff Software Engineer, Inference GBP 116K-155KAutoscaling | BF16 | Batching | Benchmarking | C++401k matching | Casual work environment | Catered meals | Childcare support | Commuter benefitsSenior-level Full TimeLondon, England18h ago
-
C++ Algorithms Engineer GBP 50K-61KC++ | CI/CD | Configuration Management | Containerization | GPU integrationCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeSenior-level Full TimeManchester, England, United Kingdom18h ago
-
Embedded Software Engineer GBP 45K-60KAUTOSAR | Agile | C# | C++ | Embedded SystemsCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeMid-level Full TimeManchester, England, United Kingdom18h ago
-
Senior ML Engineer (AI Research/ Portability) GBP 190K-230KAPI Design | Agent systems | Authentication | CI/CD | Code reviewCareer growth | Collaborative culture | Flexibility | International environment | Learning opportunitiesSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R20h ago
-
Senior ML Engineer (AI Research, Physical AI) GBP 92K-173KComputer Vision | Control | Deep learning | Distributed Computing | Distributed TrainingCareer growth and learning opportunities | Collaborative culture | Flexibility | International environment | OwnershipSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R20h ago
-
Senior Data Engineer I - Scalable Growth GBP 85K-115KAirflow | Batch pipelines | Big Data | Braze | Braze APISenior-level Full TimeLondon, United Kingdom23h ago
-
Backup and Recovery | C++ | Capacity Management | Compaction | DebuggingMentorship | On-call rotation | Open Source contributionSenior-level Full TimeLondon1d ago
-
Lead Data Scientist GBP 70K-90KAutomation | CI/CD | Feature Engineering | Hyperparameter Tuning | Infrastructure provisioningSenior-level Full TimeLondon, United Kingdom1d ago
-
Solution Engineer - Insurance & Asset Management GBP 75K-95KData Engineering | Data Governance | Data Lakes | Data Modeling | Data WarehousingSenior-level Full TimeGB-London1d ago
-
Solution Engineer - FSI GBP 71K-95KCloud Computing | Data Engineering | Data Governance | Data Lakes | Data ModelingSenior-level Full TimeGB-London1d ago
-
Senior Embedded Software Engineer GBP 60K-70KARM Cortex | ARM Cortex-M | Bash | C# | CANEducation assistance program | Employee assistance program | Employee referral program | Employee stock purchase program | Family leaveSenior-level Full TimeGlasgow, Scotland, United Kingdom1d ago
-
Applied AI Engineer EUR 90K-92KAgent systems | Agent workflows | Agent/tool use | Alerting | Chain-of-ThoughtSenior-level Full TimeLondon, UK; Madrid, Spain1d ago
-
Senior Software Engineer, GenAI Platform GBP 75K-90KAPIs | AWS | Autoscaling | Batch inference | Cost OptimizationSenior-level Full TimeLondon - The River Building HQ1d ago
-
CI/CD | Data Pipelines | FastAPI | Flask | GitDiscounts | Electric car scheme | Family leave | Generous pension contribution | Healthcare planEntry-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Lead Software Engineer - CDAO Data Platforms GBP 84K-109KAI Assisted Development | Cause analysis | Cloud Native | Code review | Distributed SystemsSenior-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Engineer II - Scalable Growth GBP 111K-145KApache Airflow | Apache Kafka | Braze | DBT | Data Pipeline MonitoringMid-level Full TimeLondon, United Kingdom1d ago
-
Asynchronous programming | Automated testing | Cats Effect | Cause analysis | Cloud NativeSenior-level Full TimeLONDON, United Kingdom1d ago
-
AI Assisted Development | Agile methodologies | Application Resiliency | Asynchronous programming | Automated testingSenior-level Full TimeLONDON, United Kingdom1d ago
-
Data Analysis | Data Pipelines | Data Processing | Debugging | Distributed SystemsAgile work environment | Healthcare benefits | Paid time offSenior-level Full TimeUnited Kingdom, Cambridgeshire, Cambridge1d ago
-
Senior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Data - UK GBP 44K-51KAWS | Azure | Data Lineage | Data Modeling | Data PipelinesEnhanced pension | Paid time off | Private dental insurance | Private health insurance | Professional developmentMid-level Full TimeWarrington, United Kingdom1d ago