Senior Data Engineer
London, England, United Kingdom
GBP 60K-80K (estimate) Senior-level Full Time
Tasks
- Build batch and real-time data pipelines
- Consult with clients to shape pragmatic engineering decisions
- Design and deliver greenfield data platforms
- Design scalable data ecosystems using data mesh data products data contracts
- Ensure data governance and compliance
- Implement secure compliant data solutions
- Implement streaming and event driven data processing
- Improve data quality, testing, and observability
- Optimize storage formats and access patterns
- Orchestrate data workflows
- Own end to end architecture of cloud native data platforms
- Process and transform large datasets
- Review designs and code
- Set engineering standards and best practices
Perks/Benefits
- Autonomy
- Mentorship and technical guidance
- Professional development opportunities
- Work on high-impact problems
Skills/Tech-stack
AWS | AWS Glue | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Spark | Argo CD | Avro | BigQuery | CI/CD | Cassandra | DBT | Data Contracts | Data Products | Data mesh | Databricks | Delta Lake | Flink | GitHub Actions | Google Cloud | Google Dataflow | Great Expectations | Infrastructure as Code | Kafka | MongoDB | ORC | Parquet | PostgreSQL | Pub/Sub | Pulumi | Python | SQL | Snowflake | Soda | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
GenAI Platform Lead GBP 84K-120KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional developmentSenior-level Full TimeSheffield, United Kingdom R11h ago
-
MLOps Engineer (LLM/GenAI) GBP 27K-27KAWS | Accelerate | Azure | Batching | CUDAContributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations supportEntry-level Full TimeSheffield, United Kingdom R12h ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Agile | Analytics | Azure | Cloud platformHybrid work environmentMid-level Full TimeUnited Kingdom R15h ago
-
Batch Machine Learning | CI/CD | Causal Inference | Cluster computing | ContainerizationEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom15h ago
-
Lead Software Engineer - Cloud/Java-Python/AI-ML GBP 84K-115KAWS | Apache Iceberg | Artificial Intelligence | Automated testing | AzureSenior-level Full TimeBOURNEMOUTH, DORSET, United Kingdom17h ago
-
AWS | Application development | Artificial Intelligence | Automated testing | AutomationSenior-level Full TimeLONDON, United Kingdom18h ago
-
Sr. Lead Data Engineer GBP 72K-84KAWS | Anomaly Detection | Automation | BigQuery | Change ManagementSenior-level Full TimeLONDON, LONDON, United Kingdom18h ago
-
AI Engineer - Global Strategy Consultant GBP 100K-125KAPIs | Access Control | Agent Orchestration | Anomaly Detection | AuthenticationMid-level Full TimeLondon, 20 Farringdon Road, United Kingdom1d ago
-
Biosensor Algorithm Engineer GBP 24K-24KAnomaly Detection | Classification | Embedded Systems | Git | Machine LearningMid-level Full TimeUnited Kingdom, Cambridge1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
AWS | Apache Flink | Apache Iceberg | Apache Spark | CassandraEmployee networks | Paid adoption leave | Paid parental leave | Professional development opportunities | Remote team collaborationSenior-level Full TimeLondon (Haggerston), United Kingdom R1d ago
-
Executive-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer (Mid‑Level ), Global GBP 70K-90KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlexible work schedule | Health insurance | Paid time off | Retirement benefits | Training and developmentSenior-level Full TimeFAR11, United Kingdom1d ago
-
Senior Platform Engineer GBP 65K-80KBackup and Recovery | Capacity Management | Command Shell | Database Clustering | Database PatchingOut of hours rotationSenior-level Full TimeDunstable, England (Vocalink), United Kingdom1d ago
-
Lead AI/ML Engineer GBP 90K-126KAPI Development | Agentic Systems | CI/CD | Cloud Native | Deep learningCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
Machine learning Engineer GBP 84K-115KAWS | Azure | Cloud Security | Docker | Google CloudCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
AMPS | AWS | AWS Athena | AWS Glue | AgileSenior-level Full TimeLONDON, United Kingdom1d ago
-
Software / Machine Learning Engineer GBP 40K-50KAWS | Computer Vision | Deep learning | Generative AI | Hugging FaceFlexible work hours | Gym discounts | Learning resources | Mental health support | MentorshipMid-level Full TimeLondon R1d ago
-
AI Engineer GBP 60K-90KAWS | Azure | CI/CD | Databricks | DockerBike to work | Career progression pathways career development programme | Educational assistance | Employee assistance programme | Employee discountMid-level Full TimeLondon, Birmingham, Manchester, Newcastle upon Tyne, …1d ago
-
AI Solution Engineer GBP 70K-95KAI Evaluation | AI Governance | AI Security | APIs | Agent FrameworksBonus package | Hybrid work | Neat benefits | Work from homeMid-level Full TimeLondon, United Kingdom1d ago
-
Research Engineer, RL Scaling Science GBP 375K-640KBenchmarking | Data Analysis | Debugging | Distributed Computing | Experiment designFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeLondon, UK1d ago
-
Contractor - Senior Data Engineer (3 months +) GBP 60K-80KAWS | AWS DMS | AWS Lambda | Amazon CloudWatch | Amazon KinesisSenior-level ContractLondon, United Kingdom1d ago
-
Batch Machine Learning | CI/CD | Causal Inference | Containerization | Data PipelinesEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalized learningSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer GBP 38K-42KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultAnnual leave | Colleague mortgage | Cycle to work initiative | Discounted gym membership | Diverse and inclusive networksMid-level Full TimeSkipton - The Bailey, United Kingdom2d ago
-
MLOps Engineer GBP 76K-100KAirflow | Automated retraining | Autoscaling | BigQuery | Blue-Green DeploymentDiscounts | Enhanced parental leave | Holiday allowance | Learning and development programme | Life insuranceSenior-level Full TimeUnited Kingdom - Remote R2d ago