Senior Data Engineer
London, England, United Kingdom
GBP 60K-80K (estimate) Senior-level Full Time
Tasks
- Build batch and real-time data pipelines
- Consult with clients to shape pragmatic engineering decisions
- Design and deliver greenfield data platforms
- Design scalable data ecosystems using data mesh data products data contracts
- Ensure data governance and compliance
- Implement secure compliant data solutions
- Implement streaming and event driven data processing
- Improve data quality, testing, and observability
- Optimize storage formats and access patterns
- Orchestrate data workflows
- Own end to end architecture of cloud native data platforms
- Process and transform large datasets
- Review designs and code
- Set engineering standards and best practices
Perks/Benefits
- Autonomy
- Mentorship and technical guidance
- Professional development opportunities
- Work on high-impact problems
Skills/Tech-stack
AWS | AWS Glue | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Spark | Argo CD | Avro | BigQuery | CI/CD | Cassandra | DBT | Data Contracts | Data Products | Data mesh | Databricks | Delta Lake | Flink | GitHub Actions | Google Cloud | Google Dataflow | Great Expectations | Infrastructure as Code | Kafka | MongoDB | ORC | Parquet | PostgreSQL | Pub/Sub | Pulumi | Python | SQL | Snowflake | Soda | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Staff Machine Learning Engineer, Simulation GBP 155K-163KData Analysis | Data Science | Deep learning | Evaluation metrics | Experiment designBonus program | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeLondon, UK22h ago
-
Data Engineer GBP 49K-62KData Modeling | Data Warehousing | Databricks | Generative AI | Machine LearningOpportunities to learn new technologies | Professional development | Targeted trainingEntry-level Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Applied AI Engineer, Enterprise GBP 190K-190KAWS | Artificial Intelligence | Cloud Computing | Cloud platform | Data RequirementsMid-level Full TimeLondon, UK1d ago
-
Principal Engineer, AI & Data Platform GBP 97K-120KBigQuery Graph | Data Governance | Databricks | Dataplex | Dbt Semantic LayerSenior-level Full Time7 Swallow Place, United Kingdom1d ago
-
Data Engineer GBP 49K-55KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureCareer growth | Collaborative culture | Knowledge sharing | Mentoring | Training and developmentMid-level Contract Full TimeNewcastle upon Tyne, England, United Kingdom1d ago
-
Principal Engineer, AI & Data Platform GBP 110K-131KBigQuery | BigQuery Graph | CI/CD | Cloud Composer | Cloud ComputingSenior-level Full Time7 Swallow Place, United Kingdom1d ago
-
Automation | Data Cleansing | Data Infrastructure | Data Matching | Data PipelinesFixed-term contract | High-visibility projectEntry-level Contract TemporaryLondon, United Kingdom1d ago
-
Sr Sales Engineer GBP 85K-120KAWS | Cloud platform | Data Science | Google Cloud | Google Cloud PlatformSenior-level Full TimeUnited Kingdom, London1d ago
-
Senior Metabolomics Bioinformatician GBP 57K-64KArtificial Intelligence | Bioinformatics | Compound Discoverer | Data Filtering | Data MiningAnnual leave | Bonus scheme | Learning culture | Life insurance | Pension schemeSenior-level Full TimeBracknell, EUROPE, United Kingdom1d ago
-
Senior Developer - Databricks | Kafka | SQL GBP 64K-79KApache Flink | Apache Kafka | Apache Spark | Argo CD | Azure DevOpsCareer development | Hybrid work | Supportive work environmentSenior-level Full TimePontefract, West Yorkshire, United Kingdom2d ago
-
Data Engineer GBP 51K-62KCloud | Data Governance | Data Modeling | Data Pipelines | Data Privacy25 days holiday | Bank holidays | Birthday day off | Coffee bars | Contributory employer pension schemeEntry-level Full TimeSolihull, England, United Kingdom2d ago
-
Lead Software Developer (AI Solutions) GBP 24K-24K.NET | AI Agent | AI agent orchestration | API Development | Agent OrchestrationCareer support | Inclusive culture | Professional developmentSenior-level Full TimeOxford, England, United Kingdom2d ago
-
Senior Data Engineer (Databricks) GBP 72K-82KAWS | AWS DMS | Amazon S3 | CI/CD | ComplianceHybrid working | Learning and development | Professional growth opportunitiesSenior-level Full TimeLondon, England, United Kingdom2d ago
-
Data Analyst - Energy GBP 26K-26KBigQuery | CI/CD | Data Documentation | Data Modeling | Data PipelinesCompany events | Flexible working | Gym membership | Inclusion groups | Learning and development budgetMid-level Full TimeLondon, England, United Kingdom R2d ago
-
Senior Machine Learning Engineer GBP 78K-109KA/B | A/B Testing | B testing | Clustering | DockerDental insurance allowance | Flexible working | Four day working week | Gym membership allowance | HolidaySenior-level Full TimeLondon, England, United Kingdom R2d ago
-
API Development | AWS | Amazon EKS | Amazon SageMaker | AutoscalingSenior-level Full TimeLONDON, LONDON, United Kingdom2d ago
-
Data Analyst GBP 26K-26KBigQuery | CI/CD | Dashboarding | Data Documentation | Data ModelingFlexible benefits | Flexible working | Learning and development budget | Life assurance | Matched contribution pension schemeMid-level Full TimeLondon, England, United Kingdom R2d ago
-
Data Engineer GBP 60K-75KDBT | Data Vault | Dataform | Dimensional Modeling | DockerFlexible working arrangements | Learning and development budget | Optional four day working week | Paid sabbatical | Remote-first workSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Data Engineer GBP 45K-50KAPI Integration | Batch Processing | Data Governance | Data Lineage | Data ModelingAfterlife support | Annual leave | Gym membership discount | Health cashback plan | Purchase holiday schemeMid-level Full TimeLondon, England2d ago
-
Microsoft AI Engineer GBP 60K-65KAI Foundry | API Integration | Azure AI | Azure AI Foundry | Azure VirtualSecurity ClearanceMid-level Full TimeMarlow,Buckinghamshire, UK2d ago
-
Quantitative Developer (Asset Management) GBP 52K-56KCode review | Data Processing | Data Structures | Performance Measurement | Portfolio constructionDiscounts | Electric car scheme | Flexible working options | Healthcare plan | Life assuranceEntry-level Full TimeLondon, England, United Kingdom2d ago
-
Databricks Data Engineer GBP 45K-52KAWS | Agile | Apache Spark | Automation | AzureAccredited training | Hybrid work | Inclusive hiring process | Remote work | Travel to LondonMid-level Full TimeLondon, ENG, United Kingdom2d ago
-
Mid-level Full TimeLondon - UK - Fenchurch, United …2d ago
-
Mid-level Full TimeLondon - UK - Fenchurch, United …2d ago
-
AWS CLI | Agile | Command Line | Computer Vision | Deep learningBuy and sell holiday | Cycle to work | Dental plan | Early finish Fridays | Enhanced parental leaveSenior-level Full TimeGloucester, South Gloucestershire, United Kingdom2d ago