Data Engineer
London, England, United Kingdom
GBP 42K-45K (estimate) Mid-level Full Time
Tasks
- Build and maintain streaming data ingestion pipelines
- Build and maintain structured and unstructured databases
- Design batch and real-time data pipelines
- Design streaming architectures with fault tolerance and schema evolution
- Develop RESTful and streaming APIs for event driven ingestion
- Develop data models for analytics and reporting
- Implement data quality controls
- Integrate AI and LLM data readiness governance and quality
- Manage queuing and streaming systems for low latency processing
- Monitor tune and troubleshoot data pipelines and databases
- Operate enterprise data warehouses and Lakehouse
- Perform data migration transformation and normalization
Perks/Benefits
- Cycle to work scheme
- Discounts for family and partners
- Health cash plan
- Life insurance
- Paid time off
- Pension
- Professional growth opportunities
- Retail discounts
- Volunteer time off
Skills/Tech-stack
API Integration | Apache Kafka | BigQuery | Cloud Platforms | Data Governance | Data Lake | Data Quality | Data Security | Data Warehousing | Databricks | Delta Lake | ETL | GraphQL | JSON | Lakehouse | Machine Learning | Python | REST | SQL | SQL Server | Schema evolution | Streaming Data | Structured Streaming
Education
N/A
Roles
Related jobs
-
Senior Backend AI Engineer GBP 28K-30KAPI Design | AWS | Azure | Backend Development | Cloud platformEmployee assistance programme | Employee wellbeing support | Flexible working options | Free virtual GP service | Holiday allowanceSenior-level Full TimeWelwyn Garden City, United Kingdom of …8h ago
-
C++ | Data Mining | Data Regression | Deep learning | Distributed ComputingSenior-level Full TimeLondon, UK9h ago
-
Senior Software Specialist - AI/ML - Monetisation GBP 100K-140KAds Auction | Behavior Modeling | Bidding | Budgeting | C++Senior-level Full TimeLondon, UK9h ago
-
Audio Processing | BigQuery | CI/CD | Cloud Storage | Cloud platformMid-level Full TimeLondon, UK9h ago
-
Cloud platform | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingMid-level Full TimeLondon, UK9h ago
-
Lead Software Engineer - Data & AI GBP 84K-126KAWS | Amazon Athena | Amazon SageMaker | Apache Flink | Apache KafkaSenior-level Full TimeLONDON, LONDON, United Kingdom10h ago
-
Senior AI Engineer (AI Platform) GBP 72K-90KAI Foundry | API Gateway | API Management | APIM | APIsDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom11h ago
-
Data Engineer – Data Science & Technology GBP 38K-50KData Architecture | Dimensional Modeling | ELT | ETL | NumPyAccess to fitness facilities | Charitable contribution match | Charity volunteer days | Continued learning opportunities | Employee assistance programsMid-level Full TimeLondon, United Kingdom20h ago
-
Senior Data Engineer GBP 70K-70KAgile | Behavior-Driven Development | CI/CD | Code review | Data EngineeringDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 57K-57KAgile | Alteryx | Automated testing | Behavior-Driven Development | CI/CDDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceMid-level Full TimeLondon, United Kingdom1d ago
-
AI Research Engineer - 3D Computer Vision GBP 75K-108KComputer Vision | Deep learning | Domain Adaptation | Edge Computing | Feature MatchingEnhanced parental leave | Family emergency leave | Gym membership | Learning allowance | Mental health supportSenior-level Full TimeBerlin; London; Munich R1d ago
-
Principal Data Engineer GBP 50K-60KAWS | AWS CDK | AWS Glue | AWS Lake Formation | AWS LambdaFlexible working | Hybrid work options | Learning and development | Remote work options | Supportive cultureSenior-level Full Timeleeds, Manchester1d ago
-
Lead Data Engineer GBP 50K-60KAWS | AWS CDK | AWS Glue | AWS Lambda | Amazon AthenaFlexible working | Hybrid options | Professional growth | Remote options | Supportive cultureSenior-level Full Timeleeds, Manchester1d ago
-
Senior Machine Learning Engineer GBP 72K-85KBatch Machine Learning | CI/CD | Containerization | Data Pipelines | Data parallelismDisability accommodations during hiring process | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer GBP 51K-55KApache Airflow | Azure Data | Azure Data Factory | Azure Functions | C#Hybrid work options | Knowledge sharing culture | Professional growth opportunities | Work flexibilityMid-level Full TimeBristol, 3 RIVERGATE, United Kingdom1d ago
-
Manager, Data Science GBP 57K-68KBayesian statistics | Cloud platform | Data Preparation | GCP | Google CloudMid-level Full TimeUnited Kingdom1d ago
-
Senior Ai Engineer (AI/ML/R&D) GBP 84K-109KAWS | CI/CD | Infrastructure as Code | LLM | Machine LearningAnnual leave | Company share scheme | Health insurance | Home-office allowance | Pension planSenior-level Full TimeManchester, United Kingdom1d ago
-
Entry-level Full Time17th Floor, 5 Aldermanbury Square, London, …1d ago
-
Junior Engineer (Graduate) GBP 32K-32KAWS | Azure | CI/CD | Docker | Feature EngineeringCareer development | Training and certificationEntry-level Full Time17th Floor, 5 Aldermanbury Square, London, …1d ago
-
Lead Ai Engineer (AI/ML/R&D) GBP 85K-120KAWS | Artificial Intelligence | CI/CD | Cloud Native | Information RetrievalAnnual leave | Company share scheme | Health insurance | Home-office allowance | Pension planSenior-level Full TimeManchester, United Kingdom1d ago
-
Senior Sales Engineer - Public Sector (UK) GBP 80K-100K.NET | CRM | Go | Java | Node.jsCareer pathing | Community guilds | Continuous professional development | Employee stock purchase plan | Hybrid workSenior-level Full TimeLondon, United Kingdom1d ago
-
Software Engineering III - AI/ML Engineer GBP 80K-109KAWS | Automation | Databricks | Datadog | Disaster RecoverySenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Data Engineer GBP 80K-110KAirflow | Anomaly Detection | BigQuery | CDC | CI/CDEquity | Health insurance | Income protection | Life cover | Pension planSenior-level Full TimeGreater Manchester, England, United Kingdom1d ago
-
Quantitative / AI Specialist GBP 50K-60KAPI Integration | Analytics | Artificial Intelligence | C++ | Electronic PricingEntry-level Full TimeLondon, United Kingdom1d ago
-
Principal Machine Learning Engineer GBP 84K-115KCloud Computing | Containerization | Data Science | Docker | KubernetesCoaching | Enhanced parental leave | Family-friendly flexibility | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago