Data Engineer | London, UK
Tasks
- Build batch jobs and data processing logic
- Conduct data quality checks
- Develop validate SQL queries
- Document data mapping validation rules test results and migration exceptions
- Extract transform reconcile validate data
- Investigate data inconsistencies root causes
- Perform data lake cleanup
- Run regression testing for batch processes
- Support ledger migration activities
- Support production readiness defect triage and post migration validation
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Batch Processing | Cause analysis | Data Analysis | Data Lake | Data Migration | Data Quality | Data Reconciliation | Data Validation | Regression testing | Reporting pipelines | Root Cause Analysis | Root cause | SQL
Education
N/A
Roles
Related jobs
-
Mobile Threat Analyst GBP 62K-95KArtificial Intelligence | Cyber Threat | Cyber threat analysis | Dark Web | Dark web monitoringMid-level Full TimeLondon, England, GB17h ago
-
Agentic AI Engineer, AI Automation GBP 70K-85KAI Search | AWS | Agents SDK | Agile | AutogenBirthday day off | Employee resource groups | Extra holiday allowance | Flexible working | Hybrid workingEntry-level Full TimeLondon18h ago
-
Flight Data Analyst GBP 43K-50KAIMS) | Airbus A320 | Data Analysis | Data Monitoring | DatabricksAnnual leave | Flexible benefits | Hybrid working options | Pension contributions | Staff travel benefitsMid-level Full TimeUnited Kingdom-London-London Luton Airport20h ago
-
Staff Forward Deployed Engineer GBP 84K-126KAI Agents | AWS | Amazon Redshift | Azure | BigQueryCompany equity | Life insurance | Mental health support | Paid time off | Paid volunteering leaveSenior-level Full TimeManchester21h ago
-
Staff Engineer - Data platform GBP 85K-110KAWS | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeUnited Kingdom21h ago
-
Financial Crime Unit - Data Analyst GBP 33K-40KAML | Data Visualization | Fraud Detection | Machine Learning | Power BICompany share purchase plan | Flexible work schedule | Health and wellbeing benefitsEntry-level Full TimeBristol, United Kingdom22h ago
-
A/B | A/B Testing | AWS | Airflow | B testingCreativity and Wellness benefits | Employee equity plan | Flexible vacation policy | Free German courses | Gym membershipSenior-level Full TimeBerlin, London23h ago
-
Mid-level Full TimeThornton-Cleveleys, United Kingdom1d ago
-
Data Analyst | Risk GBP 62K-70KAgile | Analytics dashboarding | Data Lakehouse | Data Lineage | Data ModelingMid-level Full TimeLondon, GB1d ago
-
People Analytics Specialist GBP 45K-50KAutomation | Data Science | Data Storytelling | Data Visualization | ExcelHealth and wellbeing benefits | In-office collaboration | Professional developmentMid-level Full Time58 Fenchurch Street, London, GBR, United …1d ago
-
HR Data Analyst GBP 40K-45KDashboard Development | Data Governance | Data Quality | Data Visualization | Data analyticsAnnual leave | Bank holidays | Career progression | Life assurance | Mental Health First AidersMid-level Full TimeLondon, England, United Kingdom1d ago
-
Pricing, Data & Analytics Cohort GBP 28K-29KClaims Analysis | Data Analysis | Data integration | Excel | Insurance pricingAnnual leave | Bank holidays | Cashback | Colleague assistance programme | Cycle to workEntry-level Full TimeLeicester, United Kingdom1d ago
-
Pricing, Data & Analytics Cohort GBP 28K-29KData Analysis | Excel | KPI Reporting | Market Modeling | Portfolio AnalysisCashback | Employee discounts | Flexible working | Hybrid working | Income protectionEntry-level Full TimeBexhill, United Kingdom1d ago
-
GBC Biodata Infrastructure Technical Analyst GBP 41K-46KData Pipelines | Entity recognition | Git | GitHub | GitLabFlexible working | Hybrid working patterns | On-site nursery | Parental leave | Private medical insuranceMid-level Full TimeHinxton, United Kingdom1d ago
-
Manual QA Engineer (Embedded Systems) GBP 35K-44KBluetooth | Cellular | Defect Reporting | Device Configuration | Embedded SystemsBank holidays | Discounted gift cards | Eye care vouchers | Hybrid working | Life insuranceMid-level Full TimeLeicester, England1d ago
-
Senior-level Full TimeFleet Place Office, United Kingdom1d ago
-
Finance Data Engineer GBP 52K-70KAPI Integration | BI Semantic Modeling | Data Governance | Data Modeling | Data PartitioningHybrid working | Private medical insuranceMid-level Full TimeUnited Kingdom1d ago
-
Senior-level Full TimeLondon2d ago
-
Senior Applied Scientist GBP 92K-130KBlack | Cloud Computing | Data Analysis | Deep learning | GitMentoring and coachingSenior-level Full TimeLondon2d ago
-
Data Engineer GBP 52K-75KAWS | Apache Flink | Apache Spark | Azure | ElasticsearchCompetitive benefits | Opportunity to make an impact | Remote work flexibility | Work with cutting-edge technologyMid-level Full TimeLondon R2d ago
-
Networks Data Analytics Specialist GBP 28K-28KApache Superset | Artificial Intelligence | Clustering | Component analysis | Dashboard DevelopmentEqualised parental leave | Holiday purchase scheme | Paid carer’s leave | Pension scheme | Private GP access 24 7Mid-level Full TimeBirmingham, GB, B4 6GA2d ago
-
Data Analysis | Data Science | Deep learning | Experiment design | Language ModelsBonus | Company benefits | Equity incentive plan | Hybrid workSenior-level Full TimeLondon, UK3d ago
-
Full Stack AI Engineer GBP 57K-78KAI coding | AI coding tools | API Development | Alembic | Application InsightsGroup insurance | Multisport card | Private medical care | Remote or hybrid work | Wellbeing platformMid-level Full TimeBelfast3d ago
-
Analytics Engineer GBP 45K-60KDBT | Data Modelling | Data Transformation | Data pipeline | DatabricksDiscounts | Financial coaching | Flexible work hours | Free sports and social clubs | GP office visitsMid-level Full TimeLondon, England, United Kingdom R3d ago
-
Senior Machine Learning Engineer GBP 80K-126KAPI serving | Agentic LLM | Automated testing | CI/CD | DockerContributory pension scheme | Enhanced maternity and adoption pay | Private healthcareSenior-level Full TimeLondon, United Kingdom R3d ago