Data Engineer | London, UK
Tasks
- Build batch jobs and data processing logic
- Conduct data quality checks
- Develop validate SQL queries
- Document data mapping validation rules test results and migration exceptions
- Extract transform reconcile validate data
- Investigate data inconsistencies root causes
- Perform data lake cleanup
- Run regression testing for batch processes
- Support ledger migration activities
- Support production readiness defect triage and post migration validation
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Batch Processing | Cause analysis | Data Analysis | Data Lake | Data Migration | Data Quality | Data Reconciliation | Data Validation | Regression testing | Reporting pipelines | Root Cause Analysis | Root cause | SQL
Education
N/A
Roles
Related jobs
-
Embedded system Test Engineer GBP 45K-50KAgile | Analog I/O | Analog electronics | Analog to Digital | Analog to digital I OMid-level Full TimeGlasgow, Lanarkshire, United Kingdom11h ago
-
Staff Machine Learning Engineer (Platform) - Australia based - Full Relocation Provided GBP 97K-120KAWS | Azure | CUDA | CUDA kernels | Data PipelinesCompetitive salary | ESOP | Flexible work environment | Office events | Relocation assistanceSenior-level Full TimeLondon16h ago
-
PBWM Data Analyst GBP 50K-58KData Governance | Data Mapping | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeGlasgow Campus, United Kingdom21h ago
-
Automated testing | CI/CD | Data Analysis | Functional Programming | Machine LearningMid-level Full TimeCanary Wharf, 1 Churchill Place, United …21h ago
-
Senior Data Analyst II GBP 56K-60KAB Testing | AWS | Analytics automation | Causal analysis | Churn analysisSenior-level Full TimeUK-Remote, UK, United Kingdom R21h ago
-
Machine Learning Quality Engineer GBP 78K-109KEvaluation Frameworks | Integration Testing | LLM | Python | RAGHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeGBR-London-10 Paternoster Square, United Kingdom21h ago
-
Senior Data Engineer GBP 70K-90KAPI Integration | AWS | Airflow | Azure | Cloud platformCompany lunches | Company outings | Continuing education | Flexible PTO | Health and dental benefitsSenior-level Full TimeLondon1d ago
-
Applied AI Engineer GBP 40K-80KAI Agents | API Integration | Docker | Embeddings | JavaScriptCareer development opportunities | High-growth startup | International expansion environment | Ownership and autonomyEntry-level Full TimeZurich1d ago
-
Algorithmic trading | Backtesting | C++ | Data Analysis | Data cleaningCareer growth opportunities | Collaborative work environment | Comprehensive training | Flexible working hours | Free coffee and snacksEntry-level Full TimeLondon, UK1d ago
-
Data Engineer GBP 55KAlteryx | CI/CD | Continuous Improvement | Data Governance | Data ModelingBalanced lifestyle | Financial wellbeing support | Flexible working arrangements | Hybrid work | Personal wellbeing supportMid-level Full TimeGB-ENG-LAN-Preston1d ago
-
Lead Data Analyst - Wise Platform Pricing GBP 75K-115KApache Superset | Cost Allocation | DBT | Data Modeling | Financial AnalysisCycle to work scheme | Flexible leave | Flexible working | Gym membership discount | Life insuranceSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Analyst - Wise Platform Pricing GBP 60K-85KDBT | Data Modeling | Lightdash | Python | SQLAnnual self-development budget | Cycle to work scheme | Flexible working | Group activities | Gym membership discountSenior-level Full TimeLondon, United Kingdom1d ago
-
API Integration | Active Batch | Artificial Intelligence | Azure Active Batch | Azure DataHybrid working | Mentorship | Pair programming supportSenior-level Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Senior Analytics Manager - Growth GBP 105K-150KClustering | DBT | Data Modeling | Data Visualization | Data WarehousingAnnual self-development budget | Flexible working | Life insurance | Maternity leave | Paid sabbatical leaveSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Analyst - Growth GBP 60K-85KCohort Analysis | DBT | Data Analysis | Data Modeling | Data VisualizationCycle to work scheme | Flexible working | Group activities | Gym membership discount | Life insuranceSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Analyst - Compliance Analytics GBP 60K-75KAirflow | DBT | Data Documentation | Data Governance | Data IntegrityEntry-level Full TimeLondon, United Kingdom1d ago
-
AWS | Apache Spark | Cloud platform | Data Architecture | Data EngineeringCareer development | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom1d ago
-
Staff Applied Scientist GBP 110K-160KCloud Computing | Data Analysis | Deep learning | Explainable AI | GitFlexible remote work | Generous share options | Hybrid work | Mentoring & coachingSenior-level Full TimeLondon1d ago
-
AI Engineer GBP 100K-125KAPI Development | AWS | Apache Spark | CI/CD | DatabricksCustom designed offices | Enhanced parental leave | Enhanced pension | Free breakfasts and snacks | Life insuranceMid-level Full TimeLondon, England, United Kingdom1d ago
-
Mid-level Full TimeOffice - Edinburgh, United Kingdom1d ago
-
Lead Pricing Data Analyst - BPL GBP 60K-70KAWS | Data Governance | Data Quality | Data Visualization | Data quality controlSenior-level Full TimeNorthampton, Barclays Campus, Pavilion Drive, United …1d ago
-
Data and AI Developer GBP 72K-108KAI Governance | AWS | Artificial Intelligence | Cloud Computing | Data EngineeringSenior-level Full TimeNottingham, Eng, United Kingdom1d ago
-
Senior Data Analyst -Consumer Finance GBP 53K-75KData Analysis | Data Visualization | Python | SQLAnnual leave plus bank holidays | Employee assistance program | Flexible benefits scheme | Hybrid work model | Income protectionSenior-level Full TimeLondon, United Kingdom R1d ago
-
Graduate Data Analyst GBP 31K-38KAI tools | Automation | Dashboard Development | Data Pipelines | Data QualityFlexible working options | Hybrid work | Inclusive culture | Professional development | Supportive leadershipEntry-level Full TimeLondon - Tower Place East, United … R1d ago
-
Data and AI Developer GBP 84K-119KAI Governance | AWS | Artificial Intelligence | Cloud infrastructure | Data GovernanceSenior-level Full TimeNottingham, England1d ago