Data Engineer
Tasks
- Build data transformations with PySpark
- Collaborate with analytics data science and business stakeholders
- Create data models and reusable datasets
- Design scalable data pipelines
- Develop ETL/ELT solutions
- Drive automation and continuous improvement
- Implement data quality controls
- Integrate multiple enterprise data sources
- Migrate data assets from Teradata to Databricks
- Monitor production pipelines reliability
- Optimize pipeline performance and efficiency
- Perform testing lineage and documentation
- Support governance compliance practices
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | DBT Cloud | DBT Core | Data Lineage | Data Modeling | Data Quality | Databricks | Documentation | ELT | ETL | PySpark | SQL | Testing | Version control
Education
N/A
Roles
Related jobs
-
Entry-level Full TimeLondon5h ago
-
Platform Engineer – Data Science & AI Platform GBP 75K-90KACL | Access Management | AgentOps | Apache Spark | Azure DataEmployee discount | Employee sample sales | Fixed annual payment | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom17h ago
-
Senior Analytics Engineer (6 month contract) GBP 50K-70KAI tools | DBT | Data Modeling | Data Quality | Data ReliabilityCycle to work | Electric vehicle salary sacrifice schemes | Employee referral bonus | Flexible working | Office meals and snacksSenior-level ContractLondon R20h ago
-
Senior Data Engineer - Data Science Platform GBP 60K-70KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom21h ago
-
Data Engineer - Index Data Processing GBP 55K-75KAPI Development | AWS Lambda | AWS Step Functions | Automated testing | Data QualityEntry-level Full TimeLondon UK21h ago
-
Senior-level Full TimeReading, United Kingdom22h ago
-
AI-assisted engineering | API Design | Angular | Best practices | ComplianceAnnual holiday | Bonus scheme | Flexible working | Learning culture | Life insuranceSenior-level Full TimeBracknell, England, United Kingdom23h ago
-
Data Analyst, Accounting Data and Systems GBP 28K-28KBackend Development | DBT | Data Engineering | Data Modeling | Data PipelinesMid-level Full TimeLondon - The River Building HQ1d ago
-
Scientific Data Engineer - Product Safety GBP 72K-75KAWS | Apache Spark | CI/CD | Data Lakehouse | Data ModelingAnnual holiday | Bank holidays | Bonus scheme | Life insurance | Pension schemeSenior-level Full TimeBracknell, BERKSHIRE, United Kingdom1d ago
-
Data Engineer - System Design Stability GBP 40K-50KConfiguration Management | Data Engineering | Data Modeling | Data Visualization | DatabricksEmployee referral scheme | Flexible working | Paid annual leave | Pension scheme | Professional fees reimbursedEntry-level Full TimeBristol, England, United Kingdom1d ago
-
Trainee Developer - Azure | Databricks | SQL GBP 30K-34KAzure Data | Azure Data Factory | Azure Data Lake | Cost Optimization | Data FactoryHands-on training | Mentorship | Work on live projectsEntry-level Full TimeLeicester, Leicestershire, United Kingdom R1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Data Science Professional GBP 43K-65KAnomaly Detection | Apache Spark | Big Data | Classification | Cloud ComputingAdditional annual leave | Broadband and mobile discounts | Carer leave | Cycle to work | Family leaveMid-level Full TimeLondon, GB, E1 8EP1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Lead Data Analytics Engineer GBP 75K-102KAWS | Artificial Intelligence | CI/CD | DBT | Data ObservabilitySenior-level Full TimeLondon, United Kingdom1d ago
-
Principal Software Engineer / Principal AI Engineer GBP 100K-173KAPI Integration | AWS | Agile | Artificial Intelligence | AzureComprehensive pension plan | Employee assistance program | Employee discounts | Flexible working hours | Generous vacation entitlementSenior-level Full TimeUK - London (London Wall), United …1d ago
-
Senior Software Engineer / Senior AI Engineer GBP 92K-140KAWS | Agent memory | Agentic Workflows | Azure | CI/CDComprehensive pension plan | Employee assistance program | Employee discounts | Family care leave | Flexible working hoursSenior-level Full TimeUK - London (London Wall), United …1d ago
-
Quantitative Engineer- Derivates GBP 70K-94KAWS | Automated testing | CI/CD | Cvxpy | EC2Healthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeLondon, United Kingdom1d ago
-
AI Engineer GBP 30K-30KAI Agents | AI Foundry | AI Search | Artificial Intelligence | Automation33 days annual leave | Charity support opportunities | Financial wellbeing provisions | Flexible benefits platform | Free mortgage servicesEntry-level Full TimeUnited Kingdom R1d ago
-
Senior Staff Data Engineer GBP 100K-103KCI/CD | Cloud Data | Cloud Data Platforms | Data Cataloging | Data EngineeringHybrid work | Mentoring | Onboarding and mentoringSenior-level Full TimeLondon, UK, United Kingdom, Aberdeen City R1d ago
-
Senior Staff MLOps Engineer GBP 80K-110KCI/CD | Containerization | Distributed Training | Docker | Experiment trackingHybrid workSenior-level Full TimeLondon, UK, United Kingdom, Aberdeen City R1d ago
-
Senior Cloud Engineer GBP 70K-80KAccess Management | Amazon Web Services | Automation | Bitbucket | CI/CDHybrid workSenior-level Full TimeLondon, UK, United Kingdom, Aberdeen City R1d ago
-
Data Visualisation Engineer GBP 27KAzure Data | Azure Data Factory | Claude | Cloud Computing | DAX33 days annual leave | Birthday day off | Cycle to work scheme | Electric car scheme | Employee assistance programmeMid-level Full TimeNewcastle upon Tyne, England, United Kingdom1d ago
-
Lead ML Ops Developer GBP 70K-79KAWS CDK | AWS CloudFormation | AWS Glue | AWS IAM | AWS KMSFlexible working | Hybrid work option | Professional growth | Remote work optionSenior-level Full TimeEdinburgh, Leeds, Manchester, London1d ago
-
Staff Implementations Data Engineer GBP 100K-120KAWS | Azure | Cloud platform | Data Governance | Data IngestionSenior-level Full TimeLondon, England1d ago