Senior Data Engineer
Tasks
- Build Spark pipelines on Databricks
- Conduct code reviews and mentor engineers
- Implement automated data quality checks
- Implement governed ingestion flows with Informatica IDMC
- Model bronze silver and gold lakehouse datasets
- Support Synapse workloads during migration
- Tune Spark workloads for performance and cost
Perks/Benefits
- Annual bonus
- Bank holidays
- Electric vehicle scheme
- Employee share plan
- Family-friendly leave
- Flexible work from home
- Paid time off
- Pension matching
- Retail discounts
- Training and development
- Volunteering days
Skills/Tech-stack
Apache Spark | Azure Synapse | Backfill Processing | Data Modeling | Data Quality | Databricks | ETL orchestration | Failure recovery | Incremental loading | Informatica IDMC | Joins | Partitioning | Performance Tuning | PySpark | SQL | Schema evolution | Shuffles
Education
N/A
Roles
Related jobs
-
Big Data Software Engineer GBP 43K-49KAWS | Atlassian tools | Azure | BigQuery | BigtableDiscounted mobile and broadband products | Holiday purchase scheme | Hybrid work | Maternity paternity and adoption leave | Paid bonusMid-level Full TimeBelfast, GB, BT1 3BT R2h ago
-
Data Engineer I GBP 50K-60KAzure DevOps | Cause analysis | Data Modeling | Data Quality | Data pipelineMid-level Full TimeGermany, Remote; Netherlands, Remote; Spain, Remote; … R18h ago
-
Partnership Analytics Lead - 14 Months FTC GBP 62K-80KAzure | Copilot Studio | DBT | Microsoft Fabric | Power AutomateHybrid work modelSenior-level ContractLondon, England, United Kingdom R20h ago
-
A/B | A/B Testing | AWS | Airflow | Apache SparkCreativity and wellness benefit | Employee equity plan | Flexible vacation | Free language courses | Free lunches weeklySenior-level Full TimeBerlin, London22h ago
-
Data Engineer GBP 64K-80KDBT | Data Vault | Data Warehousing | Dataform | Dimensional ModelingDental insurance allowance | Flexible working arrangements | Growth promotion cycles | Gym membership allowance | Inclusion & Belonging groupsSenior-level Full TimeLondon, England, United Kingdom R22h ago
-
Data Analyst GBP 26K-26KBigQuery | CI/CD | DBT | Dataform | GitDental insurance allowance | Discounts on services | Employee events | Family-first policies | Flexible workingMid-level Full TimeLondon, England, United Kingdom R22h ago
-
Senior Machine Learning Engineer GBP 78K-92KDocker | Feast | Feature Store | Git | GrafanaDental insurance allowance | Flexible working | Four day working week | Gym membership allowance | Learning and development budgetSenior-level Full TimeLondon, England, United Kingdom R22h ago
-
Data Engineer GBP 58K-61KAgile | Amazon Redshift | Amazon Web Services | Apache Spark | CI/CDComprehensive benefits package | Fitness reimbursement | Work anywhere remote optionsMid-level Full TimeUnited Kingdom - London1d ago
-
API | Active Batch | Analysis Services | Apache Spark | Azure Active BatchSenior-level Contract Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Senior Data Engineer GBP 70K-89KAPI | AWS | Airflow | CI/CD | CubeDiscretionary bonus | Festive office closure downtime | Global events | Paid annual leave | Work-life balance flexibilitySenior-level Full TimeLondon, England1d ago
-
Lead Data Engineer GBP 45K-60KAPIs | Analytics | Ansible | Azure | Cloud platformHybrid work environment | Learning and developmentSenior-level Full TimeUK - Hook, United Kingdom1d ago
-
AI/ML/Data Science Engineer GBP 50K-60KAPIs | Anomaly Detection | Cloud Platforms | Computer Vision | ContainerizationAnnual leave | Bank Holiday Leave | Dental care | Discounts | Enhanced maternity/paternity leaveMid-level Full TimeBiggin Hill, United Kingdom1d ago
-
C# | MATLAB | NumPy | Pandas | PythonNon permanent employment | Part-time hours | Project based workSenior-level Full TimeUnited Kingdom - Remote R1d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFreelance assignments | Part-time availability | Project based workMid-level FreelanceUnited Kingdom - Remote R1d ago
-
Freelance Machine Learning Engineer USD 110KLLM | Langchain | NumPy | Pandas | Prompt engineeringEnglish C1 writing expectation | Part time project based engagementMid-level FreelanceUnited Kingdom - Remote R1d ago
-
Machine Learning Engineer III GBP 72K-85KAWS | AWS SageMaker | Agentic AI | Amazon Bedrock | Bayesian MethodsAccess to learning platform | Adoption Assistance | Flexible benefits | Health and welfare insurance | Inclusion groupsSenior-level Full TimeLondon, United Kingdom1d ago
-
Machine Learning Engineer II GBP 72K-85KAWS | AWS Bedrock | AWS SageMaker | Agentic AI | Deep learningAdoption Assistance | Flexible benefits | Health insurance | Internal job opportunities | Leadership coursesSenior-level Full TimeLondon, United Kingdom1d ago
-
Apache Superset | Cloud Computing | Data Modeling | Data Quality | Data WarehousingSupportive team environment | UK security clearance eligibilityEntry-level Full TimeBristol - Central1d ago
-
Senior Software Engineer II - Data Engineering GBP 52K-56KAgile | Amazon EKS | Application Programming | Application Programming Interfaces | Backend DevelopmentEmployee assistance program | Flexible working hours | Generous vacation entitlement | Parental leave | Personal choice budgetMid-level Full TimeUK - London (London Wall), United …1d ago
-
Senior Software Engineer II - Data Engineering GBP 52K-56KAPI Development | Agile | Alerts | Backend Development | CI/CDEmployee assistance program | Employee discounts | Family leave | Flexible working hours | Internal communities and networksMid-level Full TimeUK - London (London Wall), United …1d ago
-
AI Engineer GBP 50K-65K.NET | A/B | A/B Testing | Async Python | AzureAnnual leave | Contributory pension | Flexible benefits | Flexible working hours | Group income protectionMid-level Full TimeUnited Kingdom R1d ago
-
Engineering - Data Engineer - Vice President - London GBP 121K-146KApache Iceberg | Apache Spark | Avro | CI/CD | ContainerizationExecutive-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Data Engineering - Data, Lakehouse and AI Data Platform Engineer - Analyst/Associate - London GBP 55K-72KApache Iceberg | Apache Spark | Avro | CI/CD | Data ModelingMid-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Automation | CI/CD | Cloud infrastructure | Data Architecture | Data GovernanceBlended working | Defined contribution pension | Employee assistance programme | Eye Tests | Flexible workingSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Cloud Computing | Dashboard Development | Data Modeling | Data Pipelines | Data ProcessingHybrid work | Private healthcareMid-level Full TimeSouthampton, United Kingdom1d ago