Senior Data Engineer
Tasks
- Collaborate with peers and mentor junior colleagues
- Collaborate with stakeholders and analysts to deliver data requirements
- Create automated test plans for UAT
- Define and execute team backlog
- Design implement test and document ETL pipelines
- Ensure compliance with data privacy regulations
- Identify performance bottlenecks and data quality issues
- Implement and optimize Databricks data pipelines
- Implement data security measures
- Ingest and transform data from multiple sources
- Lead solution design activities
- Maintain and enhance data technology standards
- Monitor and improve data accuracy and reliability
- Perform peer reviews
Perks/Benefits
- Annual performance-related bonus
- Contributory pension scheme
- Development days
- Discount on insurance products
- Flexible buy sell holiday options
- Flexible working
- Hybrid working
- Retail discounts
- Volunteering days
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | CI/CD | Data Modeling | Data Privacy | Data Quality | Data Security | Databricks | Delta Lake | ELT | ETL | GitHub Actions | Kafka | Parquet | PySpark | Python | UAT
Education
N/A
Roles
Related jobs
-
AI Engineer - Nexus Black GBP 78K-109KBackend Development | CI/CD | Cloud services | Embeddings | EvaluationHybrid workSenior-level Full TimeLondon, England, United Kingdom10h ago
-
Amazon S3 | Data Ingestion | Data Modeling | Data Pipelines | Data TransformationSenior-level Full TimeLondon14h ago
-
Senior Associate, IT, AI Engineer (Mid Level) GBP 70K-90KAWS | AWS Strands | Agent Frameworks | Agent Service | Azure AIHybrid working | Learning and development | Supportive team environmentMid-level Full TimeLondon, England, United Kingdom15h ago
-
Senior Data Engineer (Databricks) GBP 72K-80KAWS | AWS DMS | Amazon S3 | CI/CD | ComplianceHybrid workingSenior-level Full TimeLondon, England, United Kingdom15h ago
-
Lead Data Scientist GBP 75K-75KAzure DevOps | CI/CD | Data Lakes | Data Warehousing | Distributed ComputingAnnual leave | Career breaks | Income protection | Life assurance | PensionSenior-level Full TimeEdinburgh, Scotland, United Kingdom17h ago
-
Data Engineer GBP 30K-30KAI tools | AWS | AWS CDK | AWS Cloud | AWS cloud infrastructureBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Free onsite gymEntry-level Full TimeManchester / Hybrid, England, United Kingdom R18h ago
-
Software Engineer, Embedded UI - C++ GBP 70K-88KC++ | CI/CD | Concurrency | Continuous integration | Debugging401k retirement options | Health benefits | Hybrid work option | Paid time off | Remote work flexibilitySenior-level Full TimeCambridge, United Kingdom23h ago
-
AWS | Ansible | Azure | Blue-Green Deployment | Blue/greenEquity | Flexible working | Home office stipend | Paid vacation | Remote workSenior-level Full TimeLondon, England, United Kingdom - Remote R1d ago
-
Senior Data Engineer GBP 70K-80KAWS | Amazon Redshift | DBT | Data Governance | Data LakeHybrid work modelSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer GBP 40K-49KApache Spark | Cloud infrastructure | Data Architecture | Data Lineage | Data ModelingFlexible first working arrangement | Growth opportunities | Hybrid work | Total rewards for health and wellbeingMid-level Full TimeUK - Leicester - Spinneyside, United …1d ago
-
Senior Data Engineer GBP 43K-52KAWS | Azure | Data Architecture | Data Modeling | Data QualityCareer development | Flexible work | MentorshipSenior-level Full TimeUK - Leicester - Spinneyside, United …1d ago
-
Applied AI Engineer GBP 100K-125KASR | Adversarial Testing | Azure | Barge In | ElevenLabsHybrid work | In-person work | Remote workMid-level Full TimeRemote (UK), United Kingdom R1d ago
-
Data Engineer GBP 64K-74KAccess Control | Alerting | Batch Processing | Data Contracts | Data GovernanceSenior-level Full TimeLeeds, United Kingdom1d ago
-
Auto-regressive models | Custom Kernels | Data Engineering | DeepSpeed | Distributed TrainingSenior-level Full TimeLondon, UK1d ago
-
Staff Machine Learning Engineer, Simulation GBP 155K-163KData Analysis | Data Science | Deep learning | Evaluation metrics | Experiment designAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid work environmentSenior-level Full TimeLondon, UK1d ago
-
Staff Machine Learning Engineer, Simulation GBP 155K-163KData Analysis | Data Science | Deep learning | Experiment design | Foundation ModelsSenior-level Full TimeLondon, UK1d ago
-
Mid-Senior Data Engineer (GCP, Python, BigQuery) GBP 75K-85KAPI Gateway | BigQuery | CI/CD | Cloud Run | Cloud SQLCompany pension scheme | Free flu jab | Hybrid working model | Paid time off | Private healthcareSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 86K-120KA/B | A/B Testing | API Development | B testing | CI/CDSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior AI Engineer GBP 90K-120KAPI Development | Agentic Workflows | CI/CD | Embedding Models | Generative AISenior-level Full TimeLondon, United Kingdom1d ago
-
Machine Learning Engineer GBP 78K-103KAmazon SageMaker | Amazon Web Services | Apache Beam | Apache Spark | CI/CDCycle to work scheme | Employee assistance program | Flexible working options | Headspace access | Health cash planSenior-level Full TimeEdinburgh1d ago
-
Machine Learning Engineer GBP 78K-100KAWS | Apache Beam | Apache Spark | Azure | CI/CDCycle to work scheme | Employee assistance plan | Headspace access | Health cash plan | Life insuranceSenior-level Full TimeLondon1d ago
-
Data & Analytics Engineer GBP 70K-89KAgile | Azure DevOps | CI/CD | Csharp | Data GovernanceBackground checks | Hybrid workSenior-level Full TimeYork, United Kingdom, Hybrid R1d ago
-
Cloud Data Engineer GBP 35K-35KAWS | AWS Glue | Alteryx | Amazon Athena | Amazon RDSAdditional annual leave purchase | Healthcare | Hybrid working | Paid time off | PensionEntry-level Full TimeNottingham, England, United Kingdom1d ago
-
Data Engineering Lead GBP 115K-145KBigQuery | Cloud Native | DBT | Data Architecture | Data EngineeringApple hardware | Enhanced family leave | Paid time off | Pension contribution | Private medical insuranceSenior-level Full TimeLondon1d ago
-
Senior-level Full TimeUnited Kingdom1d ago