Data Engineer (Databricks)
Tasks
- Continuously adapt pipelines in BAU
- Ensure data quality, integrity, and consistency
- Implement validation monitoring and governance
- Improve data platforms frameworks and engineering standards
- Integrate multiple data sources into datasets
- Lead data architecture for validation and transformation
- Lead data engineers and analysts
- Lead design and build scalable data pipelines
- Optimize data systems for performance reliability and scalability
- Provide data engineering guidance and best practices
- Translate stakeholder data requirements into technical solutions
Perks/Benefits
- Annual leave
- Critical illness cover
- Flexible working
- Life assurance
- Paid parental leave
- Pension scheme
- Private healthcare
- Workplace adjustments
Skills/Tech-stack
Apache Spark | Audit evidence | Data Architecture | Data Governance | Data Modeling | Data Monitoring | Data Pipelines | Data Quality | Data Security | Database technologies | Databricks | Performance optimization | PySpark | Python | Scalability | Spark SQL
Education
N/A
Roles
Related jobs
-
Data Engineer GBP 36K-45KAWS | AWS Glue | Airflow | Azure | DBTAnnual paid time off | Discounted flights | Flexible benefits | Holiday vouchers | Hybrid workMid-level Full TimeUnited Kingdom-London-London Luton Airport7h ago
-
Software Engineer, Machine Learning GBP 100K-130KData Structures | Data structures algorithms | Graph theory | Information Retrieval | Language ProcessingSenior-level Full TimeLondon, UK9h ago
-
Software Engineer, Infrastructure GBP 180K-225KAI | Agent Orchestration | Bias Mitigation | C# | C++Senior-level Full TimeZurich, Switzerland | Tel Aviv, Israel …9h ago
-
Senior-level Full TimeLondon, UK9h ago
-
Senior-level Full TimeLondon, UK9h ago
-
Data Filtering | Data Processing | Data debugging | Deep learning | Distributed ComputingSenior-level Full TimeLondon, UK9h ago
-
Software Engineer III - Data Analytics Platform GBP 72K-104KAPI Development | Autoscaling | Backward Compatibility | Benchmarking | CI/CDSenior-level Full TimeLONDON, United Kingdom11h ago
-
Junior Prompt Engineer / Developer GBP 31K-32KAI API | API Integration | Anthropic API | Azure OpenAI | ExcelAccess to AI tools | Mentorship | Monday-Friday schedule | On-the-job learning | Stable onsite roleEntry-level Full TimeChirk, Wales, United Kingdom11h ago
-
Senior AI Engineer GBP 80K-108KAWS | Agent architecture | Anthropic API | Cloud platform | DevOpsAnnual leave | Annual performance bonus | Charity involvement | Community initiatives | Course trainingSenior-level Full TimeBelfast, Northern Ireland, United Kingdom11h ago
-
Data Engineer GBP 723KAWS | AWS CDK | Amazon Redshift | Amazon Web Services | BitbucketBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Health cash planMid-level Full TimeManchester / Hybrid, England, United Kingdom R12h ago
-
Senior Staff Engineer (LLM) GBP 80K-109KAgent systems | Anthropic API | Authentication | Chunking | EmbeddingsSenior-level Full TimeRemote, United Kingdom R14h ago
-
Applied AI Engineer - BPL GBP 84K-126KAWS | Azure | CI/CD | Data Lakes | Data PipelinesHybrid workSenior-level Full TimeCanary Wharf, 1 Churchill Place, United …20h ago
-
A/B | A/B Testing | Augmented Reality | B testing | C++Senior-level Full TimeLondon - 50 Cowcross Street, United …20h ago
-
Mid-level Full TimeCanary Wharf, 1 Churchill Place, United …20h ago
-
Staff Analytics Engineer GBP 50K-70KAI tools | DBT | Data Modeling | Data Quality | Data TransformationEmployee referral programme | Flexible working | Health coverage | Hybrid/remote options | Office meals and snacksSenior-level Full TimeLondon R1d ago
-
Senior-level Full TimeUnited Kingdom1d ago
-
Entry-level Full TimeSF Bay Area, CA, London, UK1d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R1d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami1d ago
-
Senior Data Engineer GBP 45K-65KAzure | Data Governance | Data Modeling | Data Pipelines | Data QualityAnnual leave | Career breaks | Flexible working | Income protection | Job share optionsSenior-level Full TimeBirmingham, England, United Kingdom1d ago
-
Access Control | Application Insights | Azure Data | Azure Data Factory | Azure Data LakeFlexible working | Health and wellbeing benefits | Mental Health First Aiders | Mental health support | Sports and social groupsEntry-level Contract TemporaryNottingham, United Kingdom1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Principal AI Engineer GBP 90K-115KAgentic Workflows | CI/CD | Cloud Computing | Experimentation | GuardrailsConference and training access | Flexible working hours | Global retreats | IT equipment budget | Learning budgetSenior-level Full TimeUnited Kingdom1d ago
-
Senior AI Engineer GBP 80K-109KAPI Design | Agent systems | CI/CD | Cloud Run | EmbeddingsDedicated learning days | Flexible work arrangement | Generous leave | Gym membership contribution | Learning and development budgetSenior-level Full TimeLondon, United Kingdom R1d ago
-
Analytics Engineer USD 100KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data LineageEnglish as office language | In person work 3 days per week | Relocation supportMid-level Full TimeBarcelona R1d ago