Data Engineer (Databricks)
Tasks
- Build and maintain data pipelines
- Design data pipelines
- Escalate risks and issues
- Implement data quality checks
- Maintain runbooks and support documentation
- Manage data loads and controls
- Monitor and optimize data performance
- Provide technical solutions from stakeholder requirements
- Reconcile actuarial input data
- Resolve data exceptions
- Support data governance documentation
- Validate and transform policyholder data
Perks/Benefits
- Annual leave purchase
- Critical illness cover
- Flexible working arrangements
- Life assurance
- Paid Maternity Leave
- Paid parental leave
- Paid paternity leave
- Pension scheme
- Private healthcare
- Share incentive plan
- Share-save plan
- Workplace adjustments
Skills/Tech-stack
Apache Spark | Azure Databricks | Data Governance | Data Modeling | Data Quality | Data Validation | Database systems | PySpark | Python | SQL | Spark SQL
Education
N/A
Roles
Related jobs
-
Software Engineer, Machine Learning GBP 100K-130KData Structures | Data structures algorithms | Graph theory | Information Retrieval | Language ProcessingSenior-level Full TimeLondon, UK1h ago
-
Data Filtering | Data Processing | Data debugging | Deep learning | Distributed ComputingSenior-level Full TimeLondon, UK1h ago
-
Data Engineer GBP 723KAWS | AWS CDK | Amazon Redshift | Amazon Web Services | BitbucketBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Health cash planMid-level Full TimeManchester / Hybrid, England, United Kingdom R4h ago
-
Senior Staff Engineer (LLM) GBP 80K-109KAgent systems | Anthropic API | Authentication | Chunking | EmbeddingsSenior-level Full TimeRemote, United Kingdom R7h ago
-
Staff Analytics Engineer GBP 50K-70KAI tools | DBT | Data Modeling | Data Quality | Data TransformationEmployee referral programme | Flexible working | Health coverage | Hybrid/remote options | Office meals and snacksSenior-level Full TimeLondon R19h ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R20h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami21h ago
-
Senior-level Full TimeLondon, United Kingdom23h ago
-
Principal AI Engineer GBP 90K-115KAgentic Workflows | CI/CD | Cloud Computing | Experimentation | GuardrailsConference and training access | Flexible working hours | Global retreats | IT equipment budget | Learning budgetSenior-level Full TimeUnited Kingdom1d ago
-
Analytics Engineer USD 100KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data LineageEnglish as office language | In person work 3 days per week | Relocation supportMid-level Full TimeBarcelona R1d ago
-
Software Engineer, GenAI Platform GBP 29K-35KAPIs | Batch inference | Cost Optimization | Data Pipelines | DebuggingMid-level Full TimeLondon - The River Building HQ1d ago
-
APIs | AWS | Batch inference | Cost Optimization | DPOMid-level Full TimeLondon - The River Building HQ1d ago
-
C++ | Functional Programming | IRRBB | Interest Rate | Interest Rate RiskMid-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Principal Data Engineer GBP 52K-55KAnalytics Integration | Automation | Business Intelligence | Data Compliance | Data EngineeringAnnual leave | Career development | Contributory pension scheme | Cycle to work scheme | Employee assistance programmeSenior-level Full TimeUnited Kingdom1d ago
-
Lead Data Engineer GBP 52K-60KAzure Data | Azure Data Factory | Azure DevOps | Data Engineering | Data FactoryCycle to work scheme | Employee assistance programme | Flexible hours | Health and wellbeing support | Hybrid workSenior-level Full TimeUnited Kingdom1d ago
-
Lead AI Engineer GBP 72K-109KAI Pipelines | Agent systems | Autogen | Automl | BigQueryDeath-in-service benefit | Employee assistance programme | Free parking | Healthcare | Hybrid workingSenior-level Full TimeCrawley, England, United Kingdom1d ago
-
Data Platform Engineer GBP 75K-90KApache Airflow | Apache Iceberg | BigQuery | Cloud Composer | Cloud platformCareer development opportunities | Distributed team | International environment | Remote-first work | Welcoming supportive teamSenior-level Full TimeUnited Kingdom - Remote R1d ago
-
Lead Agentic AI Engineer GBP 78K-110KAI Foundry | API Development | Agent Framework | Agent systems | Agentic AIAccess to global technical resources | Learning and development | Mentorship | Paid certifications training hours | Real Time Technical SupportSenior-level Full TimeLondon, 30 Fenchurch Street, United Kingdom1d ago
-
Senior Data Engineer GBP 80K-90KAirflow | BigQuery | DBT | Data Contracts | Data ModelingHybrid workSenior-level Full TimeFleet Place Office, United Kingdom1d ago
-
MLOps Engineer GBP 57K-62KA/B | A/B Testing | B testing | Data Pipelines | Data StreamingAccess to online courses | Hackathons | Peer Recognition Portal | Training and developmentMid-level Full TimeLondon, GB1d ago
-
Fixed Probing & Analytics Engineer GBP 27K-27KAnalytics Integration | Data Ingestion | Data Modeling | Data Processing | Data StorageAnnual leave | Charity days | Cycle to work | Discounts | Discretionary bonusMid-level Full TimeNewbury, GB1d ago
-
Graduate Machine Learning Engineer, AI GBP 33K-35KAWS | Adversarial Learning | Agile | Cloud platform | Data ScienceAnnual leave | Bank holidays | Cycle to work scheme | Equipment allowance | Hybrid workingEntry-level Full TimeCheltenham, England, United Kingdom1d ago
-
Machine Learning Engineer, AI (SFIA 3) GBP 56K-75KAWS | Adversarial Training | Azure | C++ | Cloud platformCycle to work scheme | Fully funded professional certifications | Gym discounts | Hybrid working | Paid study leaveMid-level Full TimeCheltenham, England, United Kingdom1d ago
-
Agile | Artificial Intelligence | Backend Development | C++ | Cloud PlatformsCross-functional collaboration | On-site flexibilityMid-level Full TimeLondon - CG; Manchester; Cheltenham1d ago
-
Mid-level Full TimeBelfast, GB2d ago