Senior Data Engineer (Databricks)
London, England, United Kingdom
GBP 72K-80K (estimate) Senior-level Full Time
Tasks
- Build data models and transformations
- Deploy and manage code via CI CD
- Design develop optimize data pipelines
- Ensure data quality
- Ensure data security and compliance
- Implement monitoring and logging
- Rectify production pipeline failures
- Troubleshoot data processing challenges
- Troubleshoot production data pipelines
Perks/Benefits
Skills/Tech-stack
AWS | AWS DMS | Amazon S3 | CI/CD | Compliance | Data Governance | Data Modeling | Data pipeline | Databricks | Delta Lake | Logging | Monitoring | Performance Tuning | PySpark | Security | Spark SQL
Education
N/A
Roles
Related jobs
-
Amazon S3 | Data Ingestion | Data Modeling | Data Pipelines | Data TransformationSenior-level Full TimeLondon9h ago
-
Senior Associate, IT, AI Engineer (Mid Level) GBP 70K-90KAWS | AWS Strands | Agent Frameworks | Agent Service | Azure AIHybrid working | Learning and development | Supportive team environmentMid-level Full TimeLondon, England, United Kingdom10h ago
-
Lead Data Scientist GBP 75K-75KAzure DevOps | CI/CD | Data Lakes | Data Warehousing | Distributed ComputingAnnual leave | Career breaks | Income protection | Life assurance | PensionSenior-level Full TimeEdinburgh, Scotland, United Kingdom12h ago
-
Data Engineer GBP 30K-30KAI tools | AWS | AWS CDK | AWS Cloud | AWS cloud infrastructureBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Free onsite gymEntry-level Full TimeManchester / Hybrid, England, United Kingdom R13h ago
-
Software Engineer, Embedded UI - C++ GBP 70K-88KC++ | CI/CD | Concurrency | Continuous integration | Debugging401k retirement options | Health benefits | Hybrid work option | Paid time off | Remote work flexibilitySenior-level Full TimeCambridge, United Kingdom18h ago
-
AWS | Ansible | Azure | Blue-Green Deployment | Blue/greenEquity | Flexible working | Home office stipend | Paid vacation | Remote workSenior-level Full TimeLondon, England, United Kingdom - Remote R22h ago
-
Senior Data Engineer GBP 70K-80KAWS | Amazon Redshift | DBT | Data Governance | Data LakeHybrid work modelSenior-level Full TimeGlasgow Campus, United Kingdom22h ago
-
Data Engineer GBP 40K-49KApache Spark | Cloud infrastructure | Data Architecture | Data Lineage | Data ModelingFlexible first working arrangement | Growth opportunities | Hybrid work | Total rewards for health and wellbeingMid-level Full TimeUK - Leicester - Spinneyside, United …22h ago
-
Senior Data Engineer GBP 43K-52KAWS | Azure | Data Architecture | Data Modeling | Data QualityCareer development | Flexible work | MentorshipSenior-level Full TimeUK - Leicester - Spinneyside, United …22h ago
-
AI Solution Architect/ Engineer - Senior Manager GBP 72K-90KAWS Bedrock | Agile methodology | Amazon SageMaker | Artificial Intelligence | Azure Machine LearningPrivate medical cover | Qualified Virtual GP | Volunteering daysSenior-level Full TimeLondon - 7 Morelondon Riverside, United …22h ago
-
Applied AI Engineer GBP 100K-125KASR | Adversarial Testing | Azure | Barge In | ElevenLabsHybrid work | In-person work | Remote workMid-level Full TimeRemote (UK), United Kingdom R22h ago
-
Data Engineer GBP 64K-74KAccess Control | Alerting | Batch Processing | Data Contracts | Data GovernanceSenior-level Full TimeLeeds, United Kingdom22h ago
-
Mid-Senior Data Engineer (GCP, Python, BigQuery) GBP 75K-85KAPI Gateway | BigQuery | CI/CD | Cloud Run | Cloud SQLCompany pension scheme | Free flu jab | Hybrid working model | Paid time off | Private healthcareSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 86K-120KA/B | A/B Testing | API Development | B testing | CI/CDSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior AI Engineer GBP 90K-120KAPI Development | Agentic Workflows | CI/CD | Embedding Models | Generative AISenior-level Full TimeLondon, United Kingdom1d ago
-
Machine Learning Engineer GBP 78K-103KAmazon SageMaker | Amazon Web Services | Apache Beam | Apache Spark | CI/CDCycle to work scheme | Employee assistance program | Flexible working options | Headspace access | Health cash planSenior-level Full TimeEdinburgh1d ago
-
Machine Learning Engineer GBP 78K-100KAWS | Apache Beam | Apache Spark | Azure | CI/CDCycle to work scheme | Employee assistance plan | Headspace access | Health cash plan | Life insuranceSenior-level Full TimeLondon1d ago
-
Data & Analytics Engineer GBP 70K-89KAgile | Azure DevOps | CI/CD | Csharp | Data GovernanceBackground checks | Hybrid workSenior-level Full TimeYork, United Kingdom, Hybrid R1d ago
-
Cloud Data Engineer GBP 35K-35KAWS | AWS Glue | Alteryx | Amazon Athena | Amazon RDSAdditional annual leave purchase | Healthcare | Hybrid working | Paid time off | PensionEntry-level Full TimeNottingham, England, United Kingdom1d ago
-
Data Engineering Lead GBP 115K-145KBigQuery | Cloud Native | DBT | Data Architecture | Data EngineeringApple hardware | Enhanced family leave | Paid time off | Pension contribution | Private medical insuranceSenior-level Full TimeLondon1d ago
-
Senior-level Full TimeUnited Kingdom1d ago
-
Applied AI ML Associate GBP 78K-109KCI/CD | Compliance | Data pipeline | Database Design | Database ModelingGuidance from technical mentors | Learning and growthEntry-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Data Engineer GCP (Remote) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Data ModelingRemote workEntry-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
AI Engineer - Contract Inside IR35 - 3-6 months GBP 70K-80KAPIs | CI/CD | Computer Vision | DevOps | Distributed SystemsSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer - Manager GBP 45K-51KAgile | Amazon Web Services | Apache Airflow | Apache Spark | AzureClient site flexibility | Flexible work schedule | Private medical cover | Virtual GP access | Volunteering daysMid-level Full TimeBirmingham - Chamberlain Square, United Kingdom1d ago