Senior Azure Data Engineer (Databricks)
UK - Edinburgh; UK - Glasgow
GBP 75K-90K (estimate) Senior-level Full Time
Tasks
- Apply clean code and software engineering best practices
- Build CI/CD pipelines
- Build real-time streaming data pipelines
- Collaborate with clients to translate data needs into technical solutions
- Deploy scalable secure data solutions on Azure
- Design and develop data engineering pipelines
- Develop event driven ingestion with Kafka and Azure Event Hubs
- Implement data governance with Unity Catalog
Perks/Benefits
- Critical illness cover
- Cycle to work
- Dental insurance
- Gympass
- Health insurance
- Industry certifications
- Life insurance
- Paid leave
- Pension
- Season ticket loans
- Training
- Travel insurance
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | Azure Event | Azure Event Hubs | CI/CD | Data Lake | Data Lakehouse | Data Modeling | Databricks | Delta Lake | DevOps | Event Hubs | GDPR | GitHub Actions | Jenkins | Kafka | PySpark | Python | SQL | Schema Design | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Regions
Countries
States
Related jobs
-
Quantitative Developer, Global Delta One GBP 103K-127KAlgorithms | Asynchronous programming | Data Modeling | Data Processing | Data StructuresMid-level Full TimeLondon18h ago
-
AI Act | AI Governance | AWS Bedrock | Agent Orchestration | Agent deploymentRemote eligible in UK | Travel opportunitiesSenior-level Full TimeLondon, UK R19h ago
-
Vice President, AI / Machine Learning Software Engineer GBP 120K-154KArchitectural thinking | Data Modeling | Data Pipelines | Data Processing | Deep learningFlexible resources | Health benefits | Paid leave | Paid volunteer time | Wellbeing programsExecutive-level Full TimeManchester, Greater Manchester, United Kingdom19h ago
-
Analytics Engineer GBP 40K-45KApache Airflow | DBT | Data Governance | Data Modeling | Data PrivacyAnnual leave | Corporate gym membership | Cycle to work scheme | Dental insurance | Employee benefits platformMid-level Full TimeLondon, United Kingdom20h ago
-
Agentic Systems | Cloud Architecture | Data Structures | Data Structures and Algorithms | Distributed SystemsSenior-level Full TimeLondon, UK21h ago
-
Senior AI Engineer GBP 72K-85KAKS | Azure AI | CI/CD | Containerization | DockerElectric car scheme | Employee discounts | Family leave | Flexible working options | Healthcare planSenior-level Full TimeBrighton and Hove, England, United Kingdom21h ago
-
Data Engineer - Brook Green Supply GBP 46K-55KApache Airflow | Apache Kafka | Apache Spark | CI/CD | DagsterMid-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer, Python, Spark GBP 75K-90KAWS | Airflow | Data Modeling | GCP | HDFSCommuter benefits | Disability insurance | Financial wellness resources | Flexible remote work Fridays | Healthcare benefitsSenior-level Full TimeCambridge, United Kingdom1d ago
-
Senior Data Engineer, Python, Spark GBP 75K-90KAWS | Airflow | Data Modeling | GCP | HDFSDental insurance | Financial wellness support | Healthcare | Hybrid work | Life insuranceSenior-level Full TimeManchester, United Kingdom1d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Entrepreneurial team | Flexible remote distributed setting | Friendly atmosphereMid-level Full TimeOxford, United Kingdom1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly work environmentMid-level Full TimeBelfast, United Kingdom1d ago
-
Freelance Machine Learning Engineer USD 110KLangchain | Language Models | Large Language Models | MLOps | NumPyFreelance opportunities | Paid per project | Part-time project-based workMid-level FreelanceUnited Kingdom - Remote R1d ago
-
LLM | Langchain | MLOps | Machine Learning | Model DeploymentFreelance project work | Part-time schedule | Project-based paymentsMid-level FreelanceUnited Kingdom - Remote R1d ago
-
Bioinformatician GBP 44K-49KBioinformatics | Cloud Computing | Containerization | Data Quality | Data quality controlEnhanced holiday pay | Hospital Cash Plan | Income protection | Life assurance | PensionMid-level Full TimeOxford, England, United Kingdom1d ago
-
Data Platform Ops, Associate GBP 47K-50KAgentic Frameworks | Alerting | Automation | Containerization | DockerEducation reimbursement | Emotional wellbeing support | Family support programs | Flexible time off | Health resourcesMid-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R1d ago
-
Mid-level Full TimeNorth Wales, United States1d ago
-
Agentic AI | CI/CD | Code review | Data Engineering | Deep learningSenior-level Full TimeHomeworker - UK, United Kingdom1d ago
-
Data Engineer GBP 50K-60KCapacity Management | Data Governance | Data Modelling | Databricks | Metadata ingestionCareer progression | Flexible hours | Hybrid workingMid-level Full TimeLondon - One Creechurch Place, United …1d ago
-
AI Science Consultant GBP 46K-46KArtificial Intelligence | Context engineering | Data Engineering | Fine Tuning | Language ModelsConference opportunities | Flexible working arrangements | Mentorship | Training opportunitiesMid-level Full TimeLondon, United Kingdom1d ago
-
Digital and AI Solution Lead GBP 58K-70KAgentic AI | Automation | Cause analysis | Data Engineering | Data platformCycle scheme | Flexible working | Life assurance | Pension scheme | Perk At Work Discount SchemeSenior-level Full TimeCheshire-Warrington, UK1d ago
-
Member of Technical Staff (Robotics Research Lead) GBP 250K-270K3D Perception | 3D Reconstruction | C++ | Computer Vision | Deep learningSenior-level Full TimeUK, Remote R1d ago
-
Benchmarking | C++ | CUDA | OpenCL | Operator fusionHybrid work | Work from homeSenior-level Full TimeLondon1d ago
-
Analytics Engineer GBP 27K-27KAmazon Redshift | BigQuery | DAG | Data Modeling | Data TransformationCommunity programs | Convenience benefits | Family benefits | Finance benefits | Growth opportunitiesMid-level Full TimeLondon - The River Building HQ1d ago
-
AWS | Ansible | As-a-Service | Authentication | AutomationOn-call rotation support | RSUsSenior-level Full TimeLondon, United Kingdom1d ago
-
AWS | Ansible | Authentication | CDC | CI/CDMid-level Full TimeLondon, United Kingdom1d ago