Senior Azure Data Engineer (Databricks)
UK - Edinburgh; UK - Glasgow
GBP 75K-90K (estimate) Senior-level Full Time
Tasks
- Apply clean code and software engineering best practices
- Build CI/CD pipelines
- Build real-time streaming data pipelines
- Collaborate with clients to translate data needs into technical solutions
- Deploy scalable secure data solutions on Azure
- Design and develop data engineering pipelines
- Develop event driven ingestion with Kafka and Azure Event Hubs
- Implement data governance with Unity Catalog
Perks/Benefits
- Critical illness cover
- Cycle to work
- Dental insurance
- Gympass
- Health insurance
- Industry certifications
- Life insurance
- Paid leave
- Pension
- Season ticket loans
- Training
- Travel insurance
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | Azure Event | Azure Event Hubs | CI/CD | Data Lake | Data Lakehouse | Data Modeling | Databricks | Delta Lake | DevOps | Event Hubs | GDPR | GitHub Actions | Jenkins | Kafka | PySpark | Python | SQL | Schema Design | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Regions
Countries
States
Related jobs
-
AI Engineer GBP 70K-96KAccess Control | Azure | Azure AI | CI/CD | ClaudeCareer follow-up | Certification support | Continuous learning opportunities | Flexible schedule | Remote working policyMid-level Full TimeLondon, England, United Kingdom9h ago
-
Senior Data Engineer - Infra GBP 68K-85KApache Airflow | Apache Kafka | Apache Spark | ClickHouse | GrafanaSenior-level Full TimeLondon, England, GB10h ago
-
Mid-level Full TimeLondon, United Kingdom12h ago
-
Data Engineer (Crypto) 12mth FTC-1 GBP 53K-73KAWS EventBridge | AWS Glue | AWS Lambda | AWS Redshift | AWS Step FunctionsEmployee assistance program | Flexible benefits | Hybrid work | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R21h ago
-
Entry-level Full TimeGlasgow Campus, United Kingdom21h ago
-
Data Engineer GBP 39K-39KAmazon Redshift | Amazon Web Services | Apache Spark | CI/CD | Cloud platformEducation grant for private schooling | Flexible working arrangements | Free shuttle bus to work | Generous time off | Hybrid workingMid-level Full TimeHinxton, United Kingdom21h ago
-
Senior Data Platform Engineer GBP 65K-80KAutomation | Azure | Azure CLI | Azure IaaS | Azure PaaS401k | Company discounts | Employee assistance program | Health care benefits day 1 | Paid time offSenior-level Full TimeQVC - Knowsley, United Kingdom21h ago
-
DevOps Engineer GBP 80K-109KAWS | Ansible | CloudFormation | Containers | Continuous DeploymentBlameless postmortems | On-call rotationSenior-level Full TimeLondon, United Kingdom21h ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Staff Applied Scientist GBP 200K-225KCloud Computing | Data Analysis | Deep learning | Git | GitHubHybrid work schedule | Mentoring & coaching | Share optionsSenior-level Full TimeLondon1d ago
-
Senior Data Engineer GBP 70K-80KAmazon Redshift | BigQuery | DBT | Data Modeling | Data PipelinesGlobal opportunities | Inclusive onboarding | Supportive work culture | Wellness programSenior-level Full TimeLondon, England, United Kingdom1d ago
-
CAMB | Computational physics | DOLFINx | Element analysis | FenicsFreelance opportunities | Part-time project work | Project-based engagementSenior-level FreelanceUnited Kingdom - Remote R1d ago
-
Data Engineer GBP 80K-95KAWS | AWS CDK | AWS CloudFormation | AWS Step Functions | AirflowCollaborative & Inclusive Culture | Flexible working | Professional development | Work-life balanceSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer, Ads Auction Platform GBP 75K-91KA/B | A/B Testing | Apache Airflow | B testing | Batch ProcessingCommuter benefits | Health benefits | Paid time off | Remote work flexibility | Retirement benefitsSenior-level Full TimeManchester, United Kingdom2d ago
-
Data Engineer, Ads Auction Platform GBP 75K-91KAirflow | Batch Processing | Data Modeling | Dimensional Modeling | Distributed ComputingCommuter benefits | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeCambridge, United Kingdom2d ago
-
Forward Deployed Engineer GBP 111K-122KAngular | Application deployment | Application development | Artificial Intelligence | BackboneMid-level Full TimeLondon, Greater London, England, United Kingdom2d ago
-
Machine Learning Engineer GBP 90K-115KAWS | Azure | Cloud Architecture | Docker | ExperimentationCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeLondon3d ago
-
Lead Data Engineer - Audience Measurement GBP 60K-65KAWS | Agile | Containers | Data Contracts | Event DrivenAnnual leave | Flexible working | Health and wellbeing benefits | Hybrid work | Income protectionSenior-level Full TimeCambridge, England, United Kingdom3d ago
-
Data Analyst (Analytics Engineer) GBP 69K-80KCloud Data | Cloud data platform | DBT | Data Lineage | Data ModelingElectric car scheme | Employee discounts | Family leave | Flexible working options | Healthcare planSenior-level Full TimeCardiff, Wales, United Kingdom3d ago
-
Data Analyst (Analytics Engineer) GBP 69K-80KDBT | Data Lineage | Data Modeling | Data Quality | Data Quality TestingElectric car scheme | Employee discounts | Family leave | Flexible working | Generous pension contributionSenior-level Full TimeBrighton and Hove, England, United Kingdom3d ago
-
Principal Software Engineer, AI Innovation GBP 55K-70KAI Agents | API Management | Artificial Intelligence | AutoAI | Cloud ComputingSenior-level Full TimeLondon, United Kingdom3d ago
-
Lead Data Engineer GBP 70K-100KAmazon Redshift | Amazon Web Services | Apache Airflow | BigQuery | Cloud ComputingCertification support | Charity Volunteer Opportunities | Professional development | Training opportunitiesSenior-level Full TimeManchester, Amsterdam, Rotterdam, Budapest3d ago
-
Senior Data Engineer GBP 70K-90KAWS | Airflow | Azure | BigQuery | DBTAnnual charity volunteering month | Flexible-hybrid work | Training and developmentSenior-level Full TimeManchester, Amsterdam, Rotterdam, Budapest3d ago
-
Senior Platform & AI Engineer GBP 76K-90KAzure OpenAI | Azure Pipelines | Branch protection | CI/CD | Code reviewFlexible workSenior-level Full TimeLondon, United Kingdom3d ago