Senior Azure Data Engineer (Databricks)
UK - Edinburgh; UK - Glasgow
GBP 75K-90K (estimate) Senior-level Full Time
Tasks
- Apply clean code and software engineering best practices
- Build CI/CD pipelines
- Build real-time streaming data pipelines
- Collaborate with clients to translate data needs into technical solutions
- Deploy scalable secure data solutions on Azure
- Design and develop data engineering pipelines
- Develop event driven ingestion with Kafka and Azure Event Hubs
- Implement data governance with Unity Catalog
Perks/Benefits
- Critical illness cover
- Cycle to work
- Dental insurance
- Gympass
- Health insurance
- Industry certifications
- Life insurance
- Paid leave
- Pension
- Season ticket loans
- Training
- Travel insurance
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | Azure Event | Azure Event Hubs | CI/CD | Data Lake | Data Lakehouse | Data Modeling | Databricks | Delta Lake | DevOps | Event Hubs | GDPR | GitHub Actions | Jenkins | Kafka | PySpark | Python | SQL | Schema Design | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Regions
Countries
States
Related jobs
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom18h ago
-
Applied AI Engineer GBP 85K-110KA/B | A/B Testing | Anthropic | B testing | ExperimentationFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetMid-level Full TimeUnited Kingdom R1d ago
-
Lead AI Engineer (AI Systems & Automation) GBP 78K-109KAlerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetSenior-level Full TimeUnited Kingdom R1d ago
-
Applied AI Engineer GBP 70K-85KCloud Computing | Data Modeling | Deep learning | Docker | LLM DeploymentFully expensed tech | Meal allowance | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom2d ago
-
Forward Deployed Engineer - Defence GBP 65K-90KAngular | Artificial Intelligence | Full Stack | Full-Stack Development | GitEqual opportunity | Technical training | Travel as neededMid-level Full TimeLondon, Greater London, England, United Kingdom2d ago
-
Consulting Systems Engineer, Data Management (EMEA) GBP 75K-101KAWS | Ansible | Apache Kafka | Azure | Cloud hybridCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeRemote, United Kingdom R3d ago
-
Senior AI/ML engineer GBP 120K-150KAWS | CI/CD | Databricks | Deep learning | Delta LakeAccelerated professional growth | Enhanced parental leave | Female health leave | Fully paid sabbatical | Health pension wellbeing benefitsSenior-level Full TimeLondon R3d ago
-
Lead Software Engineer - Python, Databricks, AWS GBP 72K-100KAWS | AWS Step Functions | Agile | Airflow | Apache SparkSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom3d ago
-
Software Engineer II - Applied AI GBP 57K-70KAI Applications | AWS | Amazon SageMaker | Azure | Cloud NativeMid-level Full TimeLONDON, LONDON, United Kingdom3d ago
-
Market Data Engineer GBP 58K-108KAeron | Apache Arrow | Bloomberg | ClickHouse | FASTCareer development and internal mobility | Discretionary bonus | Group life insurance | Gym discounts | Holiday allowanceMid-level Full TimeLondon, United Kingdom3d ago
-
Junior Analytics Engineer GBP 30K-35KArtificial Intelligence | DBT | Data Modeling | Data pipeline | ELTCycle to work scheme | Electric vehicle salary sacrifice | Employee referral program | Flexible working | Office meals and snacksEntry-level Full TimeLondon R3d ago
-
Alteryx | Business Requirements | Data Analysis | Data Reconciliation | Data TransformationFlexible resources | Paid leave | Paid volunteer time | Wellbeing programsExecutive-level Full TimeManchester, Greater Manchester, United Kingdom3d ago
-
Digital Chemist - Lab Automation & Data Science GBP 28K-28KData Analysis | Data Processing | Data Visualization | Hardware Integration | Laboratory automationBonus scheme | Life insurance | Paid time off | Pension plan | Private medical insuranceMid-level Full TimeBracknell, BERKSHIRE, United Kingdom3d ago
-
Analytics Engineer GBP 75K-90KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data ModellingEnglish language at office | In person 3 days per week | Relocation supportMid-level Full TimeLondon R3d ago
-
API Integration | Agent systems | Cloud Architecture | Cost Optimization | Data PipelinesSenior-level Full TimeLondon, UK3d ago
-
Research Engineer, Quantum Computing, DeepMind GBP 45K-60KAgentic AI | Algorithms | Data Structures | Language Models | Language ProcessingMid-level Full TimeLondon, UK3d ago
-
Principal Data Engineer GBP 90K-103KCI | CI/CD | DBT | Data Contracts | Data ManagementCareer Development Programs | Collaborative culture | Flexible time off | Flexible work schedules | Health and wellness benefitsSenior-level Full TimeAntrim, Northern Ireland, United Kingdom; Remote- … R3d ago
-
API Design | Agile | Airflow | Application Resiliency | Automated testingCareer growth | Diversity inclusion respect | MobilitySenior-level Full TimeLONDON, LONDON, United Kingdom3d ago
-
Machine Learning Engineer GBP 55K-55KAzure ML | Clustering | Data Monitoring | Decision Trees | DevOpsCoaching and mentoring opportunities | Hybrid workingMid-level Full TimeManchester, Greater Manchester, United Kingdom3d ago
-
CI/CD | Containerization | Data Pipelines | Data parallelism | Deep learningEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom3d ago
-
Growth Analytics Engineer GBP 57K-70KAmazon Redshift | Analytics engineering | Cohort Analysis | DBT | Data ModelingMid-level Full TimeLondon, United Kingdom3d ago
-
Staff Applied Scientist GBP 150K-190KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningFlexible work schedule | Hybrid work model | Stock options | Team daysSenior-level Full TimeLondon3d ago
-
Senior-level Full TimeHomeworker - UK, United Kingdom3d ago
-
Senior-level Full TimeHomeworker - UK, United Kingdom3d ago
-
AWS | Azure | Computer Vision | Docker | GCPContributory pension scheme | Cycle to work | Dental coverage | Enhanced family leave | Enhanced sick paySenior-level Full TimeGloucester, South Gloucestershire, United Kingdom3d ago