Senior Data Engineer - Azure / DataBricks / PySpark
London, United Kingdom
GBP 70K-100K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Collaborate on data architecture design
- Communicate technical designs
- Design data pipelines
- Implement data modeling and transformation
- Mentor data engineers
- Optimize data pipelines
- Support data governance practices
- Support data pipeline deployment
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Platform | Azure Synapse | Cloud Architecture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Pipeline Development | Data Quality | Data Quality Management | Data orchestration | Data pipeline | Data platform | Databricks | Environment Integration | Hybrid Environment | Hybrid environment integration | Performance Tuning | Pipeline Development | PySpark | Quality management
Education
Roles
Related jobs
-
Mid-level Full TimeBelfast, ANTRIM, United Kingdom17h ago
-
Principal Data Engineer (Core Engineering) GBP 86K-109KAI | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksFlexible working | Inclusive environment | Pension scheme | Private medical insuranceSenior-level Full TimeEdinburgh, GB19h ago
-
Data Modeling | ETL | SQLCareer growth | Training | Work-life balanceEntry-level Full TimeLondon, England, GBR1d ago
-
Senior Data Platform Engineer GBP 67K-85KAWS | Airflow | Azure | CI/CD | DBTEmployee discounts | Flexible working | Health insurance | Mental wellbeing support | Paid parental leaveSenior-level Full TimeDepop - Remote, UK, United Kingdom R1d ago
-
Airflow | Dagster | Dashboard Development | Data Engineering | Data analyticsEmployee assistance program | Flexible working options | Generous annual leave | Income protection | Life assuranceSenior-level Full TimeLondon, United Kingdom1d ago
-
AI Platform Engineer GBP 72K-90KAPI Gateway | AWS | Agentic Frameworks | Amazon SageMaker | AutogenMid-level Full TimeGlasgow Campus, United Kingdom1d ago
-
ML Platform Engineer GBP 87K-109KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EventBridge | Amazon RedshiftSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Senior Data Engineer GBP 50K-70KAWS | AWS Step Functions | Amazon S3 | Amazon SQS | Apache AirflowContributory pension | Cycle to work | Dental coverage | Early Friday finish | Enhanced sick paySenior-level Full TimeManchester, Lancashire, United Kingdom1d ago
-
Apprenticeship - Data Engineer Level 5 GBP 23K-24KCommunication | Data Analysis | Data Governance | Data Management | Data PipelinesCareer development | Supportive environmentEntry-level Apprenticeship Full TimeDarlington, County Durham, United Kingdom1d ago
-
Data Governance | Data Modeling | Databricks | ETL | JiraSenior-level Full TimeBOURNEMOUTH, DORSET, United Kingdom1d ago
-
Senior Data Engineer GBP 67K-85KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOpsCareer development | Community events | Inclusive environment | Training opportunitiesSenior-level Full TimeUnited Kingdom, United Kingdom1d ago
-
Software Engineer III, AI/Machine Learning GBP 82K-118KC++ | Data Processing | Data pipeline | Debugging | Distributed ComputingSenior-level Full TimeLondon, UK1d ago
-
Data Engineer GBP 25K-36KAWS | Athena | CloudFormation | Data Modeling | Data ValidationBonus scheme | Car lease scheme | Discount programs | Healthcare cash plan | Holiday entitlementMid-level Full TimeRemote, United Kingdom R1d ago
-
APIs | CRM systems | DBT | Data Governance | Data ModelingFlexible working | Paid holiday | Pension scheme | Sick pay | Volunteering dayMid-level Full TimeUnited Kingdom2d ago
-
Real-Time Visual Data Analytics Specialist (Spotfire) - UK, Poland or South Africa (Home-based) - FSP GBP 42K-47KClinical data | Data Analysis | Data Visualization | Power BI | PythonFlexible work arrangement | Home-based roleMid-level Full TimeUnited Kingdom-London-Gridiron-Remote R2d ago
-
Data Engineer, Vice President GBP 115K-140KApache Airflow | CI/CD | Cloud Platforms | Data Governance | Data ModellingEducation reimbursement | Family support programs | Flexible time off | Health and wellness resources | Retirement plansExecutive-level Full TimeL14 - Verde Building, 10 Bressenden …2d ago
-
AI Mobilisation Lead GBP 81K-93KAWS | Apache Beam | Azure | Batch Processing | Cloud PlatformsFlexible working | Hybrid working | Parental leave | Pension | Performance bonusSenior-level Full TimeLondon 10 Gresham Street, United Kingdom2d ago
-
Data Engineer GBP 50K-56KAI | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQLCareer growth | Collaborative environment | Flexible working | Impactful workMid-level Full TimeBirmingham, England, United Kingdom2d ago
-
Data Governance | Data Modelling | Data Privacy | Data Quality | DatabricksExecutive-level Full TimeBOURNEMOUTH, DORSET, United Kingdom2d ago
-
Analytics Engineer GBP 45K-60KBusiness Intelligence | Dashboard Development | Data Manipulation | Data Modeling | Data PipelinesDigital nomad policy | Financial support | Flexi-time | Hybrid working | Mental health programsMid-level Full TimeLondon, United Kingdom2d ago
-
ASQL | Azure Synapse | CI/CD | Data Factory | Data ModelingMid-level Full TimeLondon, United Kingdom2d ago
-
Data Engineer GBP 40K-52KAWS | Azure | Cloud Platforms | Data Governance | Data ModelingFlexible benefits | Holiday entitlement | Life assurance | Pension | Performance share schemesMid-level Full TimeUnited Kingdom-London-London Luton Airport2d ago
-
Lead Data Analyst GBP 45KAzure DevOps | Data Cleansing | Data Modeling | Data Validation | Data VisualizationFlexible working | Hybrid work arrangementSenior-level Full TimeLeicester, Leicestershire, United Kingdom2d ago
-
Principal Data Scientist GBP 25K-27KClassification | Clustering | Data Governance | Data Pipelines | Data SecurityComprehensive health insurance | Flexible hybrid work model | Life insurance | Paid time off | PensionSenior-level Full TimeLONDON, United Kingdom2d ago
-
AWS | CI/CD | Data Lifecycle Management | Data Modeling | Data SecurityCareer growth opportunities | Collaborative work environmentSenior-level Full TimeLONDON, LONDON, United Kingdom2d ago