Senior Data Engineer - Azure / DataBricks / PySpark
London, United Kingdom
GBP 70K-100K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Collaborate on data architecture design
- Communicate technical designs
- Design data pipelines
- Implement data modeling and transformation
- Mentor data engineers
- Optimize data pipelines
- Support data governance practices
- Support data pipeline deployment
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Platform | Azure Synapse | Cloud Architecture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Pipeline Development | Data Quality | Data Quality Management | Data orchestration | Data pipeline | Data platform | Databricks | Environment Integration | Hybrid Environment | Hybrid environment integration | Performance Tuning | Pipeline Development | PySpark | Quality management
Education
Roles
Related jobs
-
Data Engineer 12 month FTC GBP 47K-56KAnalysis Services | Apache Spark | Artificial Intelligence | Azure Analysis | Azure Analysis ServicesCareer growth | Flexible working options | Work-life balanceEntry-level Contract Full Time TemporaryBirmingham, England, United Kingdom7h ago
-
Partnership Analytics Lead - 14 Months FTC GBP 70K-95KAzure Foundry | Copilot Studio | DBT | Data Modeling | Microsoft FabricHybrid work | Work from home daysSenior-level ContractLondon, England, United Kingdom R1d ago
-
Senior AI Engineer GBP 70K-90KAWS | AWS Bedrock | Agentic AI | Alembic | Amazon S3Employee assistance programme | Enhanced maternity leave | Extra annual leave | Group life assurance | Health & wellbeing platformSenior-level Full TimeBournemouth, United Kingdom1d ago
-
Lead Data Engineer GBP 80K-96KAWS | Agile | Apache Spark | CI/CD | Cloud platformAnnual leave | Cycle to work scheme | Discounted gym membership | Employer pension scheme | Family leaveSenior-level Full TimeEdinburgh1d ago
-
Data Engineer - Multi-Cloud GBP 38K-50KAWS | AWS Lambda | Agile | Amazon EC2 | Amazon EMRDeath in service cover | Electric vehicle leasing | Paid holiday | Pension scheme | Private medical coverMid-level Full TimeLondon, England, United Kingdom1d ago
-
Associate - Funds Data Stewardship GBP 44K-50KData Distribution | Data Governance | Data Quality | Excel | MiroEducation reimbursement | Emotional well-being support | Family support programs | Flexible time off | Hybrid work modelMid-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R1d ago
-
Senior Data Engineer GBP 80K-100KAI Search | Apache Spark | Azure AI | Azure AI Search | Azure DataAnnual leave | Employee assistance programme | Employee referral bonus | Enhanced maternity and paternity leave | Life assuranceSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Warehouse Engineer GBP 50K-55KAWS Glue | Agile | Alerting | Apache Airflow | CI/CDEmployee assistance program | Employee discounts | Family care leave | Flexible work-life balance | Flexible working hoursSenior-level Full TimeUK-Oxford (Nielsen House), United Kingdom1d ago
-
Senior Data Warehouse Engineer GBP 50K-55KAWS Glue | AWS Lambda | AWS SNS | AWS Secrets | AWS Secrets ManagerCommuting allowance | Employee assistance program | Employee discounts | Family care leave | Flexible working hoursSenior-level Full TimeUK-Oxford (Nielsen House), United Kingdom1d ago
-
Senior Systems Engineer, Data Management, London GBP 50K-70KAccess Control | Apache Airflow | Apache Kafka | Apache Spark | Business IntelligenceSenior-level Full TimeLondon, United Kingdom1d ago
-
Continuous integration | DBT | Data Lineage | Data Modeling | Data PartitioningAnnual leave | Birthday off | Critical illness cover | Cycle scheme | Enhanced parental leaveSenior-level Full TimeBristol, UK R2d ago
-
Senior Data Engineer - CFP Energy Group GBP 54K-67KApache Airflow | Apache Flink | Apache Kafka | Azure | ClickHouseSenior-level Full TimeLondon, England, United Kingdom2d ago
-
Senior Data Engineer - Real time analytics GBP 75K-100KAWS | AWS Glue | Amazon DMS | Amazon EKS | Amazon EMRCommute benefit | Competitive benefits | Fast-learning environment | Health coverage | Lunch benefitSenior-level Full TimeLondon Office2d ago
-
Data Engineer GBP 51K-51KAgile | Cognos | Data Modeling | Data integration | Data virtualizationEmployee wellbeing support | Flexible working arrangements | Hybrid working | Life assuranceSenior-level Full TimeGB-ENG-LAN-Warton2d ago
-
Senior Data Engineer - UK GBP 70K-80KAirflow | Amazon Redshift | BigQuery | DBT | DagsterEmployee stock options | Enhanced parental leave | Extra leave | Hybrid work | MacBook providedSenior-level Full TimeUK - HQ - London R2d ago
-
Data Engineer - UK GBP 55K-75KAmazon Redshift | Apache Airflow | BigQuery | DBT | DagsterEmployee stock options | Extra paid leave | Holiday allowance | Hybrid work | MacBook providedMid-level Full TimeUK - HQ - London R2d ago
-
Data Analyst GBP 26K-26KBigQuery | CI/CD | DBT | Data Modeling | Data PipelinesCompany events | Dental insurance allowance | Flexible working | Four day week option | Gym membership allowanceMid-level Full TimeLondon, England, United Kingdom R2d ago
-
Lead Analytics Engineer GBP 85K-110KAirflow | Apache Superset | Business Intelligence | DBT | Data ModelingFlexible working | Paid annual leave | Paid sabbatical | Paid sick leave | Parental leaveSenior-level Full TimeLondon, United Kingdom2d ago
-
Data Engineer - Design Configuration GBP 38K-50KAsset Management | Asset management systems | Change Control | Configuration Management | Data Integrity24 7 employee support line | Annual leave | Bank holidays | Buy and sell holiday | Company pension contributionsEntry-level Full TimeBristol, England, United Kingdom2d ago
-
Sr Data Engineer GBP 70K-86KAgile | Artificial Intelligence | Dashboarding | Data Lineage | Data ModelingFlexible working hours | Hybrid workSenior-level Full TimeGlasgow Campus, United Kingdom2d ago
-
Software Engineer - Python/Pyspark GBP 80K-106KAbinitio | Copilot | Data Engineering | Databricks | GitLabSenior-level Full TimeKnutsford, Radbroke Hall, United Kingdom2d ago
-
Machine Learning Engineer GBP 50K-60KAzure Machine Learning | CatBoost | Git | Keras | KubeflowFlexible work model | In-person collaborationMid-level Full TimeUK025 - Erskine,United Kingdom(UK025)2d ago
-
Senior Data Engineer GBP 78K-100KAirbyte | Automated testing | BigQuery | CI/CD | Cloud RunAnnual performance review | Birthday day off | Community volunteer days | Cycle to work scheme | Dog-friendly officeSenior-level Full TimeLondon, United Kingdom3d ago
-
Mid-level Full TimeLondon3d ago
-
Senior Advanced Analytics Engineer GBP 70K-90KAWS | Azure | Cloud Computing | Cloud platform | DBTCollaborative work environment | Growth opportunities | Professional developmentSenior-level Full TimeLondon, United Kingdom3d ago