Lead Data Engineer (Cloud)
GB-ENG-LAN-Preston
GBP 55K Senior-level Full Time Found 10d ago
Tasks
- Build ingestion pipelines into lakehouse
- Develop Spark transformation jobs
- Implement manifest-driven transformation in JSON
- Maintain Delta Lake tables
- Orchestrate workflows in Airflow
- Troubleshoot pipeline performance and reliability
Perks/Benefits
- Employee share plans
- Flexible health benefits
- Green Car Scheme
- Pension scheme
- Potential annual incentive
- Private health plans
- Shopping discounts
- Wellbeing discounts
Skills/Tech-stack
Airflow | Azure | Cloud Computing | CosmosDB | Data Engineering | Data Governance | Data Quality | Databricks | Delta Lake | Enterprise Architecture | Hybrid environments | JSON | Metadata Management | MongoDB | Spark
Education
N/A
Language: en |
Views: 0 |
Clicks: 0
Related jobs
-
Lead Data Engineer GBP 72K-102KAnomaly Detection | Apache Airflow | Apache Spark | Automation | CI/CDSenior-level Full TimeBrentford, United Kingdom3d ago
-
Contract Lead Data Engineer GBP 85K-102KClient Relationship Management | Client relationship | Data Architecture | Data Engineering | Data platformSenior-level Full TimeManchester, England, United Kingdom5d ago
-
Agile | Automation | Big Data | Big Data Ecosystems | CI/CDSenior-level Contract Full TimeSheffield, England, United Kingdom5d ago
-
Senior-level Full TimeLondon, United Kingdom9d ago