Data Engineer
Manchester, NorthWest M1, United Kingdom
GBP 50K-60K (estimate) Mid-level Full Time
Tasks
- Build and enhance data pipelines with Spark
- Collaborate with analysts developers and stakeholders on data requirements
- Continuously improve pipeline performance reliability and maintainability
- Define and implement data quality rules and validations
- Design Gold layer data models for analytics
- Develop automated data quality checks and exception reports
- Develop transformation enrichment and aggregation logic
- Document pipelines data models and architectural decisions
- Ensure data access controls and security measures
- Implement Medallion Architecture layers
- Implement data governance standards and metadata management
- Maintain Databricks data platform
- Maintain data lineage documentation
- Monitor troubleshoot pipeline failures and data issues
Perks/Benefits
- Annual discretionary bonus scheme
- Cash back healthcare scheme
- Company contributory pension scheme
- Cycle to work scheme
- Employee assistance programme
- Enhanced family-friendly policies
- Hybrid working
- Life assurance
- Staff referral scheme
- Subsidised gym membership
Skills/Tech-stack
API | Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key Vault | Azure SQL | Azure SQL Database | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Data orchestration | Databricks | Delta Lake | Key Vault | Power BI | Python | SQL | SQL Database
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeStoke-on-Trent, England, United Kingdom11h ago
-
AI Engineer GBP 45K-50KAI Search | Azure AI | Azure AI Search | Azure OpenAI | DatabricksAbility to purchase additional annual leave | Annual leave | Discretionary bonus scheme | Employee assistance program | Employee share purchase planMid-level Full TimeLondon, United Kingdom12h ago
-
Junior Data Engineer GBP 30K-34KCyber Security | Data Assurance | Data Engineering | Data Governance | Data IngestionEntry-level Full TimeManchester, Greater Manchester, United Kingdom13h ago
-
Agentic AI Engineer, AI Automation GBP 70K-89KAI Search | AWS | Agents SDK | Autogen | AzureAdditional paid time off | Employee resource groups | Flexible working hours | Hybrid work model | Modern Health App accessMid-level Full TimeLondon14h ago
-
Senior Controls & Robotics Engineer GBP 50K-65KAPM | Electrical schematics | EthernetIP | Fieldbus | HMISenior-level Full TimeNewport, Wales, GB, NP19 4XJ21h ago
-
Mid-level Full TimeCanary Wharf, 1 Churchill Place, United …21h ago
-
Defence Analytics Engineer GBP 40K-71KArtificial Intelligence | C Sharp | Data analytics | Machine Learning | PythonBonus scheme | Coursera access | Financial advice | Flexi days | Flexible benefitsNone Full TimeGB - London - Whitehall, United …21h ago
-
Defence Analytics Engineer GBP 40K-71KAerodynamics | C# | C++ | Computer Modeling | Guidance and controlBonus scheme | Dental coverage | Employee networks | Extra flexi days | Financial adviceEntry-level Full TimeGB - London - Whitehall, United …21h ago
-
Applied AI Engineer GBP 72K-93KAgentic Systems | CI/CD | Drift Detection | Embeddings | Inference PipelinesHybrid workSenior-level Full TimeLondon, United Kingdom21h ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Analytics GA4 | Azure | Cloud Computing | DashboardsHybrid workMid-level Full TimeUnited Kingdom R22h ago
-
Data Engineering Lead - Value & Analytics GBP 38K-46KAWS | Azure | Cloud Architecture | Cybersecurity | Data GovernanceHybrid workSenior-level Full TimeUnited Kingdom R22h ago
-
Software Engineer - Data Infrastructure GBP 45K-52KAWS | Amazon SQS | Batch Processing | BigQuery | Data IngestionMid-level Full TimeLondon1d ago
-
Compliance Governance Data Scientist GBP 53K-81KDashboarding | Data Modeling | Data Pipelines | GRC | Key Risk IndicatorsMid-level Full TimeLondon, United Kingdom1d ago
-
Algorithms | C plus plus | Data Structures | Java | Machine LearningExecutive-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
AWS | Agile | Apache Spark | Azure | BitbucketExecutive-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
API Management | Apache Spark | Azure API | Azure API Management | Azure DataSenior-level Contract Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Mid-level Full TimeTrimble Offices, Morley1d ago
-
AI Engineer GBP 70K-96KAccess Control | Azure | Azure AI | CI/CD | ClaudeCareer follow-up | Certification support | Continuous learning opportunities | Flexible schedule | Remote working policyMid-level Full TimeLondon, England, United Kingdom1d ago
-
Cloud Data Platform Software Engineer II GBP 72K-94KAWS Glue | Agile | Amazon Kinesis | Amazon Redshift | Apache BeamCareer growth opportunities | Diversity and inclusion culture | Learning opportunitiesEntry-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Engineer - Infra GBP 68K-85KApache Airflow | Apache Kafka | Apache Spark | ClickHouse | GrafanaSenior-level Full TimeLondon, England, GB1d ago
-
Mid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer (Crypto) 12mth FTC-1 GBP 53K-73KAWS EventBridge | AWS Glue | AWS Lambda | AWS Redshift | AWS Step FunctionsEmployee assistance program | Flexible benefits | Hybrid work | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R1d ago
-
Entry-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer GBP 39K-39KAmazon Redshift | Amazon Web Services | Apache Spark | CI/CD | Cloud platformEducation grant for private schooling | Flexible working arrangements | Free shuttle bus to work | Generous time off | Hybrid workingMid-level Full TimeHinxton, United Kingdom1d ago
-
Senior Data Platform Engineer GBP 65K-80KAutomation | Azure | Azure CLI | Azure IaaS | Azure PaaS401k | Company discounts | Employee assistance program | Health care benefits day 1 | Paid time offSenior-level Full TimeQVC - Knowsley, United Kingdom1d ago