Data Engineer
Manchester, NorthWest M1, United Kingdom
GBP 50K-60K (estimate) Mid-level Full Time
Tasks
- Automate and standardize data engineering workflows
- Build data pipelines with Spark
- Collaborate with analysts and BI developers
- Create automated data quality checks
- Design Gold layer data models
- Develop medallion architecture
- Document pipelines and architectural decisions
- Implement data quality exception reporting
- Implement data quality rules
- Improve pipeline performance and reliability
- Maintain Databricks platform
- Maintain data lineage documentation
- Manage data access controls
- Monitor and troubleshoot pipeline failures
- Support data governance and metadata
Perks/Benefits
- Annual discretionary bonus scheme
- Cash back healthcare scheme
- Company contributory pension scheme
- Cycle to work scheme
- Employee assistance programme
- Enhanced family-friendly policies
- Hybrid working
- Life assurance
- Staff referral scheme
- Subsidised gym membership
Skills/Tech-stack
ADLS | AWS | Apache Spark | Azure | Azure Key Vault | Azure SQL | Azure SQL Database | Data Governance | Data Lineage | Data Modeling | Data Quality | Data orchestration | Databricks | Delta Lake | GCP | Key Vault | Power BI | Python | REST APIs | SQL | SQL Database
Education
N/A
Roles
Related jobs
-
Lead Software Developer (AI Solutions) GBP 24K-24K.NET | AI Agent | AI agent orchestration | API Development | ASP NETProfessional developmentSenior-level Full TimeOxford, England, United Kingdom11h ago
-
Data Science Manager GBP 55K-65KAzure | Data Mining | Databricks | Language Processing | Machine LearningCross-functional collaboration | MentorshipMid-level Full TimeLondon, United Kingdom21h ago
-
Automation | C++ | Collateral Management | Econometrics | Funding risk30 days holiday | Coaching | Flexible working | Hybrid working | Life assuranceMid-level Full TimeLondon, 21 Moorfields, United Kingdom R21h ago
-
Agile | Analytics Cloud | Autonomous Data Warehouse | Business Intelligence | CI/CDMid-level ContractLondon - CG21h ago
-
Entry-level Full TimeLondon, United Kingdom21h ago
-
Applied AI ML Lead - Python & Agentic AI GBP 81K-109KAWS | AWS Bedrock | Agentic AI | Amazon SageMaker | CI/CDSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Senior ML Engineer - Kimchi (LLM Inference Optimization GBP 110K-141KActivations quantization | Amazon Web Services | ArgoCD | CUDA | CUDA-adjacent toolingEquipment budget | Equity options | Extra days off | Hackathon | Learning budgetSenior-level Full TimeUnited Kingdom R1d ago
-
Senior-level Full TimeBelfast1d ago
-
Lead Machine Learning Engineer GBP 90K-115KAWS | Azure | Cloud Computing | Docker | GCPCoaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeLondon1d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Opportunity to impact millions | Remote/distributed teamMid-level Full TimeLondon, United Kingdom1d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Friendly work environment | Remote/distributed workMid-level Full TimeBristol, United Kingdom1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote workMid-level Full TimeLeeds, United Kingdom1d ago
-
Senior AI Engineer GBP 70K-90KAI Model Garden | AI Studio | AKS | Azure AI | Azure AI StudioFlexible hybrid working | Health and wellness benefits | Learning and development supportSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer GBP 70K-95KAWS Athena | Apache Airflow | Apache Druid | Apache Hive | Apache SparkSenior-level Full TimeLondon, United Kingdom2d ago
-
AI Engineer GBP 60K-60KAWS | Agile | Airflow | Apache Spark | AutogenAnnual leave | Company socials | Development Training Time | EAP support | Enhanced parental leaveMid-level Full TimeLondon, England, United Kingdom2d ago
-
Senior Applied Scientist GBP 105K-135KBlack | Cloud Computing | Complex reasoning | Data Analysis | Deep learningHybrid work | Remote work days | Share options | Slack | Zoom)Senior-level Full TimeLondon2d ago
-
Staff Applied Scientist GBP 225K-325KCloud Computing | Complex Planning | Data Analysis | Deep learning | GitHybrid work arrangement | Mentoring and coaching culture | Share optionsSenior-level Full TimeLondon2d ago
-
Freelance Machine Learning Engineer USD 110KLangchain | MLOps | NumPy | Pandas | Prompt engineeringPart-time opportunities | Project based workMid-level FreelanceUnited Kingdom - Remote R2d ago
-
Langchain | MLOps | NumPy | Pandas | Prompt engineeringFlexible part-time hours | Freelance project-based work | Paid per projectMid-level FreelanceUnited Kingdom - Remote R2d ago
-
Model Behavior Architect- Function Calling GBP 115K-190KAPI Design | Agentic Workflows | Automated testing | Data Generation | Function CallingHealth insurance | Meal vouchers | Parental leave | Sport allowance | Transportation allowanceSenior-level Full TimeLondon4d ago
-
AI Engineer GBP 72K-100KAPIs | Agent Orchestration | Agile | Cost Optimization | Data GovernanceHybrid work | Mentoring | Training and documentation support | Work from home daysMid-level Full Time TemporaryLondon, UK4d ago
-
Ansible | ArgoCD | Azure | Azure Blob | Azure Blob StorageHybrid work modeSenior-level Contract Full TimeSheffield, England, United Kingdom4d ago
-
Access Control | Amazon Redshift | BigQuery | CI/CD | Container ServicesInclusive work culture | Remote-friendlySenior-level Full TimeLondon4d ago
-
Lead Data Engineer GBP 64K-80KAWS Glue | Agile | DBT | Data Architecture | Data ModelingCollaborative leadership support | Engineering standards ownership | Full-time hours | Permanent contract | Remote within UKSenior-level Full TimeBideford, United Kingdom4d ago