Data lake Engineer
Tasks
- Apply security governance RBAC encryption and data masking
- Architect medallion data platform
- Build API-based data integrations
- Deliver production ready data products
- Design and implement distributed data processing pipelines
- Enforce data quality monitoring and validation
- Implement DevOps practices with CI/CD
- Mentor engineers and define technical standards
- Optimize clusters for cost and performance
- Orchestrate and schedule data workflows
Perks/Benefits
- Affinity network membership
- Career development
- Cycle2work scheme
- Discounted gym membership
- Discounts portal
- Family-friendly policies
- Flexible benefits
- Hybrid working
- Paid Holidays
- Pension scheme
- Social impact days
- Training opportunities
Skills/Tech-stack
ADLS | API Integration | Airflow | Autoscaling | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CD | Cluster tuning | Data Factory | Data Ingestion | Data Observability | Data Quality | Data encryption | Data masking | Databricks Workflows | Delta Lake | ETL | Git Flow | GitHub | Infrastructure as Code | Low Latency | Low Latency Data Ingestion | Low-latency data | Medallion Architecture | PySpark | Python | RBAC | SQL | Serverless Pools | Serverless computing | Spot instances | TDD | Workload Refactoring | “as-code”
Education
N/A
Roles
Related jobs
-
Data Operations Engineer GBP 30K-35KAWS | CI/CD | Cloud Security | Data Compliance | Data GovernanceEntry-level Full TimeLondon, England, United Kingdom3h ago
-
Machine Learning Engineer GBP 26K-26KA/B | A/B Testing | Algorithm Design | B testing | Data ProcessingContinuous learning | Flexible working | High-ownership environment | Hybrid workingMid-level Full TimeLondon - The River Building HQ14h ago
-
Machine Learning Engineer GBP 50K-50KAWS | Class imbalance | DBT | Forecasting | Hyperparameter TuningAdditional holiday option | ClassPass membership | Enhanced family leave | Equity options | Flexible bank holidaysMid-level Full TimeLondon15h ago
-
Audio Processing | Classification | Computer Vision | Data Quality | JAXWork from home flexibilitySenior-level Full TimeLondon21h ago
-
Data Engineer (Cloud) GBP 52K-52KApache Airflow | Apache Spark | Azure | CI/CD | Data GovernanceHybrid workingMid-level Full TimeGB-ENG-LAN-Preston R22h ago
-
AI Engineer GBP 52K-54KAI Search | Azure AI | Azure AI Search | CI/CD | DatabricksHybrid work arrangementsSenior-level Full TimeGB-ENG-LAN-Preston R22h ago
-
AI Testing | Agentic AI | Azure Repos | CI/CD | Conversational AIHybrid workSenior-level Contract Full TimeGlasgow, Scotland, United Kingdom R22h ago
-
Senior Embedded C++ Engineer GBP 57K-65KAutomated testing | C plus plus | CI/CD | Configuration Management | Configuration management toolingCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeSenior-level Full TimeLondon, England, United Kingdom23h ago
-
Embedded Software Engineer GBP 45K-60KBare Metal | C++ | CAN | CI/CD | DO-178CCycle scheme | Employee assistance programme | Life insurance | Pension scheme | Private medical insuranceMid-level Full TimeReading, England, United Kingdom1d ago
-
C++ Algorithms Engineer GBP 50K-62KC++ | CI/CD | Clean Code | Configuration Management | Container DeploymentCycle and tech scheme | Employee assistance programme | Flexible working | Learning and mentoring | Life insuranceSenior-level Full TimeManchester, England, United Kingdom1d ago
-
Mid-level Full TimeManchester, England, United Kingdom1d ago
-
Data Engineer GCP (Remote) GBP 70K-86KAlerting | CI/CD | Cloud Composer | Cloud Functions | Cloud StorageRemote workEntry-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
Senior-level Full TimeBelfast1d ago
-
Mid-level Full TimeStoke-on-Trent, England, United Kingdom1d ago
-
Lead Machine Learning Engineer GBP 80K-109KCloud Computing | Docker | Kubernetes | Machine Learning | PyTorchCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeLondon1d ago
-
Senior Applied Scientist GBP 205K-205KCloud Computing | Deep learning | Git | GitHub | Hugging FaceHybrid work | Mentoring | Share optionsSenior-level Full TimeLondon1d ago
-
Staff Applied Scientist GBP 225K-325KBlack | Cloud Computing | Complex Planning | Dataset analysis | Deep learningFlexible remote work | Hybrid work scheme | Mentoring and coaching | Share optionsSenior-level Full TimeLondon1d ago
-
AI Data Engineering Lead GBP 72K-80KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | Amazon AthenaRemote work flexible arrangements | Work-life balanceSenior-level Full TimeNottinghamshire, UK R1d ago
-
Data Governance | Data Lake | Data Privacy | Data Quality | Data WarehouseCharity initiatives involvement | Flexible working | Health and wellbeing support | Learning hub access | Sustainability initiatives involvementSenior-level Full TimeLuton, GB, LU2 9TN1d ago
-
Data Engineer GBP 45K-52KAmazon Web Services | Apache Spark | CloudWatch | Data Modeling | DatabricksAnnual bonus | Annual leave | Early Finish Friday | Electric vehicle scheme | Employee assistance programmeMid-level Full TimeOxford/ Hybrid, GB, OX4 4DQ R1d ago
-
Data Engineer GBP 47K-70KAirflow | Amazon Web Services | Apache Spark | Argo | AzureAnnual leave | Away Days | Company socials | Development training days | EAPSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Dash | Data Visualization | Databases | Git | Plasma PhysicsFlexible onsite working | Onsite parking | Public transport accessEntry-level InternshipMilton, England, United Kingdom1d ago
-
AI Engineer, LLM Systems & Agentic Workflows GBP 97K-130KAgentic Workflows | Anthropic API | Constrained decoding | Evaluation Pipelines | Go100 percent remote | Employee referral bonuses | Flexible time off | Fun events | Room to growSenior-level Full TimeArgentina; Brazil; Chile; Colombia; Costa Rica; … R1d ago
-
Sr. Machine Learning Engineer GBP 65K-85KComputer Vision | Convolutional Neural Networks | Data Pipelines | Deep learning | Diffusion Models25 days holiday | Cycle garage | Dental scheme | Free soft drinks | Hybrid workingSenior-level Full TimeUnited Kingdom, London1d ago
-
Lead ML Engineer / Scientist GBP 87K-111KAWS | AWS Infrastructure | Alerting | Amazon Web Services | CI/CDSenior-level Full TimeLondon, United Kingdom1d ago