Data Engineer
Tasks
- Apply engineering practices with source control peer review and automated testing
- Collaborate with data and solution architects on enterprise models
- Define and maintain interface contracts for reporting and visualization
- Design and build data models and transformation logic
- Develop governed data products for reporting and analytics
- Embed data quality controls validation testing and monitoring
- Embed privacy PII retention and access control in transformation logic
- Handle master and reference data and implement slowly changing dimensions
- Implement continuous improvement reusable patterns and practices
- Investigate and resolve data quality or pipeline failures
- Maintain data contracts versioning and semantic readiness requirements
- Maintain documentation of business rules data lineage and transformations
- Manage engineering layer between ingestion and reporting
- Perform knowledge transfer and establish in house engineering standards
- Productionize data science outputs into governed data products
- Translate business requirements into data engineering outputs
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Spark | CI/CD | Data Access Control | Data Contracts | Data Governance | Data Lineage | Data Modeling | Data Monitoring | Data Quality | Data Retention | Data Validation | Data Versioning | Data access | Databricks | Delta Lake | Dimensional Modeling | ELT | ETL | Git | Lakehouse Architecture | Medallion Architecture | Metadata | PII | Parquet | Privacy | Python | Relational modeling | SQL | Semantic data | Semantic data modeling | Slowly Changing Dimensions
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeYork, United Kingdom12h ago
-
Senior Machine Learning Engineer GBP 90K-126KAsynchronous programming | Azure | Distributed Systems | Docker | EvalsSenior-level Full TimeUK - London20h ago
-
Embedded Software Engineer GBP 30K-34KBluetooth | C# | C++ | CI/CD | Continuous DeploymentAnnual leave | Community and charity initiatives | Company pension scheme | Cycle to work | Private healthcareMid-level Full TimeMelbourn, United Kingdom21h ago
-
Data Engineer GBP 37K-45KAWS | AWS Glue | AWS Lambda | Amazon DynamoDB | Amazon EMRAnnual leave | Company pension | Cycle to work | Give as you earn | Hybrid workMid-level Full TimeBelfast, United Kingdom21h ago
-
Senior AI Engineer GBP 80K-108KAWS | Agentic Architectures | Anthropic API | Cloud platform | DevOpsAnnual performance bonus | Community and charity initiatives | Cycle to work | Give as you earn | Health and lifestyle benefitsSenior-level Full TimeBelfast, Northern Ireland, United Kingdom21h ago
-
Data Engineer GBP 762KAWS CDK | Amazon Redshift | Amazon Web Services | Azure OpenAI | BigQuery25 days holiday | Bike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leaveMid-level Full TimeManchester / Hybrid, England, United Kingdom R22h ago
-
APIs | Agent systems | Cloud platform | CrewAI | EvaluationCustomer facing responsibilities | Travel opportunity | White glove deploymentsSenior-level Full TimeLondon, UK1d ago
-
Mid-level Full TimeLondon, England, United Kingdom1d ago
-
AWS | Apptainer | Bioimage Informatics | CPU Clusters | Cluster schedulingSenior-level Full TimeCambridge, Cambridgeshire, United Kingdom1d ago
-
Applied Machine Learning Engineer, EMEA GBP 100K-125KDeep learning | Fine Tuning | Generative AI | Human Feedback | LLM InferenceMid-level Full TimeLondon, UK1d ago
-
Analytics Engineer GBP 57K-74KDBT | Data Governance | Data Modeling | Data Pipelines | Data QualityEntry-level Full TimeCEY BO, United Kingdom1d ago
-
Senior-level Full TimeLocation Cambridge, United Kingdom1d ago
-
Associate Quantum Engineer GBP 45K-56KAutomation | Cryogenics | DC wiring | Data Analysis | Differential EquationsMid-level Full TimeReading, England, United Kingdom1d ago
-
AI Engineer GBP 100K-125KAI monitoring | C++ | CLIP | Clap | Deep learningCycle to work scheme | Dental insurance | Employer pension contribution | Free meals | Private health insuranceMid-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer GBP 45K-50KData Governance | Data Lakes | Data Modeling | Data Quality | Data ReconciliationSenior-level Full TimeGBR-4PS, United Kingdom1d ago
-
Lead Data Platform Engineer GBP 86K-106KAPI Integration | AWS EventBridge | AWS Functions | AWS Glue | AWS LakeAdditional annual leave purchase | Healthcare | Paid time off | Pension | Sharesave schemeSenior-level Full TimeNottingham, United Kingdom1d ago
-
Senior Data Engineer GBP 60K-80KAirflow | Anomaly Detection | BigQuery | Data Governance | Data ModelingDonation matching | Employee assistance program | Flexible schedule | Health benefits | Lifestyle benefitSenior-level Full TimeLondon, United Kingdom - Remote / … R1d ago
-
Data Engineer (Tech Lead/Staff) GBP 55K-84KAPI Integration | AWS | Apache Airflow | Apache Spark | DBTSenior-level Full TimeLondon (GB)1d ago
-
Music AI/ML QE Engineer GBP 40K-50KData Visualization | Integration Testing | Java | Language Models | Large Language ModelsMid-level Full TimeLondon1d ago
-
Senior Analytics Engineer GBP 50K-60KAmazon Redshift | Automation | BigQuery | Data Modeling | Data PipelinesGenerous annual leave | Healthcare | Parental leave | Pensions | Well-beingSenior-level Full TimeLondon - The River Building HQ1d ago
-
Senior Machine Learning Engineer GBP 76K-100KAutomated Deployment | BigQuery | Cloud platform | Drift monitoring | Feature StoreSenior-level Full TimeLondon - Hybrid R1d ago
-
A/B | A/B Testing | B testing | Contextual Bandits | Data QualityAnnual leave policy | In-person onboarding | Remote work | Restricted stock unitsSenior-level Full TimeUnited Kingdom (Remote) R1d ago
-
Senior Lead Software Engineer – Data Platforms GBP 90K-120KAI Governance | Agile | Artificial Intelligence | Automation tools | CloudSenior-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Analytics Engineer GBP 70K-80KAzure Data | Azure Data Factory | Azure DevOps | Business ontology | CI/CDSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 65K-80KAWS | Agile | Azure | Cloud Computing | Computer VisionAnnual holiday allowance | Buy additional holiday | Colleague discount | Cycle to work scheme | Employee assistance programmeSenior-level Full TimeLondon, London, United Kingdom1d ago