Data Engineer
Tasks
- Build and maintain Azure data pipelines
- Define architectural patterns data flows and technical designs
- Design and maintain API integrations
- Develop and optimize data models schemas and tables
- Implement data QA validation and completeness checks
- Implement secure file transfers SFTP and webhook ingestions
- Ingest data from APIs SQL databases and legacy systems
- Maintain data dictionary and data lineage documentation
- Maintain data standards and best practices
- Migrate data from on prem systems
- Monitor and troubleshoot pipeline failures and performance issues
- Translate business rules into data layer logic
Perks/Benefits
- Employee assistance program
- Enhanced family leave
- Identity and background checks
- Life insurance
- Paid time off
- Retail discounts
Skills/Tech-stack
API Integration | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Factory | Data Lake | Data Modeling | Data Quality | Data Reconciliation | Data Validation | DevOps | Git | Microsoft Fabric | Relational modeling | SFTP | SQL | SQL Database | Synapse Analytics | Webhooks
Education
N/A
Roles
Related jobs
-
Software Specialist (TL) - AI/ML - Monetisation GBP 35K-40KC++ | Causal Inference | Data Analysis | Data Modeling | Data PipelinesSenior-level Full TimeRemote, UK | London, UK R9h ago
-
Senior AI Engineer GBP 77K-100KAWS | Agent architectures | Anthropic API | Cloud platform | DevOpsAnnual leave | Community involvement | Course and certification support | Cycle to work | Give as you earnSenior-level Full TimeBristol, England, United Kingdom9h ago
-
MLOps Engineering Specialist GBP 50K-66KAWS SageMaker | Amazon Web Services | CI/CD | Distributed tracing | Drift DetectionMid-level Full TimeLondon, GB, E1 8EP11h ago
-
Mid-level Full TimeLondon, England, United Kingdom20h ago
-
AI Engineer, Rates VP GBP 81K-130KAPIs | Agent systems | Agentic Frameworks | ETL | EmbeddingsEmployee assistance program | Employee discounts | Learning and development resources | Life insurance | Paid leaveExecutive-level Full Time33 CANADA SQUARE CANARY WHARF LONDON, …20h ago
-
Senior-level Full Time40 BANK STREET, United Kingdom20h ago
-
System Design Stability Data Engineer GBP 52K-55KData Engineering | Data Modeling | Data Visualization | Database Management | DatabricksCharitable donations | Digital GP service | Employee assistance membership | Enhanced parental leave pay | Flexible workingMid-level Full TimeGBR-Bridgwater-EDF NNB Hinkley Point C (040GB), …20h ago
-
Azure | Azure Data | Azure Data Lake | Data Lake | DatabricksExecutive-level Full TimeLondon, UK: 10 New Burlington Street …20h ago
-
Mid-level Full TimeLondon1d ago
-
Associate Principal Engineer (Big Data Engineer) GBP 52K-60KAirflow | Apache Kafka | Azure | CI/CD | DBTMid-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Engineer GBP 60K-80KAWS | Agile | Apache Airflow | Asana | AzureContinuous learning | Health insurance | Pension plan | Remote work flexibility | Work-life balanceSenior-level Full TimeLondon, United Kingdom R1d ago
-
A/B | A/B Testing | B testing | Business Analytics | DashboardingMid-level Full TimeLondon, England, United Kingdom1d ago
-
Artificial Intelligence | CI/CD | Continuous Deployment | Continuous integration | Continuous integration Continuous deploymentSenior-level Full TimeLondon, UK1d ago
-
Applied AI & Data Scientist GBP 50K-61KAgent-based | Agent-based systems | Data Engineering | Data Pipelines | Deep learningAnnual leave | Family-friendly initiatives | Flexible work options | Hybrid working | Pension schemeMid-level Full TimeEdinburgh - Central Area, Midlothian, United …1d ago
-
Lifecycle Data Analyst GBP 50K-60KA/B | A/B Testing | B testing | Data Quality | Data VisualizationMid-level Full TimeUnited Kingdom, London1d ago
-
Member of technical staff - Research - Model - London GBP 230K-340KData Pipelines | Deep learning | Distributed Training | Evaluation | GitCareer development | Continuous learning | Hybrid work | Professional growthSenior-level Full TimeLondon1d ago
-
AWS | Ansible | Automation | Backups | CDCCareer growth | Mentorship and coaching | On-call rotations | RSU benefitsSenior-level Full TimeLondon, United Kingdom1d ago
-
AWS | Ansible | As-a-Service | Authentication | AutomationMid-level Full TimeLondon, United Kingdom1d ago
-
Senior Analytics Engineer GBP 60K-70KBigQuery | DBT | Data Mapping | Data Modeling | Data VisualizationAnnual Product Allowance | Annual performance bonus | Bank holidays | Career growth | Employee discountsSenior-level Full TimeBorehamwood, United Kingdom1d ago
-
Data Science & AI Specialist GBP 30K-30KAWS Bedrock | Apache Druid | Apache Pulsar | Artificial Intelligence | CI/CDCarers leave up to 2 weeks | Discounted mobile and broadband | Equalized maternity paternity and adoption leave | Holiday purchase scheme | Hybrid workingMid-level Full TimeLondon, GB, E1 8EP R1d ago
-
Revenue Operations Data Engineering Partner GBP 60K-80KAutomation | B2B SaaS | B2B SaaS Revenue Mechanics | CRM Integrations | CRM hygieneSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Engineer - 6 month FTC GBP 45K-68KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOpsFlexible working | Hybrid work | Work from anywhere up to 30 days per yearSenior-level Contract TemporaryLondon, United Kingdom R1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
AI Software Engineer GBP 80K-105KAPI Design | Agentic patterns | Application Context | CI Automation | Dependency InjectionSenior-level Full TimeUnited Kingdom-Cambridge-Milton Road-Cambridge Science Park1d ago
-
Digital & Analytics Product Manager GBP 48K-50KAnalytics | Business Intelligence | Business acumen | Data Modeling | Digital ProductHybrid work model | No visa sponsorship | Work in office 3 days per weekMid-level Full TimeLondon, GBR, United Kingdom1d ago