Data Engineer
Tasks
- Build and maintain Azure data pipelines
- Define architectural patterns data flows and technical designs
- Design and maintain API integrations
- Develop and optimize data models schemas and tables
- Implement data QA validation and completeness checks
- Implement secure file transfers SFTP and webhook ingestions
- Ingest data from APIs SQL databases and legacy systems
- Maintain data dictionary and data lineage documentation
- Maintain data standards and best practices
- Migrate data from on prem systems
- Monitor and troubleshoot pipeline failures and performance issues
- Translate business rules into data layer logic
Perks/Benefits
- Employee assistance program
- Enhanced family leave
- Identity and background checks
- Life insurance
- Paid time off
- Retail discounts
Skills/Tech-stack
API Integration | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Factory | Data Lake | Data Modeling | Data Quality | Data Reconciliation | Data Validation | DevOps | Git | Microsoft Fabric | Relational modeling | SFTP | SQL | SQL Database | Synapse Analytics | Webhooks
Education
N/A
Roles
Related jobs
-
Digital Analytics Manager GBP 32K-36KA/B | A/B Testing | Adobe Analytics | B testing | Data ModelingDental | Discounted broadband | Discounted mobile | Equalized parental leave | Gym membershipMid-level Full TimeLondon, GB, E1 8EP9h ago
-
Data Engineer, Ads Auction Platform GBP 75K-91KA/B | A/B Testing | Apache Airflow | B testing | Batch ProcessingCommuter benefits | Health benefits | Paid time off | Remote work flexibility | Retirement benefitsSenior-level Full TimeManchester, United Kingdom14h ago
-
Data Engineer, Ads Auction Platform GBP 75K-91KAirflow | Batch Processing | Data Modeling | Dimensional Modeling | Distributed ComputingCommuter benefits | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeCambridge, United Kingdom14h ago
-
Forward Deployed Engineer GBP 111K-122KAngular | Application deployment | Application development | Artificial Intelligence | BackboneMid-level Full TimeLondon, Greater London, England, United Kingdom17h ago
-
Data Analyst (Analytics Engineer) GBP 69K-80KCloud Data | Cloud data platform | DBT | Data Lineage | Data ModelingElectric car scheme | Employee discounts | Family leave | Flexible working options | Healthcare planSenior-level Full TimeCardiff, Wales, United Kingdom1d ago
-
Data Analyst (Analytics Engineer) GBP 69K-80KDBT | Data Lineage | Data Modeling | Data Quality | Data Quality TestingElectric car scheme | Employee discounts | Family leave | Flexible working | Generous pension contributionSenior-level Full TimeBrighton and Hove, England, United Kingdom1d ago
-
Business Intelligence | Data Analysis | SQL | Stakeholder management | Team leadershipHybrid work | Remote WorkingSenior-level Full TimeLondon, United Kingdom1d ago
-
Principal Software Engineer, AI Innovation GBP 55K-70KAI Agents | API Management | Artificial Intelligence | AutoAI | Cloud ComputingSenior-level Full TimeLondon, United Kingdom1d ago
-
Lead Data Engineer GBP 70K-100KAmazon Redshift | Amazon Web Services | Apache Airflow | BigQuery | Cloud ComputingCertification support | Charity Volunteer Opportunities | Professional development | Training opportunitiesSenior-level Full TimeManchester, Amsterdam, Rotterdam, Budapest1d ago
-
Senior Data Engineer GBP 70K-90KAWS | Airflow | Azure | BigQuery | DBTAnnual charity volunteering month | Flexible-hybrid work | Training and developmentSenior-level Full TimeManchester, Amsterdam, Rotterdam, Budapest1d ago
-
Applied AI ML Lead- Agentic AI & Python GBP 81K-109KAgentic AI | CI/CD | Cloud Computing | Code review | ContainerizationSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Senior Data Engineer - Global People Data GBP 75K-105KAPI Integration | Apache Spark | Azure | Canonical Data | Canonical Data ModelCareer development opportunities | Hybrid work schedule | Inclusive work cultureSenior-level Full TimeLondon, London, United Kingdom1d ago
-
Quantitative Developer GBP 52K-75KAWS | Azure | Data Modeling | Data Pipelines | GCPDental insurance | External and internal training eligibility | Health insurance | Life insurance | Paid time offMid-level Full TimeLondon, United Kingdom1d ago
-
AI Engineer GBP 65K-80KAWS | Automated testing | Azure | CI/CD | Computer VisionEmployee assistance programme | Generous annual leave | Income protection | Laptop | Life assuranceMid-level Full TimeScotland, United Kingdom1d ago
-
Senior AI Engineer - Legal AI GBP 80K-109KAWS | Chunking | Computer Vision | Confidence scoring | Context engineeringAI experimentation budget | Enhanced parental leave | Equity | Hybrid working | Income protectionSenior-level Full TimeLondon1d ago
-
Principal Machine Learning Engineer GBP 78K-120KAWS | Agent systems | Argo Workflows | ArgoCD | CI/CDAnnual learning budget | Childcare support | Enhanced parental leave | Home office budget | Hybrid workSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior-level Full TimeLondon1d ago
-
Senior Data Engineer GBP 75K-90KAWS Glue | Airflow | BigQuery | Cloud services | DBTFlexible time off | Hybrid work | Medical insurance | Paid birthday off | Pension schemeSenior-level Full TimeKing's Cross, London, United Kingdom1d ago
-
Consultancy Analytics Manager GBP 40K-45KDashboarding | Data Analysis | Data Processing | Data Visualization | Microsoft OfficeAdditional paid holidays | Birthday day off | Flexible working | Life assurance | Paid time offMid-level Full TimeEllesmere Port, England, United Kingdom - … R1d ago
-
Freelance Machine Learning Engineer USD 110KLangchain | Language Models | Large Language Models | MLOps | Machine LearningPart-time projects | Project based workMid-level FreelanceUnited Kingdom - Remote R1d ago
-
Data Engineer GBP 36K-44KAPI | AWS | Airflow | Azure | BigQueryBlood donation time off | Counselling service | Extra paid leave | Flexible working hours | Free annual eye testsMid-level Full TimeLondon, England, United Kingdom - Remote R1d ago
-
Data Engineer GBP 69K-94KAirflow | Azure | Data Lake | Data Modeling | Data ValidationCritical illness cover | Hybrid work environment | Life insurance | Paid time off | Pension contributionSenior-level Full TimeManchester, United Kingdom1d ago
-
Lead Analytics Engineer GBP 70K-80KCI/CD | Cost Optimization | Data Engineering | Data Governance | Data LiteracyBonus scheme | Colleague discount | Family care leave | Hybrid work | Life & disability insuranceSenior-level Full TimeLondon Hub, United Kingdom1d ago
-
Senior BI Data Engineer GBP 67K-70KData Governance | Data Modeling | Data Pipelines | Data Quality | Dataflows Gen2Cycle to work scheme | Discount programs | Employee assistance program | Employee recognition | Enhanced annual leaveSenior-level Full TimeKendal, United Kingdom1d ago
-
Artificial Intelligence | Data Modeling | Data Science | Data Warehousing | Data platformCareer development opportunities | Entrepreneurial environment | High individual responsibilitySenior-level Full TimeLondon, England, United Kingdom1d ago