Data Engineer (Banking & Investments)
Tasks
- Build parameterized Fabric templates
- Create ingestion mappings
- Deploy data pipelines across DEV TEST UAT and PROD
- Develop incremental load processes
- Document reusable engineering patterns
- Enhance metadata driven ingestion framework
- Execute CI CD and DevOps promotion processes
- Implement watermarks and merge logic
- Integrate Fabric pipelines with On Premises Data Gateways
- Maintain source to target data mappings and technical specifications
- Migrate ETL from Azure Data Factory and Azure Data Lake Storage to Microsoft Fabric
- Support system testing and UAT defect investigation
- Test data pipelines and resolve data quality defects
- Work in agile sprint teams
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | CI/CD | Data Factory | Data Gateway | Data Ingestion | Data Lake Storage | Data Mapping | DevOps | ETL | Fabric Pipelines | Incremental loads | Merge logic | Microsoft Fabric | Microsoft Fabric Pipelines | On Premises Data | On-Premises | On-premises Data Gateway | Python | SQL | Watermarks
Education
N/A
Roles
Related jobs
-
Buildkite | C++ | CI/CD | Camera | Hardware-in-the-loopHybrid work | Work from home daysSenior-level Full TimeLondon R21h ago
-
Robotics Engineer GBP 123K-130KAPI Design | Asynchronous programming | Bayesian Inference | C++ | CUDAHybrid work | Work from home optionsSenior-level Full TimeLondon; Sunnyvale R22h ago
-
Data Engineer, Global Client Solutions GBP 77K-77KCloud Computing | Data Engineering | Data Fusion | Docker | GitDental insurance | Hybrid work schedule | Medical insurance | Mental Health Awareness Days | Paid time offMid-level Full TimeLondon, United Kingdom1d ago
-
Forward-Deployed Data Scientist II GBP 90K-134KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewDisability coverage | Donation matching | Employee resource groups | Employee stock purchase plan | Flexible paid time offMid-level Full TimeLondon1d ago
-
Causal Inference | Machine Learning | Model Productionization | Personalization | PythonContinuous learning | Flexible working | Hybrid workingSenior-level Full TimeLondon - The River Building HQ1d ago
-
Machine Learning Engineer - Routing & ETA GBP 27K-27KForecasting | Machine Learning | Predictive Modeling | Production Machine Learning | PythonContinuous learning | Flexible working hours | Hybrid workEntry-level Full TimeLondon - The River Building HQ1d ago
-
AI Research Engineer - GPU Simulation GBP 80K-105KC++ | CUDA | Domain Randomization | Flight Dynamics | GPU ProgrammingEnhanced parental leave | Health and wellness gym membership | Learning allowance | Mental health support | Paid Family Emergency LeaveSenior-level Full TimeMunich - Berlin - London - … R1d ago
-
Senior Data Engineer GBP 64K-74KAWS Glue | Apache Airflow | Azure Data | Azure Data Factory | CI/CDHybrid work arrangementSenior-level Full Time17th Floor, 5 Aldermanbury Square, London, … R1d ago
-
Entry-level Full Time17th Floor, 5 Aldermanbury Square, London, …1d ago
-
Senior Data Engineer GBP 72K-80KAccess Control | Airflow | BigQuery | CI/CD | Cloud ComposerAgile working | Career coaching | Enhanced parental leave | Occasional travel for workshops and meetings | Pension matchingSenior-level Full TimeManchester Office1d ago
-
Senior Data Engineer GBP 72K-80KAccess Control | Airflow | BigQuery | CI/CD | Cloud ComposerAgile working | Career coaching | Enhanced parental leave | Pension matching | Private medical coverSenior-level Full TimeHeathrow Office1d ago
-
Senior Data Engineer GBP 72K-80KAPIs | Access Control | Airflow | BigQuery | CI/CDAgile working | Career coaching | Enhanced parental leave | Learning opportunities | Occasional travel for workshopsSenior-level Full TimeLondon Office1d ago
-
Mid-level Full TimeRemote (United States); United Kingdom; Canada R1d ago
-
Senior Data Engineer GBP 70K-75KAWS | Azure | Azure Data | Azure Data Factory | CI/CDBirthday day off | Cycle to work scheme | Enhanced maternity leave | Enhanced paternity leave | Gym discountsSenior-level Full TimeLondon or Manchester UK1d ago
-
API Design | AWS | AWS Bedrock | Apache Airflow | Apache IcebergSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Data Platform Engineer GBP 60K-70KAzure | Azure Databricks | Azure DevOps | Azure Monitor | CI/CDFlexible work modelMid-level Full TimeNewcastle, United Kingdom R1d ago
-
AI Solution Lead Engineer GBP 59K-74KAWS | Automation | Azure | CI/CD | Computer VisionAnnual health assessments | Annual leave | Charity matched funding | Cycle to work scheme | Double matched pensionSenior-level Full TimeScottishPower HQ, United Kingdom1d ago
-
Staff Engineer GBP 80K-100KAutomated testing | Containers | Continuous integration | Executorch | Graph optimizationSenior-level Full TimeLocation Cambridge, United Kingdom1d ago
-
Data Engineering Specialist (Snowflake) GBP 72K-80KAWS | Apache Spark | Data Architecture | Data Modeling | Data WarehousingFlexible working arrangements | Hybrid workSenior-level Full TimeWaterloo Street, United Kingdom R1d ago
-
Senior AI Engineer GBP 92K-125KAPIs | AWS | Agent workflows | Alerting | AzureEmployee assistance program | Employee discounts | Flexible working hours | Personal choice budget | Sabbatical leaveSenior-level Full TimeUK - London (London Wall), United …1d ago
-
SAS Engineer EUR 56KAutomation | Data Cleansing | Data Migration | Data Reconciliation | Data ValidationFlex benefits program | Income protection | Life assurance | Paid time off | Pension matchingMid-level Full TimeManchester, GB R1d ago
-
Forward Deployment Engineer GBP 78K-120KAWS | Artificial Intelligence | Azure | CI/CD | Fine TuningMid-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data engineer GBP 50KAPI Integration | Alteryx | Automation | Data Modeling | Data VisualizationHybrid work | Permanent employmentMid-level Full TimeFleet UK - Manchester Office, United …1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeDerby, United Kingdom1d ago