Azure Data Engineer
Tasks
- Apply Azure security with Key Vault RBAC and encryption
- Build Azure Databricks pipelines
- Configure CI CD release management with Azure DevOps
- Design Azure Data Platforms
- Develop Azure Data Factory ETL pipelines
- Develop Delta Lake lakehouse architectures
- Implement PySpark and SQL transformations
- Implement data governance and regulatory reporting
- Integrate batch and streaming data sources
- Manage data quality validation and reconciliation
- Optimize SQL performance and query plans
- Set up data lineage audit and monitoring
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hub | Azure Key Vault | CI/CD | Data Factory | Data Governance | Data Lineage | Data Quality | Data Reconciliation | Data Validation | Delta Lake | Dependency management | ELT | ETL | Encryption | Error Handling | Event Hub | Git | Job Scheduling | Kafka | Key Vault | Lakehouse | Managed Identities | Medallion Architecture | Monitoring | Orchestration | PySpark | Python | RBAC | Release Management | SQL | Spark SQL
Education
N/A
Related jobs
-
Data & Analytics Lead GBP 75K-90KAWS | DBT | Data Dictionary | Data Governance | Data QualityHybrid working | Mental health support | Training coaching mentoring | Unlimited paid time offSenior-level Full TimeLondon, England, United Kingdom16h ago
-
Lead Data Engineer GBP 47K-60KAWS Glue | Amazon Lake Formation | Amazon Redshift | Amazon S3 | Data environmentsFlexible working | Hybrid work | Professional growth | Remote workSenior-level Full Timeleeds, Manchester1d ago
-
Lead Machine Learning Scientist, FinCrime GBP 115K-150KAgile | Cloud Data | Cloud data platform | Data platform | Deep learningFlexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R1d ago
-
Lead Machine Learning Scientist, Search GBP 115K-150KContextual Bandits | Data Science | Embeddings | Explainable AI | Machine LearningIncentive awards tied to performance | Professional development | Remote work flexibilitySenior-level Full TimeCardiff, London or Remote (UK) R1d ago
-
Lead Data Scientist - Treasury Markets Quant GBP 75K-111KAlgorithmic Execution | Apache Spark | At risk | Backtesting | CI/CDSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Governance Lead GBP 52K-52KData Governance | Data Issue Management | Data Management | Data Quality | Data StandardsFlexible working | Hybrid working | Travel reimbursement N/ASenior-level Full TimeGB-ENG-LAN-Preston1d ago
-
Lead Analytics Engineer GBP 85K-115KApache Airflow | Business Intelligence | DBT | Data Modelling | Data QualityFlexible working | Paid annual leave | Paid sabbatical | Paid sick leave | Parental leaveSenior-level Full TimeLondon, United Kingdom1d ago
-
Lead Data Engineer GBP 80K-80KAutomation | Cloud infrastructure | Data Architecture | Data Engineering | Data GovernanceReasonable workplace adjustments | Remote work flexibilitySenior-level Full TimeLondon, Greater London, United Kingdom2d ago
-
Head of AI Transformation GBP 90K-110KAI strategy | Artificial Intelligence | Computer Vision | Data Governance | Data analyticsBonus scheme | Buy/sell holiday | Hybrid working | Paid days off | Pension schemeExecutive-level Full TimeLondon, England, United Kingdom2d ago
-
AI Engineer - (Grade "F") GBP 92K-119KAPIs | Automated testing | BigQuery | CI/CD | Cloud RunDiscounted shopping | Flexible working | Hybrid work | Job share | Paid time offSenior-level Full TimeManchester Westminster House, United Kingdom2d ago
-
Lead Data Scientist GBP 75K-100KBloom Filters | Data Visualization | Deep Neural Networks | Gradient descent | Graph diffusionSenior-level Full TimeLondon, England (Angel Lane), United Kingdom2d ago
-
Data Analytics Lead GBP 52K-52KAlteryx | Analytics Strategy | Data Pipelines | Data Quality | Data VisualizationSenior-level Full TimeDurrington Head Office, United Kingdom2d ago
-
Technical Lead, AI Engineering GBP 97K-150KAgentic Frameworks | Agile | Autonomous Agents | CI/CD | Cloud NativeSenior-level Full Timemanchester, united kingdom2d ago
-
Lead Data Scientist GBP 26K-30KApache Spark | Approximate Nearest Neighbor | Approximate Nearest Neighbor search | Artificial Intelligence | Data Analysis24 7 virtual GP access | Charity volunteer day | Colleague discount | Defined contribution pension | Employee discounts and perksSenior-level Full TimeUnited Kingdom2d ago
-
Lead Data Scientist GBP 75K-80KAWS | Agile | Azure | Cloud platform | Data Governance24 7 GP Services | Company pension contribution | Enhanced maternity leave and pay | Enhanced paternity leave and pay | Generous referral schemeSenior-level Full TimeAltrincham, England, United Kingdom2d ago
-
Alerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | High ownership culture | Learning and development budget | Modern engineering practicesSenior-level Full TimeUnited Kingdom R3d ago
-
Head of Enterprise Data Governance, Risk and Management GBP 106K-125KBusiness stakeholder management | Control environment | Cross Business Stakeholder Management | Data Governance | Data ManagementAnnual leave | Critical illness cover | Flexible working | Life assurance | Paid parental leaveExecutive-level Full TimeFenchurch Avenue, United Kingdom3d ago
-
AI guardrails | AI system evaluation | APIs | Asynchronous programming | Cloud NativeEmployee assistance program | Employee discounts | Hybrid work model | Learning and development resources | Paid parental leaveSenior-level Full TimeLocation(s): Belfast, Northern Ireland, United Kingdom3d ago
-
Head of Data Architecture GBP 105K-114KAI | Analytics | Data Architecture | Data Governance | Data Management28 days holiday | Access to pay as you earn service | Car allowance | Colleague support service | Company carSenior-level Full TimeManchester, Lancashire, UNITED KINGDOM3d ago
-
Data Governance Lead GBP 57K-69KAudit Readiness | Compliance Management | DAMA | DCAM | Data CatalogHybrid work | Training and developmentSenior-level Full TimeHandforth, CHE, SK9 3RN3d ago
-
Executive-level Full TimeLondon3d ago
-
Lead Data Analyst - CRM Analytics GBP 75K-115KA/B | A/B Testing | B testing | CRM | Customer SegmentationHybrid work options | Hybrid working | Paid annual holiday | Paid leave opportunities | Paid parental leaveSenior-level Full TimeLondon, United Kingdom3d ago
-
Senior Clinical Data Science Lead GBP 57K-91KClinical data | Clinical data management | Clinical data review | Clinical data science | Clinical trialsEmployee Assistance programmes | Health and Wellbeing Programmes | Learning and development opportunities | Life assurance and disability coverage | Retirement and pension plansSenior-level Full TimeUK, Swansea, United Kingdom4d ago
-
Head of Data Platform GBP 73K-100KAgile | Business Analysis | Data Governance | Data Management | Database ArchitectureExecutive-level Full TimeLondon, United Kingdom4d ago
-
Data Governance Lead GBP 63K-65KBusiness glossary | Control Frameworks | Data Architecture | Data Catalog | Data GovernanceFlexible working hours | Paid parental leave | Remote or mobile workingSenior-level Full TimeLondon York Road, United Kingdom4d ago