Principal Digital Specialist - Principal Data Engineer (Azure)
Tasks
- Assure technical designs for analytics projects
- Collaborate with data science and architecture teams
- Conduct proof-of-concept development
- Design Azure Data Pipelines
- Develop lakehouse architectures
- Gatekeep production pipeline changes in Azure DevOps
- Guide technical direction for data engineering
- Lead data engineering standards
- Mentor data engineering teams
- Own data quality security governance assurance
- Perform code reviews
- Provide technical liaison with external digital partners
- Support transition of solutions into production support
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure | Azure Bicep | Azure Data | Azure Data Lake | Azure Databricks | Azure DevOps | CI/CD | Data Governance | Data Lake | Data Quality | Data Security | Infrastructure as Code | IoT | Lakehouse | Microsoft Fabric | Python | SQL | Streaming | Terraform | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
AI Data Engineer GBP 111K-133KAgent memory | Amazon Web Services | Audio Processing | Batch Processing | Cloud infrastructureAccess to AI tools | Equity | OwnershipMid-level Full TimeLondon7h ago
-
Insights Product Manager - Analytics Engineering GBP 50K-68KAmplitude | Anomaly alerting | CI/CD | DBT | Data CatalogAnnual leave | Counselling access | Employee assistance program | Free Economist content access | Moving home supportMid-level Full TimeLondon - Commercial R11h ago
-
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 70K-100KAI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial IntelligenceHybrid work schedule | Travel for customer visits and events | Workshops seminars and community buildingSenior-level Full TimeLondon, United Kingdom; Paris, France R16h ago
-
APIs | AWS | Automation Pipelines | Azure | Backend DevelopmentAnnual leave | Company lunches | Learning and development budget | Monthly socials | Public holidaysEntry-level Full TimeLondon18h ago
-
Alerting | Cause analysis | Completeness Accuracy Timeliness Consistency | Data Governance | Data MonitoringSenior-level Full TimeLondon20h ago
-
Data Engineer GBP 45K-50KApache Airflow | Batch Data Processing | Batch data | BigQuery | Cloud platformCompany performance bonus | Employee assistance | Enhanced family leave | Flexible working | Gym membershipMid-level Full TimeLondon, England, United Kingdom23h ago
-
Infrastructure and MLOps Engineer GBP 91K-110KAWS | CI/CD | Docker | Kubernetes | LinuxAnnual leave | Barista bar | Dental plan | Employee assistance programme | Flexible workingSenior-level Full TimeBristol, UK1d ago
-
AI Research Engineer - Computer Vision GBP 65K-90KAdversarial Attacks | Computer Vision | Deep learning | Edge Computing | Hardware optimizationEnhanced parental leave | Gym membership | Learning allowance | Mental health support | Paid Family Emergency LeaveSenior-level Full TimeBerlin; London; Munich R1d ago
-
AWS | Apache Airflow | Apache Kafka | Apache Spark | CI/CDCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Flexible remote workSenior-level Full TimeManchester, United Kingdom1d ago
-
Senior AI Engineer GBP 70K-90KAPI Development | AWS | Agent Orchestration | Apache Spark | CI/CDCentral London office | Enhanced parental leave | Enhanced pension | Free meals and snacks | Life insuranceSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Bilby | CAMB | Class | DOLFINx | FenicsPart-time freelance | Project based workSenior-level FreelanceUnited Kingdom - Remote R1d ago
-
Data Engineering Technical Lead GBP 60K-70KAd Hoc Queries | Ad-Hoc | Data Integrity | Data Modeling | Data ProcessingHybrid work model | Mentorship | Professional developmentSenior-level Full TimeGBR - Manchester, United Kingdom1d ago
-
System Development Engineer, ToolBelt - Builder Tools, Operator Tools, UXP2 and Cutlass. GBP 75K-90KAWS | Amazon Web Services | Ansible | CI/CD | Distributed SystemsCareer growth | Flexible work arrangements | Mentorship | Work-life balanceSenior-level Full TimeLondon, England, GBR1d ago
-
AI Engineer GBP 70K-80KAgent systems | Agentic AI | Algorithms | Cloud Native | Data StructuresLearning and development | Mental health support | Training opportunities | Wellbeing programsMid-level Full TimeManchester, GB1d ago
-
Data Analysis | Data Generation | Human-in-the-loop | Model-based data generation | PythonMid-level Full TimeLondon, England, GBR1d ago
-
Data Engineer (Integration) GBP 60K-70KAWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Systems Manager | AWS Systems Manager Parameter StoreCollaborative culture | Flexible collaboration hours | Fully remote across Europe | Work-life balanceSenior-level Full TimeLondon, United Kingdom R1d ago
-
Senior Data Engineer — Ingestion & Platform GBP 70K-80KAPI Key | Apache Airflow | Authentication | CI/CD | DBTFlexible collaboration hours | Fully remote work | Ownership and innovation culture | Work-life balanceSenior-level Full TimeLondon, United Kingdom R1d ago
-
Principal Machine Learning Engineer GBP 78K-90KAIOps | AWS | Airflow | Anomaly Detection | Batch inferenceAdditional leave | Hybrid working | Move annual leave carry over | Option to Buy Sell Annual Leave | Private healthcareSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Lead Data Engineer GBP 70K-87KAdobe Experience | Adobe Experience Platform | Apache Airflow | Azure | CI/CDHybrid workSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Software engineer, generative AI (UK) GBP 80K-90KAWS | Agentic Workflows | Asyncio | Azure | CI/CDCompany offsites | Dental insurance | Fertility support | Learning and development stipend | Medical insuranceMid-level Full TimeLondon, UK1d ago
-
AI engineer (UK) GBP 80K-90KAWS | Bias detection | Cloud platform | Deep learning | ExplainabilityCompany off-sites | Dental insurance | Fertility and family planning support | Learning and development stipend | Medical insuranceMid-level Full TimeLondon, UK1d ago
-
AI Engineer USD 100K-250KLLM Evaluation | Language Models | Large Language Models | Machine Learning | PostgreSQLFree meals | Private medical insurance | Visa sponsorshipMid-level Full TimeLondon, England, GB1d ago
-
Senior-level Full TimeLondon1d ago
-
Principal Decision Scientist - Marketing GBP 70K-100KAudience Segmentation | CAC | Causal Inference | Churn Prediction | Customer Lifetime ValueBonuses | Coaching | Compassionate leave | Flexible hours | Internal mobilitySenior-level Full TimeUK, London1d ago
-
Lead Data Engineer GBP 90K-106KBasel 3.1 | Cause analysis | Data Governance | Data Lineage | Data ValidationHybrid workingSenior-level Full TimeEdinburgh, Scotland, United Kingdom1d ago