Principal Data Engineer
Manchester, United Kingdom
GBP 90K-109K (estimate) Senior-level Full Time
Tasks
- Build data lake data warehouse and BI reporting structures
- Coach and mentor data engineers
- Create physical data models for reuse and storage optimization
- Define data platform technical direction
- Design and build data observability and data quality
- Design data solutions and work packages
- Develop advanced BI solutions in Power BI
- Develop secure governed data pipelines
- Ensure data pipeline quality and integrity
- Establish coding standards and ingestion patterns
- Implement data cleansing mapping transformation and storage optimization
- Maintain documentation for data platform content
- Perform unit testing and peer testing
Perks/Benefits
Skills/Tech-stack
ADLS Gen2 | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Governance | Data Lake Storage Gen2 | Data Lakehouse | Data Modeling | Data Observability | Data Pipelines | Data Quality | Databricks | Delta Lake | Dimensional Modeling | Entra ID | Firewall | Git | Infrastructure as Code | Kimball Dimensional | Kimball dimensional modeling | Medallion Architecture | Microsoft Azure | Microsoft Entra | Microsoft Entra ID | Power BI | Private Link | PySpark | Python | RBAC | SQL | Spark SQL | Synapse Analytics | Terraform | Unit Testing | Virtual Network | YAML pipelines | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior Data Engineer GBP 70K-70KAgile | Behavior-Driven Development | CI/CD | Code review | Data EngineeringDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceSenior-level Full TimeLondon, United Kingdom13h ago
-
Data Engineer GBP 57K-57KAgile | Alteryx | Automated testing | Behavior-Driven Development | CI/CDDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceMid-level Full TimeLondon, United Kingdom13h ago
-
Senior Machine Learning Engineer GBP 72K-85KBatch Machine Learning | CI/CD | Containerization | Data Pipelines | Data parallelismDisability accommodations during hiring process | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom14h ago
-
Data Engineer GBP 51K-55KApache Airflow | Azure Data | Azure Data Factory | Azure Functions | C#Hybrid work options | Knowledge sharing culture | Professional growth opportunities | Work flexibilityMid-level Full TimeBristol, 3 RIVERGATE, United Kingdom14h ago
-
Software Engineering III - AI/ML Engineer GBP 80K-109KAWS | Automation | Databricks | Datadog | Disaster RecoverySenior-level Full TimeLONDON, LONDON, United Kingdom18h ago
-
Quantitative / AI Specialist GBP 50K-60KAPI Integration | Analytics | Artificial Intelligence | C++ | Electronic PricingEntry-level Full TimeLondon, United Kingdom19h ago
-
365 Admin Center | Access Control | Admin Center | Data Cleansing | Data GovernanceEntry-level Contract Full Time TemporaryCanary Wharf, 1 Churchill Place, United …1d ago
-
Senior AWS Data Platform Developer GBP 72K-85KAWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS Lake FormationSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
ML/AI Engineer GBP 70K-85KAutoscaling | Blue/green | CI/CD | CUDA | CanaryAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeManchester Westminster House, United Kingdom1d ago
-
AI Engineer / AI Analyst GBP 60K-80KAI Evaluation | Agent systems | CI/CD | Cloud Computing | ComplianceCycle to work scheme | Employee Assistance Programme (EAP) | Employer pension contributions | Health related time off | Hybrid workingMid-level Full TimeUK-London-Chiswick Bldg 5 Floor 4, United …1d ago
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom1d ago
-
Applied AI Engineer GBP 85K-110KA/B | A/B Testing | Anthropic | B testing | ExperimentationFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetMid-level Full TimeUnited Kingdom R1d ago
-
Lead AI Engineer (AI Systems & Automation) GBP 78K-109KAlerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetSenior-level Full TimeUnited Kingdom R1d ago
-
Applied AI Engineer GBP 70K-85KCloud Computing | Data Modeling | Deep learning | Docker | LLM DeploymentFully expensed tech | Meal allowance | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom3d ago
-
Forward Deployed Engineer - Defence GBP 65K-90KAngular | Artificial Intelligence | Full Stack | Full-Stack Development | GitEqual opportunity | Technical training | Travel as neededMid-level Full TimeLondon, Greater London, England, United Kingdom3d ago
-
Consulting Systems Engineer, Data Management (EMEA) GBP 75K-101KAWS | Ansible | Apache Kafka | Azure | Cloud hybridCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeRemote, United Kingdom R3d ago
-
Senior AI/ML engineer GBP 120K-150KAWS | CI/CD | Databricks | Deep learning | Delta LakeAccelerated professional growth | Enhanced parental leave | Female health leave | Fully paid sabbatical | Health pension wellbeing benefitsSenior-level Full TimeLondon R3d ago
-
Lead Software Engineer - Python, Databricks, AWS GBP 72K-100KAWS | AWS Step Functions | Agile | Airflow | Apache SparkSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom3d ago
-
Staff ML Engineer, Gaia GBP 146K-162KData Pipelines | Debugging | Deep learning | Distributed Training | Machine LearningHybrid workSenior-level Full TimeLondon3d ago
-
Software Engineer II - Applied AI GBP 57K-70KAI Applications | AWS | Amazon SageMaker | Azure | Cloud NativeMid-level Full TimeLONDON, LONDON, United Kingdom3d ago
-
Senior or Principal Data Scientist GBP 50K-65KData Modeling | Data Pipelines | Data Visualization | Data Wrangling | Data cleaningMentorship opportunities | Professional developmentSenior-level Full TimeUnited Kingdom3d ago
-
Market Data Engineer GBP 58K-108KAeron | Apache Arrow | Bloomberg | ClickHouse | FASTCareer development and internal mobility | Discretionary bonus | Group life insurance | Gym discounts | Holiday allowanceMid-level Full TimeLondon, United Kingdom3d ago
-
Junior Analytics Engineer GBP 30K-35KArtificial Intelligence | DBT | Data Modeling | Data pipeline | ELTCycle to work scheme | Electric vehicle salary sacrifice | Employee referral program | Flexible working | Office meals and snacksEntry-level Full TimeLondon R3d ago
-
Alteryx | Business Requirements | Data Analysis | Data Reconciliation | Data TransformationFlexible resources | Paid leave | Paid volunteer time | Wellbeing programsExecutive-level Full TimeManchester, Greater Manchester, United Kingdom3d ago
-
Digital Chemist - Lab Automation & Data Science GBP 28K-28KData Analysis | Data Processing | Data Visualization | Hardware Integration | Laboratory automationBonus scheme | Life insurance | Paid time off | Pension plan | Private medical insuranceMid-level Full TimeBracknell, BERKSHIRE, United Kingdom3d ago