Lead Data Engineer - Python, Databricks, React
GLASGOW, LANARKSHIRE, United Kingdom
GBP 90K-109K (estimate) Senior-level Full Time
Tasks
- Build data collection storage access and analytics solutions
- Develop preventative controls for data quality
- Identify data lineage and provenance
- Implement data governance and security controls
- Improve metadata semantic layer for AI readiness
- Maintain data pipelines and architectures
- Manage access, security, and compliance
- Perform data quality root cause analysis
- Prototype and deploy analytics tooling
- Validate AI assisted outputs and handle sensitive data
Perks/Benefits
Skills/Tech-stack
Agile | Apache Spark | Cloud Platforms | Data Catalog | Data Engineering | Data Governance | Data Lineage | Data Management | Data Quality | Data profiling | Databricks | LLMOps | MLOps | Metadata Management | Natural Language | Natural language query | Python | R | SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
API Design | AWS | AWS Bedrock | Apache Airflow | Apache IcebergSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom7h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeDerby, United Kingdom17h ago
-
Full Stack Engineer- Data Science Focus GBP 80K-90KAWS CDK | AWS CloudFormation | AWS Fargate | AWS Glue | AWS LambdaMid-level Full TimeDerby, United Kingdom18h ago
-
Lead Data Analyst GBP 69K-90KAnalytics engineering | DBT | Dashboards | Python | SQLCareer growth | Data-driven environment | Direct feedback | Flexible independent work environment | High-growth environmentSenior-level Full TimeLondon23h ago
-
Data Engineer III - Python, Databricks, React GBP 74K-109KAI Assisted Development | Access Control | Agile | Apache Spark | Cloud PlatformsSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom23h ago
-
Data Engineer GBP 50K-60KAgile | Apache Airflow | Azure | Azure Data | Azure Data FactoryChristmas closure | Disability confident employer interview scheme | Health insurance | Paid time off | Pension planEntry-level Full TimeNewcastle upon Tyne, United Kingdom R23h ago
-
Sr. Solutions Engineer GBP 80K-108KAWS | Apache Spark | Cloud platform | Data Engineering | Delta LakeFlexible customer facing role | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom1d ago
-
AWS | Automated testing | CI/CD | Cause analysis | Code reviewSenior-level Full TimeLONDON, United Kingdom1d ago
-
AWS | Agile | Apache Spark | Automated testing | CI/CDSenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Data Analytics Engineer GBP 53K-60KAWS | AWS Glue | Airflow | Amazon Redshift | DBTAnnual Holiday Vouchers | Company bonus scheme | Discounted flights | Flexible benefits | Free easyJet Plus membershipMid-level Full TimeUnited Kingdom-London-London Luton Airport R1d ago
-
Machine Learning Engineer (All Levels) GBP 50K-95KAWS | Apache Spark | CI/CD | Code review | Computer Vision3 days per week on site | Flexible working | Hybrid working | Workplace adjustments supportSenior-level Full TimeBristol, UK R1d ago
-
Data Engineer GBP 51K-51KAgile | Cognos | Data Modeling | Data Warehousing | Data virtualizationBalanced lifestyle | Flexible working arrangements | Hybrid working | Learning opportunities | Support for financial wellbeingMid-level Full TimeGB-ENG-LAN-Warton R1d ago
-
Analytics Engineer GBP 45K-60KDBT | Data Documentation | Data Modeling | Data Observability | Data TestingDiscounts via Cobens Extras | Dog-friendly office | Duvet Day | Financial coaching | Flexible workEntry-level Full TimeLondon, England, United Kingdom R1d ago
-
Business Engineer GBP 70K-90KAI ethics | Agent Orchestration | Bias Mitigation | Code review | JavaTravelSenior-level Full TimeLondon, UK1d ago
-
Data Engineer GBP 55K-57KData Engineering | Data Modeling | Data Transformation | Data Warehousing | Data integrationDiscounted gym membership | Electric vehicle leasing | Experience days | Flexible working | Life assuranceMid-level Full TimeLondon, United Kingdom1d ago
-
Software Engineer, AI/ML, PhD, Early Career GBP 80K-95KArtificial Intelligence | Data Mining | Data Storage | Data Structures | Data structures algorithmsMid-level Full TimeLondon, UK1d ago
-
Senior Data Engineer GBP 74K-90KAccess Control | Airflow | Analytics engineering | BigQuery | CI/CDAgile working | Career coaching | Enhanced parental leave | Occasional travel | Pension matchingSenior-level Full TimeWoking Office1d ago
-
Data Engineer GBP 65K-65KAccess Management | Agile | Azure Data | Azure Data Factory | Azure Data LakeCareer pathways | Cycle to work scheme | Discounted staff pet care | Flexible working | Green Cars salary sacrifice schemeMid-level Full TimeKeynsham, Bristol, England1d ago
-
API Design | Amazon SQS | BGP | BMC | CI/CDSenior-level Full TimeLondon1d ago
-
Apache Airflow | Apache Spark | Batch data | Batch data pipelines | Data GovernanceProfessional growth | Remote-first work environment | Well-being supportSenior-level Contract Full TimeGreater London R1d ago
-
Machine Learning Engineer, Memory GBP 80K-127KAgile | Foundation Models | Language Processing | Long Context | Machine LearningCoaching | Critical illness insurance | Cycle to work scheme | Dental insurance | Disability insuranceMid-level Full TimeLondon,England,United Kingdom1d ago
-
Senior Data Engineer GBP 70K-75KAWS | Agile | Apache Spark | Azure | CI/CD25 days annual leave | Cycle to work scheme | Discounted gym membership | Employee-led clubs and events | Employer pension schemeSenior-level Full TimeEdinburgh1d ago
-
AI Software Engineering Specialist GBP 165K-315KAnthropic | Autogen | Braintrust | CI/CD | Cost ManagementMid-level Full TimeNewcastle, Cobalt Business Park Bldg 9C, …1d ago
-
Machine Learning Engineer GBP 70K-90KA/B | A/B Testing | B testing | C++ | ClassificationFlexible work schedule | In office 4 plus days per weekMid-level Full TimeLondon - 50 Cowcross Street, United …1d ago
-
Principal Data Engineer GBP 74K-88KAirflow | Apache Kafka | Automated alerting | BigQuery | Cloud ComposerCareer progression | Community work time | Extra time off for volunteering | Hybrid work model | Mentoring opportunitiesSenior-level Full TimeCity of London - United Kingdom R1d ago