Lead Data Engineer
Leicester, Leicestershire, United Kingdom
GBP 64K-79K Senior-level Full Time
Tasks
- Build and maintain ETL processes
- Collaborate with data scientists on data requirements and infrastructure
- Deploy machine learning models into production
- Design and develop scalable data pipelines
- Ensure data quality and integrity
- Ensure data security across data platforms
- Manage and optimize databases and data warehouses
- Monitor and maintain deployed machine learning models
- Optimize spark performance and scalability
- Translate data science prototypes into production solutions
Perks/Benefits
- N/A
Skills/Tech-stack
API | Apache Spark | CI/CD | Data Modeling | Data Quality | Data Security | Databricks | ETL | MLflow | NoSQL | PyTorch | Python | Relational databases | SQL | Scikit-learn | TensorFlow | Terraform
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | ML Ops Engineer | Ops Engineer
Related jobs
-
C++ | JAX | Machine Learning | Performance Tuning | ProfilingMid-level Full TimeLondon, UK3h ago
-
AWS SageMaker | Amazon Bedrock | Amazon ECS | Amazon EKS | Amazon S3Senior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom4h ago
-
API Design | AWS | Amazon Bedrock | Amazon ECS | Amazon EKSMid-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom4h ago
-
Lead Data Analyst GBP 83K-98KAutomation | Board reporting | DAX | Data Controls | Data Governance28 days annual leave | Bank holidays | Employer pension matching | Hybrid work 50 percent home office | Private medical insuranceSenior-level Full TimeEdinburgh, GB7h ago
-
Machine Learning Engineer GBP 70K-85KAWS | Anomaly Detection | Apache Spark | Azure | Data ProcessingMid-level Full TimeGlasgow Campus, United Kingdom14h ago
-
Lead Data Engineer GBP 86K-106KAWS | Apache Airflow | Azure | CI/CD | DBTFlexible working | Gym membership | Share scheme | Training budget | Volunteering daysSenior-level Full TimeBirmingham, England, United Kingdom14h ago
-
Sr. Applied AI Engineer GBP 90K-115KAWS | Azure | GCP | Generative AI | Machine LearningHome-office equipment | Hybrid work model | Self-development budgetSenior-level Full TimeLondon Office15h ago
-
Applied AI Engineer GBP 80K-95KAPI Integration | Generative AI | Machine Learning | Python | REST APIsHome office setup | Hybrid work model | Mentorship | Self-development budgetMid-level Full TimeLondon Office15h ago
-
Mid-level Full TimeLeeds/Sheffield/Manchester, UK (Hybrid) R16h ago
-
21 CFR | 21 CFR Part 11 | Audit trails | CFR Part 11 | Cloud platformAnnual bonus | Comprehensive benefits package | Equity compensation | Hybrid workSenior-level Full TimeLondon, England17h ago
-
Senior Data Engineer, Unified Platform GBP 73K-95KAirflow | Amazon S3 | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeLondon21h ago
-
Team Lead, Data Engineering GBP 90K-109KBatch Processing | Communication | Data Engineering | Data Governance | Data ModelingSenior-level Full TimeLondon21h ago
-
Machine Learning Engineer GBP 68K-85KComputer Vision | Convolutional Neural Networks | Deep learning | Diffusion Models | Generative ModelsCycle garage and showers | Dental scheme | Free soft drinks | Hybrid working | On-site barSenior-level Full TimeUnited Kingdom, London21h ago
-
Machine Learning Engineer (Recommenders) GBP 70K-85KCI/CD | Deep learning | Distributed Computing | Docker | GPU ComputingEmployee discount | Flexible benefits allowance | Inclusive workplace | Online learning resources | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom22h ago
-
APIs | Azure | CI/CD | Data Governance | Distributed SystemsBi weekly engineering gatherings | Carbon footprint offset via Ecologi | Company laptop and tools | Company social events | Enhanced family policySenior-level Full TimeMoorgate, SouthEast EC2, United Kingdom R1d ago
-
Associate Principal Engineer (Big Data) GBP 55K-65KAirflow | Apache Kafka | CI/CD | Cloud Computing | CybersecurityMid-level Full TimeLondon, United Kingdom1d ago
-
Apache Airflow | Apache Flink | Azure | CI/CD | ComplianceSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer Support Officer GBP 50K-50KConfluence | Database performance | Database performance tuning | ETL | ITILHybrid workingMid-level Full TimeGB-ENG-LAN-Preston1d ago
-
Lead Data Architect GBP 86K-102KBusiness Intelligence | Data Architecture | Data Engineering | Data Governance | Data LineageFlexible work location | Hybrid working | Team leadership and coachingSenior-level Full TimeNewbury, England, United Kingdom1d ago
-
AWS | AWS Lambda | AWS S3 | AWS Step Functions | AgileSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Data Science Lead GBP 75K-75KAzure DevOps | CI/CD | Data Lakes | Data Versioning | Data WarehousingCareer breaks | Income protection | Life assurance | Paid time off | PensionSenior-level Full TimeEdinburgh, Scotland, United Kingdom1d ago
-
Apache Airflow | Apache Spark | App Service | Azure | Azure AppMid-level Full TimeLondon, United Kingdom1d ago
-
Predictive Analytics Lead GBP 75K-85KClassification | Data Visualization | Forecasting | Model Validation | PandasSenior-level Full TimeSlough, United Kingdom1d ago
-
Apache Lucene | Conversational AI | Elasticsearch | Java | Language ModelsFamily benefits | Flexible working arrangements | Generous time off | Hybrid working patterns | On-site nurseryEntry-level Full TimeHinxton, United Kingdom1d ago
-
AI | Authoritative Data | Authoritative Data Sourcing | Data Engineering | Data GovernanceBike4Work scheme | Continuous learning | Flexible working | Gym benefits | Hybrid workingMid-level Full TimeLondon, 21 Moorfields, United Kingdom R1d ago