Lead Data Engineer
Tasks
- Architect streaming and micro batch solutions
- Build real time sportsbook data feeds
- Contribute to technical proposals and architecture reviews
- Design low-latency data pipelines
- Implement AWS data platform services
- Implement data integrity controls
- Lead data migrations to AWS
- Mentor data engineers and set coding standards
- Support regulatory reporting and lineage
Perks/Benefits
Skills/Tech-stack
AWS | AWS CDK | AWS Glue | AWS Lambda | Amazon Athena | Amazon Kinesis | Amazon MSK | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cloud Dataflow | DBT | Data Factory | Databricks | Google BigQuery | Google Cloud | Google Cloud Dataflow | Great Expectations | Lake Formation | MWAA | Python | SQL | Snowflake | Spark Streaming | Step Functions | Synapse Analytics | Terraform
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Data Engineer GBP 70K-70KAgile | Behavior-Driven Development | CI/CD | Code review | Data EngineeringDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceSenior-level Full TimeLondon, United Kingdom18h ago
-
Data Engineer GBP 57K-57KAgile | Alteryx | Automated testing | Behavior-Driven Development | CI/CDDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceMid-level Full TimeLondon, United Kingdom18h ago
-
Principal Data Engineer GBP 50K-60KAWS | AWS CDK | AWS Glue | AWS Lake Formation | AWS LambdaFlexible working | Hybrid work options | Learning and development | Remote work options | Supportive cultureSenior-level Full Timeleeds, Manchester19h ago
-
Senior Machine Learning Engineer GBP 72K-85KBatch Machine Learning | CI/CD | Containerization | Data Pipelines | Data parallelismDisability accommodations during hiring process | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom19h ago
-
Data Engineer GBP 51K-55KApache Airflow | Azure Data | Azure Data Factory | Azure Functions | C#Hybrid work options | Knowledge sharing culture | Professional growth opportunities | Work flexibilityMid-level Full TimeBristol, 3 RIVERGATE, United Kingdom20h ago
-
Entry-level Full Time17th Floor, 5 Aldermanbury Square, London, …21h ago
-
Software Engineering III - AI/ML Engineer GBP 80K-109KAWS | Automation | Databricks | Datadog | Disaster RecoverySenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Data Engineer GBP 80K-110KAirflow | Anomaly Detection | BigQuery | CDC | CI/CDEquity | Health insurance | Income protection | Life cover | Pension planSenior-level Full TimeGreater Manchester, England, United Kingdom1d ago
-
Quantitative / AI Specialist GBP 50K-60KAPI Integration | Analytics | Artificial Intelligence | C++ | Electronic PricingEntry-level Full TimeLondon, United Kingdom1d ago
-
Staff Applied Scientist GBP 110K-160KCloud Computing | Complex Planning | Data Analysis | Deep learning | Explainable AIEMI share option scheme | Generous share options | Hybrid work schedule | Mentoring and coaching cultureSenior-level Full TimeLondon1d ago
-
Senior Applied Scientist GBP 100K-120KBlack | Cloud Computing | Deep learning | Git | GitHubEMI share option scheme | Remote work hybrid scheme | Share options | Tax efficient equity scheme | Team days in personSenior-level Full TimeLondon1d ago
-
365 Admin Center | Access Control | Admin Center | Data Cleansing | Data GovernanceEntry-level Contract Full Time TemporaryCanary Wharf, 1 Churchill Place, United …1d ago
-
Senior AWS Data Platform Developer GBP 72K-85KAWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS Lake FormationSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
ML/AI Engineer GBP 70K-85KAutoscaling | Blue/green | CI/CD | CUDA | CanaryAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeManchester Westminster House, United Kingdom1d ago
-
Responsible AI Lead GBP 90K-110KAgent Builder | BigQuery | CI/CD | Cloud Run | Cloud SQLAnnual bonus | Discounted shopping | Flexible working | Hybrid working | Job shareSenior-level Full TimeManchester Westminster House, United Kingdom1d ago
-
Lead AI Scientist GBP 90K-131KAI Ops | Agentic AI | Artificial Intelligence | Bias Mitigation | Cloud platformAnnual bonus | Discounted shopping | Flexible working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom1d ago
-
AI Engineer / AI Analyst GBP 60K-80KAI Evaluation | Agent systems | CI/CD | Cloud Computing | ComplianceCycle to work scheme | Employee Assistance Programme (EAP) | Employer pension contributions | Health related time off | Hybrid workingMid-level Full TimeUK-London-Chiswick Bldg 5 Floor 4, United …1d ago
-
Lead Data Warehousing Engineer GBP 75K-100KArtificial Intelligence | CRM | Data Governance | Data Ingestion | Data LineageCollaborative inclusive team | Employee benefits | Flexible working arrangements | Opportunities for internal mobilitySenior-level Full TimeLN - 25 Cabot Square, United …1d ago
-
Lead Data Analyst – Operational Excellence (FTC) GBP 72K-74KActivity-based costing | Cluster Analysis | Cost modelling | Data Modelling | Data QualityBenefit allowance | Flexible benefits | Healthcare cash plan | Holiday allowance | Pension schemeSenior-level Full TimeSouthampton - Quilter House, United Kingdom1d ago
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom1d ago
-
Applied AI Engineer GBP 85K-110KA/B | A/B Testing | Anthropic | B testing | ExperimentationFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetMid-level Full TimeUnited Kingdom R2d ago
-
Lead AI Engineer (AI Systems & Automation) GBP 78K-109KAlerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetSenior-level Full TimeUnited Kingdom R2d ago
-
Applied AI Engineer GBP 70K-85KCloud Computing | Data Modeling | Deep learning | Docker | LLM DeploymentFully expensed tech | Meal allowance | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom3d ago
-
Forward Deployed Engineer - Defence GBP 65K-90KAngular | Artificial Intelligence | Full Stack | Full-Stack Development | GitEqual opportunity | Technical training | Travel as neededMid-level Full TimeLondon, Greater London, England, United Kingdom3d ago
-
Lead Data Scientist GBP 72K-82KAnomaly Detection | Bayesian Methods | C# | Cross-validation | Data VisualizationHybrid working | Life assurance | Pension contribution | Private medical insurance | Professional certifications supportedSenior-level Full TimeLeeds, England, United Kingdom3d ago