Lead Software Engineer — Java, Spark, Kubernetes, AWS, Databricks
GBP 86K-109K (estimate) Senior-level Full Time
Tasks
- Build infrastructure as code
- Build scalable Spark jobs
- Define CI CD and automated testing practices
- Design microservices and data processing frameworks
- Develop cloud architecture on AWS
- Enforce Kubernetes runtime standards
- Enforce security and compliance controls
- Implement RBAC encryption and auditability
- Implement resilient observable services
- Instrument observability and incident runbooks
- Lead architecture and delivery of data pipelines
- Mentor engineers and run code reviews
- Optimize Databricks performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS IAM | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon EC2 | Amazon Kinesis | Amazon S3 | Amazon VPC | Amazon Web Services | Apache Spark | Audit Logging | Automated testing | CI/CD | Data Quality | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Distributed tracing | Docker | Encryption | GRPC | Infrastructure as Code | Java | Kafka | Kubernetes | Observability | RBAC | REST | SQL | Schema evolution | Step Functions | Unity Catalog | Web Services | “as-code”
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Scientific Data Engineer GBP 50K-55KAmazon Web Services | Automated testing | Cloud Orchestration | Cloud platform | CondaBank holidays | Coffee tea snacks | Critical illness coverage | Cycle to work scheme | EMI share optionsMid-level Full TimeEC2A1AJ, London, England, United Kingdom10h ago
-
Machine Learning Engineeer GBP 46K-50KAmazon Web Services | Automated testing | Bayesian Modelling | Cloud Pipeline | Cloud pipeline orchestrationCoffee and tea | Critical illness coverage | Cycle to work scheme | EMI share options | Employer pensionMid-level Full TimeEC2A1AJ, London, England, United Kingdom10h ago
-
Data Engineer 12 month FTC GBP 47K-56KAnalysis Services | Apache Spark | Artificial Intelligence | Azure Analysis | Azure Analysis ServicesCareer growth | Flexible working options | Work-life balanceEntry-level Contract Full Time TemporaryBirmingham, England, United Kingdom14h ago
-
Data Science and Analysis Team Lead GBP 53K-58KAzure | Charting | DBT | Data Cleansing | Data QualityFlexible benefits | Hybrid work | Life assurance | Paid holiday | Pension planSenior-level Full TimeHemel Hempstead, England, United Kingdom R1d ago
-
Partnership Analytics Lead - 14 Months FTC GBP 70K-95KAzure Foundry | Copilot Studio | DBT | Data Modeling | Microsoft FabricHybrid work | Work from home daysSenior-level ContractLondon, England, United Kingdom R1d ago
-
Senior Data Engineer GBP 60K-78KAWS | Airflow | Asynchronous programming | CI/CD | DBTAnnual leave | Background check | Learning and development opportunities | Paid public holidays | Paid time offSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Embedded Audio Firmware Engineer GBP 52K-70KAdaptive filtering | Assembly | C# | CI/CD | CMakeHybrid remote work | Relocation supportSenior-level Full TimeNewbury, England1d ago
-
Senior AI Engineer GBP 70K-90KAWS | AWS Bedrock | Agentic AI | Alembic | Amazon S3Employee assistance programme | Enhanced maternity leave | Extra annual leave | Group life assurance | Health & wellbeing platformSenior-level Full TimeBournemouth, United Kingdom1d ago
-
Software Engineer II, Embedded Systems/Firmware GBP 48K-55KAlgorithms | C# | C++ | Computer Science | Data StructuresSenior-level Full TimeLondon, UK1d ago
-
Senior Machine Learning Engineer GBP 65K-90KA/B | A/B Testing | B testing | Classification | Deep learningSenior-level Full TimeLondon - The River Building HQ1d ago
-
Senior Machine Learning Engineer GBP 65K-88KAgentic AI | CircleCI | Data Drift | Data Drift Detection | DockerContinuous learning | Flexible working | Hybrid work setupSenior-level Full TimeLondon - The River Building HQ R1d ago
-
Data Engineer GBP 70K-87KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EKSEmployee assistance program | Flexible work | Generous leave | Holistic wellbeing programs | Learning platform accessSenior-level Full TimeUK, United Kingdom1d ago
-
Senior-level Full TimeLondon - The River Building HQ1d ago
-
Lead Data Engineer GBP 80K-96KAWS | Agile | Apache Spark | CI/CD | Cloud platformAnnual leave | Cycle to work scheme | Discounted gym membership | Employer pension scheme | Family leaveSenior-level Full TimeEdinburgh1d ago
-
AI Engineer GBP 45K-73KAgent systems | CI/CD | Cloud platform | Google Cloud | Google Cloud PlatformFlexible working | Hybrid working | Job shareEntry-level Full TimeLeeds Wellington Place, United Kingdom2d ago
-
Data Governance and Reporting Lead GBP 52K-52KData Catalog | Data Compliance | Data Governance | Data Integrity | Data ManagementAnnual leave | Cycle to work | Discounts and employee deals | Electric vehicle schemes | Healthcare benefitsSenior-level Full TimeScottishPower HQ, United Kingdom2d ago
-
Senior Staff Generative AI Engineer, Vice President GBP 110K-130KAgentic Frameworks | CI/CD | Code review | Continuous Delivery | Continuous integrationAccess to AI assisted development tools | Hybrid work model | Learning resources | Mentorship cultureSenior-level Full Time40 BANK STREET, United Kingdom2d ago
-
Data Engineer - Multi-Cloud GBP 38K-50KAWS | AWS Lambda | Agile | Amazon EC2 | Amazon EMRDeath in service cover | Electric vehicle leasing | Paid holiday | Pension scheme | Private medical coverMid-level Full TimeLondon, England, United Kingdom2d ago
-
Senior Data Engineer - Multi-Cloud GBP 70K-80KAWS | AWS Lambda | Amazon EC2 | Amazon EMR | Amazon S3Death in service cover | Electric vehicle leasing | Holiday allowance | Mentorship | Pension schemeSenior-level Full TimeLondon, England, United Kingdom2d ago
-
Associate - Funds Data Stewardship GBP 44K-50KData Distribution | Data Governance | Data Quality | Excel | MiroEducation reimbursement | Emotional well-being support | Family support programs | Flexible time off | Hybrid work modelMid-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R2d ago
-
Forward Deployed Engineer GBP 66K-80KAI Agent | AI Agent Frameworks | AI/ML | AI/ML concepts | API IntegrationSenior-level Full TimeUnited Kingdom - Remote R2d ago
-
Senior Data Engineer GBP 80K-100KAI Search | Apache Spark | Azure AI | Azure AI Search | Azure DataAnnual leave | Employee assistance programme | Employee referral bonus | Enhanced maternity and paternity leave | Life assuranceSenior-level Full TimeLondon, England, United Kingdom2d ago
-
Senior Data Warehouse Engineer GBP 50K-55KAWS Glue | Agile | Alerting | Apache Airflow | CI/CDEmployee assistance program | Employee discounts | Family care leave | Flexible work-life balance | Flexible working hoursSenior-level Full TimeUK-Oxford (Nielsen House), United Kingdom2d ago
-
Senior Data Warehouse Engineer GBP 50K-55KAWS Glue | AWS Lambda | AWS SNS | AWS Secrets | AWS Secrets ManagerCommuting allowance | Employee assistance program | Employee discounts | Family care leave | Flexible working hoursSenior-level Full TimeUK-Oxford (Nielsen House), United Kingdom2d ago
-
Senior Systems Engineer, Data Management, London GBP 50K-70KAccess Control | Apache Airflow | Apache Kafka | Apache Spark | Business IntelligenceSenior-level Full TimeLondon, United Kingdom2d ago