Lead Software Engineer — Java, Spark, Kubernetes, AWS, Databricks
GLASGOW, LANARKSHIRE, United Kingdom
GBP 86K-109K (estimate) Senior-level Full Time
Tasks
- Build infrastructure as code
- Build scalable Spark jobs
- Define CI CD and automated testing practices
- Design microservices and data processing frameworks
- Develop cloud architecture on AWS
- Enforce Kubernetes runtime standards
- Enforce security and compliance controls
- Implement RBAC encryption and auditability
- Implement resilient observable services
- Instrument observability and incident runbooks
- Lead architecture and delivery of data pipelines
- Mentor engineers and run code reviews
- Optimize Databricks performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS IAM | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon EC2 | Amazon Kinesis | Amazon S3 | Amazon VPC | Amazon Web Services | Apache Spark | Audit Logging | Automated testing | CI/CD | Data Quality | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Distributed tracing | Docker | Encryption | GRPC | Infrastructure as Code | Java | Kafka | Kubernetes | Observability | RBAC | REST | SQL | Schema evolution | Step Functions | Unity Catalog | Web Services | “as-code”
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Member of Technical Staff - Infrastructure Supercompute GBP 240K-325KAnsible | Containerization | Infrastructure as Code | Kubernetes | PulumiSenior-level Full TimeLondon, UK1d ago
-
Member of Technical Staff - Hardcore Supercompute GBP 240K-325KAnsible | Containers | Debugging | Distributed Systems | DockerSenior-level Full TimeLondon, UK1d ago
-
Mid-level Full TimeWorsley1d ago
-
Agents | Agile | Application development | CI/CD | CloudSenior-level Full TimeLONDON, United Kingdom1d ago
-
Agents | Agile | CI/CD | Cloud | Continuous DeliverySenior-level Full TimeLONDON, United Kingdom1d ago
-
Architecture | Big Data | Continuous integration | Data Pipelines | Distributed SystemsSenior-level Full TimeLondon1d ago
-
Analytics Engineer GBP 60K-72KAWS | Amazon QuickSight | Amazon Redshift | Apache Airflow | CI/CDCompany events | Employee resource groups | Extended parental leave | Health coverage | Learning pathsSenior-level Full TimeLiverpool, United Kingdom R1d ago
-
AI Engineer GBP 125K-165KAWS | Agent Frameworks | Amazon Bedrock | Anthropic Claude | AzureEquity | Learning and development stipend | WFH equipment allowance | Wellbeing benefitMid-level Full TimeCopenhagen, DK; London, UK1d ago
-
Junior Analytics Engineer GBP 30K-35KDBT | Data Modeling | Data Pipelines | Data Quality | LLMInclusive workplace | Private health insurance | Work from home Mondays and FridaysEntry-level Full TimeLondon, United Kingdom1d ago
-
Senior-level Full TimeManchester1d ago
-
Data Engineer (Python, SQL, Microsoft Fabric) GBP 40K-50KETL | Microsoft Fabric | Python | SQLAnnual leave | Hybrid work flexibility | Pension | Personal development opportunities | Private healthcareMid-level Full TimeChester, England and Wales, United Kingdom1d ago
-
Machine Learning Engineer GBP 70K-85KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingMid-level Full TimeLondon1d ago
-
Software Engineer (Leadership) - Machine Learning GBP 160K-215KAgent Orchestration | Apache Hive | Apache Pig | Apache Spark | Bias MitigationSenior-level Full TimeZurich, Switzerland | Remote, UK | … R1d ago
-
Analytics Engineer (Mid-level) GBP 50K-65KAI/ML | AI/ML workflows | Apache Spark | Azure | Azure DataHybrid working | Permanent contractMid-level Full TimeLondon Hybrid R1d ago
-
AWS | BigQuery | CI/CD | Cypress | Docker25 days holiday | Choice of laptop | Commuter support | Company socials | Cycle to work schemeSenior-level Full TimeLondon1d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Laid-back atmosphere | Remote-friendlyMid-level Full TimeCambridge, United Kingdom1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | Data pipelineAsynchronous culture | Flexible management style | Remote-friendly, distributed teamMid-level Full TimeLeeds, United Kingdom1d ago
-
Data Engineer GBP 40K-50KDAX | Data Governance | Data Modeling | Data Quality | Data TransformationCollaborative inclusive work environment | Growth and career development | Opportunity to work on innovative projects | Professional development opportunitiesMid-level Full TimeBanbury, United Kingdom1d ago
-
Data Quality Lead GBP 65K-79KData Governance | Data Quality | Data Standards | Data profiling | Data quality frameworksFlexible working | Hybrid working | Reasonable adjustments providedSenior-level Full TimeLondon - 133 Houndsditch, United Kingdom1d ago
-
Data Quality Lead GBP 65K-79KData Governance | Data Modeling | Data Quality | Data Standards | Data StewardshipFlexible working | Hybrid working | Reasonable accommodationsSenior-level Full TimeLondon - 133 Houndsditch, United Kingdom1d ago
-
Analytics Engineer GBP 60K-75KAttribution | Data Documentation | Data Modeling | Data Quality | Data TestingHybrid workSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Database Reliability Engineer GBP 70K-90KAnsible | Backup and Recovery | Best practices | CI/CD | Database observabilityAccess to SS C University | Competitive holiday scheme | Hands-on, team-customized training | Hybrid work model | Professional development reimbursementSenior-level Full TimeLondon UK, United Kingdom1d ago
-
Data Engineer GBP 40K-50KDAX | Data Governance | Data Modeling | Databricks | ETLCollaborative and inclusive work environment | Global company benefits package | Opportunity to work on innovative projects | Professional development and growth opportunitiesMid-level Full TimeBanbury, United Kingdom1d ago
-
Technology Optimization Program Lead GBP 75K-101KCommunication | Java | Program coordination | Python | Stakeholder managementCharity volunteering days | Contributory pension scheme | Electric vehicle scheme | Employee assistance programme | Employee discountsSenior-level Full TimeUK - London (London Wall), United …1d ago
-
Specialist Embedded Software Engineer GBP 39K-54K4G | 5G | Agile | Bash | BroadbandAnnual leave | Carer’s leave | Colleague discounts | Family leave | Life assuranceSenior-level Full TimeRiverside Tower, Belfast (N.I), United Kingdom1d ago