Senior Kubernetes Engineer – Data Platform
London, United Kingdom of Great Britain and Northern Ireland
GBP 70K-95K (estimate) Senior-level Contract
Tasks
- Build and maintain metadata lineage and governance capabilities
- Collaborate with platform and data engineering teams
- Design and build Kubernetes centric platform services for distributed data workloads
- Develop and optimize data ingestion and transformation pipelines with Apache Spark
- Implement scalable data processing patterns with object storage S3
- Improve platform observability using metrics logs and tracing
- Mentor engineers and contribute to best practices for Kubernetes and data platforms
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Apache Hadoop | Apache Iceberg | Apache Spark | Custom Resource Definitions | Data Governance | Data Lineage | Delta Lake | Grafana | Infrastructure as Code | Kubernetes | Kubernetes Operators | Metadata Management | OpenTelemetry | Prometheus | “as-code”
Education
N/A
Related jobs
-
Mid-level Full TimeStoke-on-Trent, England, United Kingdom14h ago
-
AI Engineer GBP 45K-50KAI Search | Azure AI | Azure AI Search | Azure OpenAI | DatabricksAbility to purchase additional annual leave | Annual leave | Discretionary bonus scheme | Employee assistance program | Employee share purchase planMid-level Full TimeLondon, United Kingdom15h ago
-
Junior Data Engineer GBP 30K-34KCyber Security | Data Assurance | Data Engineering | Data Governance | Data IngestionEntry-level Full TimeManchester, Greater Manchester, United Kingdom16h ago
-
Data Engineering Lead - Value & Analytics GBP 38K-46KAWS | Azure | Cloud Architecture | Cybersecurity | Data GovernanceHybrid workSenior-level Full TimeUnited Kingdom R1d ago
-
AWS | Agile | Apache Spark | Azure | BitbucketExecutive-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
API Management | Apache Spark | Azure API | Azure API Management | Azure DataSenior-level Contract Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Mid-level Full TimeTrimble Offices, Morley1d ago
-
Cloud Data Platform Software Engineer II GBP 72K-94KAWS Glue | Agile | Amazon Kinesis | Amazon Redshift | Apache BeamCareer growth opportunities | Diversity and inclusion culture | Learning opportunitiesEntry-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Engineer - Infra GBP 68K-85KApache Airflow | Apache Kafka | Apache Spark | ClickHouse | GrafanaSenior-level Full TimeLondon, England, GB1d ago
-
Mid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer (Crypto) 12mth FTC-1 GBP 53K-73KAWS EventBridge | AWS Glue | AWS Lambda | AWS Redshift | AWS Step FunctionsEmployee assistance program | Flexible benefits | Hybrid work | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R2d ago
-
Data Engineer GBP 39K-39KAmazon Redshift | Amazon Web Services | Apache Spark | CI/CD | Cloud platformEducation grant for private schooling | Flexible working arrangements | Free shuttle bus to work | Generous time off | Hybrid workingMid-level Full TimeHinxton, United Kingdom2d ago
-
DevOps Engineer GBP 80K-109KAWS | Ansible | CloudFormation | Containers | Continuous DeploymentBlameless postmortems | On-call rotationSenior-level Full TimeLondon, United Kingdom2d ago
-
Senior Data Engineer GBP 70K-80KAWS | Agile | CCPA | CI/CD | Cloud platformCharity involvement | Discretionary bonus schemes | Health and well-being support | Learning hub access | Sustainability initiativesSenior-level Full TimeLuton, GB, LU2 9TN2d ago
-
SAP Data & Analytics Architect Senior Manager GBP 60K-80KAI and Machine Learning | AI enablement | APIs | Agile | Analytics CloudSenior-level Full TimeLondon2d ago
-
Senior Data Engineer -Quantexa GBP 70K-74KApache Spark | Azure DevOps | CI/CD | Contextual Data Modeling | Contextual dataFlexible hours | Office work on demand | Part-time options | Work from homeSenior-level Full TimeLondon2d ago
-
Lead Platform Engineer GBP 75K-85KAI Safety | AWS Step Functions | Amazon EKS | Amazon SageMaker | Apache AirflowSenior-level Full TimeGlasgow Campus, United Kingdom2d ago
-
Sr Software Quality Engineer (Exp w/ AI Techniques) USD 90K-112KAPI Testing | APM | Agile | Azure | Azure DevOpsCharitable giveback day | Community service projects | Medical/Dental/Vision insurance | Paid time off | Retirement benefitsSenior-level Full TimeBedford, United States2d ago
-
Data Engineer GBP 45K-45KAccess Control | Apache Spark | Automated Deployment | Azure Data | Azure Data FactoryFamily-friendly benefits | Flexible working | Generous annual leave | Pension scheme | Personalized career developmentMid-level Full TimeGlasgow, Scotland, United Kingdom2d ago
-
Data Engineer GBP 47K-61KAgile delivery | Analytics | Business Intelligence | By Design | Data Engineering33 days annual leave | Annual buy and sell holidays | Contributory pension scheme | Cycle to work scheme | Flexible working schemeMid-level Full Time6369 UK Mobile Worker, United Kingdom2d ago
-
Data Engineer GBP 80K-95KAWS | AWS CDK | AWS CloudFormation | AWS Step Functions | AirflowCollaborative & Inclusive Culture | Flexible working | Professional development | Work-life balanceSenior-level Full TimeLondon, England, United Kingdom3d ago
-
Senior-level Full TimeLondon, United Kingdom3d ago
-
Data Engineer, Ads Auction Platform GBP 75K-91KA/B | A/B Testing | Apache Airflow | B testing | Batch ProcessingCommuter benefits | Health benefits | Paid time off | Remote work flexibility | Retirement benefitsSenior-level Full TimeManchester, United Kingdom3d ago
-
Machine Learning Engineer GBP 90K-115KAWS | Azure | Cloud Architecture | Docker | ExperimentationCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeLondon4d ago
-
Lead Data Engineer - Audience Measurement GBP 60K-65KAWS | Agile | Containers | Data Contracts | Event DrivenAnnual leave | Flexible working | Health and wellbeing benefits | Hybrid work | Income protectionSenior-level Full TimeCambridge, England, United Kingdom4d ago