Senior Software Engineer, Data
Tasks
- Build data transfer pipelines
- Build operational retry and backfill systems
- Collaborate with product and partner teams
- Design data transfer hub
- Develop hub and spoke data exchange
- Implement data integrity checks
- Implement event driven lifecycle tracing
- Orchestrate parallel workflows
- Participate in on-call support rotation
- Set up dashboards and alerting
- Solve cloud to cloud networking problems
- Write infrastructure as code
Perks/Benefits
Skills/Tech-stack
Airflow | Azure | Blob Storage | Cloud Storage | Data Integrity | Event Driven | Event-driven architecture | Flyte | Infrastructure as Code | Kafka | Network Architecture | Object storage | Observability | Prefect | Python | Terraform | “as-code”
Education
N/A
Related jobs
-
Lead Data Platform Engineer -6 Month Secondment GBP 85K-102KAPI Integration | AWS Glue | AWS Lake | AWS Lake Formation | AWS LambdaAnnual leave | Bank holidays | Healthcare | Pension | SharesaveSenior-level Full TimeNottingham, United Kingdom R9h ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 90K-110KAnomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group personal pension scheme with employer matchMid-level Full TimeRemote - United Kingdom R16h ago
-
Senior Data Engineer GBP 95K-115KAWS Databricks | AWS Glue | Apache Airflow | Apache Kafka | Data ModelingAnnual leave | Bank holidays | Pension plan | Private health insuranceSenior-level Full TimeLondon R20h ago
-
Applied AI Architect, Digital Natives Business GBP 190K-230KClaude API | Cloud Architecture | Data Science | Evaluation | LLMSenior-level Full TimeLondon, UK R23h ago
-
Senior Data Engineer GBP 65K-85KAccess Controls | Alerting | Apache Airflow | Azure Data | Azure Data FactoryHybrid work options | Industry-leading technology | Remote work options | Well-being programs | Work flexibilitySenior-level Full TimeBasingstoke, United Kingdom R1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSightFlexible benefits | Life assurance | LinkedIn Learning access | Paid Holidays | Pension planSenior-level Full TimeHybrid, London, England, United Kingdom R1d ago
-
Data Engineer GBP 52K-75KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformRemote work option | Team collaborationMid-level Full TimeLondon R1d ago
-
Senior Data Quality Engineer GBP 72K-80KAirflow | Apache Beam | Apache Kafka | BDD | BehaveDiscounted shopping | Flexible working | Hybrid working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom R1d ago
-
Senior Machine Learning Engineer GBP 65K-81KAWS | AWS SageMaker | Airflow | Azure | DockerFlexible working | Hybrid work arrangement | Remote work flexibilitySenior-level Full TimeGibbs Building, United Kingdom R1d ago
-
Senior Analytics Engineer USD 100KAirflow | Amazon Redshift | CI/CD | DBT | Data ModelingIn person work 3 days per week | Relocation supportSenior-level Full TimeLondon R2d ago
-
Data Engineer GBP 44K-44KAPIs | Azure Data | Azure Data Factory | CI/CD | Data FactoryHybrid working | OTE bonusMid-level Full TimeManchester R2d ago
-
Senior AI Engineer GBP 78K-100KAWS | Agentic architecture | Anthropic API | Azure | C++Annual leave | Community and charity initiatives | Cycle to work | Give as you earn | Hybrid workingSenior-level Full TimeBelfast, Northern Ireland, United Kingdom R2d ago
-
Senior AI Engineer GBP 78K-100KAWS | Agentic architecture | Anthropic API | Azure | DevOpsCommunity and Charity Involvement | Cycle to work | Give as you earn | Hybrid work | Learning budgetSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
AWS | Azure | Cloud platform | Data Analysis | Data ModelingCycle to work scheme | Employee assistance programme | Eye care | Free breakfast | Gym discountEntry-level Full TimeHavas Village London - 35, United … R2d ago
-
API Design | C# | C++ | Compute efficiency | Data PipelinesEducation reimbursement | Family support programs | Flexible time off | Health and wellbeing resources | Hybrid work modelExecutive-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R2d ago
-
Lead Data Analyst - Foreign Exchange Data GBP 72K-90KAccess Control | Data Governance | Data Lineage | Data Migration | Data ModelingBike4work | Coaching | Flexible benefits | Gym benefits | Hybrid workingSenior-level Full TimeLondon, 21 Moorfields, United Kingdom R2d ago
-
Senior Data Engineering Manager GBP 72K-80KAPI Design | Automation | Azure | Azure Data | Azure Data Factory27 days holiday | Buy Sell Additional Holiday | Car allowance | Defined contribution pension scheme | Flexible working environmentSenior-level Full TimeDorking, Surrey, UK, United Kingdom R2d ago
-
Lead Engineer – Advanced AI Engineering GBP 84K-126KAPI | Agents | Agile | Artificial Intelligence | CI/CD30 days holiday | Annual bonus | Discounted shopping | Flexible working | Hybrid workingSenior-level Full TimeLondon 10 Gresham Street, United Kingdom R2d ago
-
Quantum Control Designer GBP 46K-60KIon Trap | Ion Trap Quantum Gates | Physics modeling | Python | QiskitDental insurance | Equity participation | Flexible holiday allowance | Flexible working | Group life insuranceMid-level Full TimeHaywards Heath, England, United Kingdom - … R2d ago
-
Data Engineer (Bioinformatics) GBP 62K-62KAgile | Airflow | Apache Parquet | Apache Spark | BGEN30 days holiday + bank holidays | Cycle to work scheme | EV scheme | Employee assistance programme | Employer pension schemeSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Staff Software Engineer - Data Platforms GBP 105K-105KAWS | Agile | Airflow | Ansible | AzureBank holidays | Cycle to work scheme | Enhanced parental leave | Home and tech savings | On-call rotationSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Senior Software Engineer - UltraGrid GBP 90K-120KAlgorithms | Apache | Concurrency | Data Structures | Distributed ConsensusHealth, dental, vision coverage | Laptop provided | Mental health support | Remote work option | Stock optionsSenior-level Full TimePalo Alto; Hybrid (London, England, GB) R3d ago
-
Data Engineer GBP 70K-85KAirflow | Ansible | Argo CD | CI/CD | Dagster35 hour working week | Additional annual leave | Employee assistance programme | Enhanced maternity/paternity pay | MacBook Pro providedSenior-level Full TimeCheltenham, England, United Kingdom - Remote R3d ago
-
Machine Learning Engineer GBP 78K-109KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London R3d ago
-
AI | Advanced Analytics | Data analytics | Deep learning | GenAIDedicated buddy | Flexible work options | Hybrid work | Mentorship | Talent managementEntry-level InternshipBank House, Bank House Square, Newcastle … R4d ago