Staff Data Platform Engineer
Tasks
- Build and operate globally distributed data transfer infrastructure
- Build hub and spoke data transfer model
- Design and build distributed data transfer pipelines
- Design cloud to cloud and cross cloud networking solutions
- Develop pipeline logic with Python
- Ensure reliability observability and operational alerting
- Implement infrastructure as code with Terraform
- Ingest large volumes of sensor data at PB scale
- Lead technical design and delivery for data transfer hub
- Orchestrate parallelized transfer jobs
- Set technical direction for data transfer hub
Perks/Benefits
Skills/Tech-stack
AWS | Alerting | Apache Kafka | Azure | Backfill | Cloud Networking | Cross-cloud | Cross-cloud networking | Data Integrity | Data Pipelines | Flyte | GCP | Infrastructure as Code | Monitoring | Object storage | Python | Retry strategies | Terraform | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
AWS | Application development | Artificial Intelligence | Automated testing | AutomationSenior-level Full TimeLONDON, United Kingdom8h ago
-
AI Engineer - Global Strategy Consultant GBP 100K-125KAPIs | Access Control | Agent Orchestration | Anomaly Detection | AuthenticationMid-level Full TimeLondon, 20 Farringdon Road, United Kingdom18h ago
-
Biosensor Algorithm Engineer GBP 24K-24KAnomaly Detection | Classification | Embedded Systems | Git | Machine LearningMid-level Full TimeUnited Kingdom, Cambridge18h ago
-
Machine learning Engineer GBP 84K-115KAWS | Azure | Cloud Security | Docker | Google CloudCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
Software / Machine Learning Engineer GBP 40K-50KAWS | Computer Vision | Deep learning | Generative AI | Hugging FaceFlexible work hours | Gym discounts | Learning resources | Mental health support | MentorshipMid-level Full TimeLondon R1d ago
-
AI Engineer GBP 60K-90KAWS | Azure | CI/CD | Databricks | DockerBike to work | Career progression pathways career development programme | Educational assistance | Employee assistance programme | Employee discountMid-level Full TimeLondon, Birmingham, Manchester, Newcastle upon Tyne, …1d ago
-
AI Solution Engineer GBP 70K-95KAI Evaluation | AI Governance | AI Security | APIs | Agent FrameworksBonus package | Hybrid work | Neat benefits | Work from homeMid-level Full TimeLondon, United Kingdom1d ago
-
Research Engineer, RL Scaling Science GBP 375K-640KBenchmarking | Data Analysis | Debugging | Distributed Computing | Experiment designFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeLondon, UK1d ago
-
Contractor - Senior Data Engineer (3 months +) GBP 60K-80KAWS | AWS DMS | AWS Lambda | Amazon CloudWatch | Amazon KinesisSenior-level ContractLondon, United Kingdom1d ago
-
Batch Machine Learning | CI/CD | Causal Inference | Containerization | Data PipelinesEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalized learningSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer GBP 38K-42KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultAnnual leave | Colleague mortgage | Cycle to work initiative | Discounted gym membership | Diverse and inclusive networksMid-level Full TimeSkipton - The Bailey, United Kingdom1d ago
-
MLOps Engineer GBP 76K-100KAirflow | Automated retraining | Autoscaling | BigQuery | Blue-Green DeploymentDiscounts | Enhanced parental leave | Holiday allowance | Learning and development programme | Life insuranceSenior-level Full TimeUnited Kingdom - Remote R1d ago
-
Mid-level Full TimeXC Birmingham Head Office, United Kingdom1d ago
-
AWS Step Functions | Agile | Amazon S3 | Amazon SQS | Apache AirflowLife assurance | Paid time off | Pension scheme | Training and developmentSenior-level Full TimeLondon - Central; Manchester; Cheltenham1d ago
-
Bioinformatician GBP 39K-44KArtificial Intelligence | CI/CD | Containerization | Data integration | Fair PrinciplesFlexible working arrangements | Generous paid time off | Onsite nursery | Pension scheme | Private medical insuranceMid-level Full TimeHinxton, United Kingdom1d ago
-
AI/ML Engineer, Responsible AI GBP 70K-80KBiomedical Data | Deep learning | Ethical AI | Foundation Models | Machine LearningSenior-level Full TimeLondon The Stanley Building, United Kingdom1d ago
-
Mid-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Senior-level Full TimeLondon, England, United Kingdom1d ago
-
Staff Applied Scientist GBP 165K-190KCloud Computing | Deep learning | Deep learning frameworks | Explainable AI | GitFlexible work schedule | Hybrid work | Mentoring & coaching | Share options | Team collaboration daysSenior-level Full TimeLondon2d ago
-
Senior Data Engineer GBP 81K-114KAWS EKS | Aerospike | Amazon Web Services | Apache Airflow | Apache FlinkDocumentation and onboarding support | Remote workSenior-level Full TimeLondon, England2d ago
-
AI architecture | APIs | Agent systems | Cloud platform | Data PipelinesSenior-level Full TimeLondon, UK3d ago
-
C++ | Data Processing | Data debugging | Data extraction | Distributed ComputingSenior-level Full TimeLondon, UK3d ago
-
Machine Learning Engineer GBP 110K-145KCI/CD | Docker | Feature Engineering | Kubernetes | Model Deployment401k matching | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceSenior-level Full TimeUnited Kingdom R3d ago
-
Airflow | BigQuery | Computer Vision | Deep learning | EmbeddingsBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Income replacement programsSenior-level Full TimeRemote - United Kingdom R3d ago
-
Staff Machine Learning Engineer, ML Efficiency GBP 81K-118KApache Spark | C++ | Caching | Cloud Cost Optimization | Cloud infrastructureBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group pension with employer matchSenior-level Full TimeRemote - United Kingdom R4d ago