Senior Data Engineer, Unified Platform
Tasks
- Contribute to project management and project reporting
- Coordinate vendor changes and perform routine data operations
- Design data governance processes
- Develop monitoring and quality control software
- Drive data migrations across platforms
- Establish and enforce data modeling standards
- Implement processes to onboard and manage new datasets
- Maintain vendor ingestion pipelines
- Model, build, and manage data products
- Monitor data ingestion pipelines and data quality
- Own delivery of data products and implement solutions
- Respond to user requests and identify platform gaps
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Amazon S3 | Apache Flink | Apache Kafka | Apache Spark | Argo Workflows | Arrow | Avro | Backfilling | Batch Processing | Cassandra | ClickHouse | Data Governance | Data Ingestion | Data Modeling | Data Quality | Data migrations | Data pipeline | Dead Letter Queue | Delta Lake | Iceberg | JSON | Java | Kubernetes | Monitoring | NoSQL | Orchestration | Parquet | Protobuf | Protobuf gRPC | Python | RDBMS | SQL | Streaming | Thrift
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeStoke-on-Trent, England, United Kingdom17h ago
-
AI Engineer GBP 45K-50KAI Search | Azure AI | Azure AI Search | Azure OpenAI | DatabricksAbility to purchase additional annual leave | Annual leave | Discretionary bonus scheme | Employee assistance program | Employee share purchase planMid-level Full TimeLondon, United Kingdom18h ago
-
Junior Data Engineer GBP 30K-34KCyber Security | Data Assurance | Data Engineering | Data Governance | Data IngestionEntry-level Full TimeManchester, Greater Manchester, United Kingdom19h ago
-
Agentic AI Engineer, AI Automation GBP 70K-89KAI Search | AWS | Agents SDK | Autogen | AzureAdditional paid time off | Employee resource groups | Flexible working hours | Hybrid work model | Modern Health App accessMid-level Full TimeLondon20h ago
-
Senior Controls & Robotics Engineer GBP 50K-65KAPM | Electrical schematics | EthernetIP | Fieldbus | HMISenior-level Full TimeNewport, Wales, GB, NP19 4XJ1d ago
-
Mid-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
Defence Analytics Engineer GBP 40K-71KArtificial Intelligence | C Sharp | Data analytics | Machine Learning | PythonBonus scheme | Coursera access | Financial advice | Flexi days | Flexible benefitsNone Full TimeGB - London - Whitehall, United …1d ago
-
Defence Analytics Engineer GBP 40K-71KAerodynamics | C# | C++ | Computer Modeling | Guidance and controlBonus scheme | Dental coverage | Employee networks | Extra flexi days | Financial adviceEntry-level Full TimeGB - London - Whitehall, United …1d ago
-
Applied AI Engineer GBP 72K-93KAgentic Systems | CI/CD | Drift Detection | Embeddings | Inference PipelinesHybrid workSenior-level Full TimeLondon, United Kingdom1d ago
-
AI Engineering Team Lead GBP 70K-103KAPI Development | Backend Development | Cloud Computing | Data Pipelines | DeploymentEngaging employee programs | Flexible time off policy | Life assurance | Pension | Private health coverageSenior-level Full TimeUnited Kingdom Remote R1d ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Analytics GA4 | Azure | Cloud Computing | DashboardsHybrid workMid-level Full TimeUnited Kingdom R1d ago
-
Data Engineering Lead - Value & Analytics GBP 38K-46KAWS | Azure | Cloud Architecture | Cybersecurity | Data GovernanceHybrid workSenior-level Full TimeUnited Kingdom R1d ago
-
Software Engineer - Data Infrastructure GBP 45K-52KAWS | Amazon SQS | Batch Processing | BigQuery | Data IngestionMid-level Full TimeLondon1d ago
-
Compliance Governance Data Scientist GBP 53K-81KDashboarding | Data Modeling | Data Pipelines | GRC | Key Risk IndicatorsMid-level Full TimeLondon, United Kingdom1d ago
-
Algorithms | C plus plus | Data Structures | Java | Machine LearningExecutive-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
AWS | Agile | Apache Spark | Azure | BitbucketExecutive-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
API Management | Apache Spark | Azure API | Azure API Management | Azure DataSenior-level Contract Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Mid-level Full TimeTrimble Offices, Morley1d ago
-
AI Engineer GBP 70K-96KAccess Control | Azure | Azure AI | CI/CD | ClaudeCareer follow-up | Certification support | Continuous learning opportunities | Flexible schedule | Remote working policyMid-level Full TimeLondon, England, United Kingdom1d ago
-
Cloud Data Platform Software Engineer II GBP 72K-94KAWS Glue | Agile | Amazon Kinesis | Amazon Redshift | Apache BeamCareer growth opportunities | Diversity and inclusion culture | Learning opportunitiesEntry-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Engineer - Infra GBP 68K-85KApache Airflow | Apache Kafka | Apache Spark | ClickHouse | GrafanaSenior-level Full TimeLondon, England, GB1d ago
-
Mid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer (Crypto) 12mth FTC-1 GBP 53K-73KAWS EventBridge | AWS Glue | AWS Lambda | AWS Redshift | AWS Step FunctionsEmployee assistance program | Flexible benefits | Hybrid work | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R2d ago
-
Entry-level Full TimeGlasgow Campus, United Kingdom2d ago
-
Data Engineer GBP 39K-39KAmazon Redshift | Amazon Web Services | Apache Spark | CI/CD | Cloud platformEducation grant for private schooling | Flexible working arrangements | Free shuttle bus to work | Generous time off | Hybrid workingMid-level Full TimeHinxton, United Kingdom2d ago