Senior Data Engineer, Unified Platform
Tasks
- Contribute to project management and project reporting
- Coordinate vendor changes and perform routine data operations
- Design data governance processes
- Develop monitoring and quality control software
- Drive data migrations across platforms
- Establish and enforce data modeling standards
- Implement processes to onboard and manage new datasets
- Maintain vendor ingestion pipelines
- Model, build, and manage data products
- Monitor data ingestion pipelines and data quality
- Own delivery of data products and implement solutions
- Respond to user requests and identify platform gaps
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Amazon S3 | Apache Flink | Apache Kafka | Apache Spark | Argo Workflows | Arrow | Avro | Backfilling | Batch Processing | Cassandra | ClickHouse | Data Governance | Data Ingestion | Data Modeling | Data Quality | Data migrations | Data pipeline | Dead Letter Queue | Delta Lake | Iceberg | JSON | Java | Kubernetes | Monitoring | NoSQL | Orchestration | Parquet | Protobuf | Protobuf gRPC | Python | RDBMS | SQL | Streaming | Thrift
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeLeeds/Sheffield/Manchester, UK (Hybrid) R10h ago
-
Machine Learning Engineer GBP 68K-85KComputer Vision | Convolutional Neural Networks | Deep learning | Diffusion Models | Generative ModelsCycle garage and showers | Dental scheme | Free soft drinks | Hybrid working | On-site barSenior-level Full TimeUnited Kingdom, London15h ago
-
Machine Learning Engineer (Recommenders) GBP 70K-85KCI/CD | Deep learning | Distributed Computing | Docker | GPU ComputingEmployee discount | Flexible benefits allowance | Inclusive workplace | Online learning resources | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom16h ago
-
APIs | Azure | CI/CD | Data Governance | Distributed SystemsBi weekly engineering gatherings | Carbon footprint offset via Ecologi | Company laptop and tools | Company social events | Enhanced family policySenior-level Full TimeMoorgate, SouthEast EC2, United Kingdom R18h ago
-
Data Engineer Support Officer GBP 50K-50KConfluence | Database performance | Database performance tuning | ETL | ITILHybrid workingMid-level Full TimeGB-ENG-LAN-Preston19h ago
-
AWS | AWS Lambda | AWS S3 | AWS Step Functions | AgileSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Apache Airflow | Apache Spark | App Service | Azure | Azure AppMid-level Full TimeLondon, United Kingdom1d ago
-
Apache Lucene | Conversational AI | Elasticsearch | Java | Language ModelsFamily benefits | Flexible working arrangements | Generous time off | Hybrid working patterns | On-site nurseryEntry-level Full TimeHinxton, United Kingdom1d ago
-
AI | Authoritative Data | Authoritative Data Sourcing | Data Engineering | Data GovernanceBike4Work scheme | Continuous learning | Flexible working | Gym benefits | Hybrid workingMid-level Full TimeLondon, 21 Moorfields, United Kingdom R1d ago
-
Data Engineer GBP 50K-60KAWS | Azure | CI/CD | CloudFormation | Data LakeCharitable leave | Paid time off | Private medical insuranceMid-level Full TimeLondon, 30 Fenchurch Street, United Kingdom1d ago
-
AI Data Engineer GBP 72K-88KAI Tooling | Alerting | Automated testing | CI/CD | Cloud ComputingAccess to online courses | Flexible working arrangements | Hybrid working | Training and development opportunitiesSenior-level Full TimeLondon, GB1d ago
-
Staff Applied Scientist GBP 225K-325KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningHybrid work schedule | Mentoring and coachingSenior-level Full TimeLondon2d ago
-
Experienced Quantitative Researcher - Cambridge GBP 65K-85KC++ | Data Structures | Data Structures and Algorithms | Linux | PythonInternational team outing | Medical insurance | Paid vacationSenior-level Full TimeCambridge, England, United Kingdom2d ago
-
Senior Analytics Engineer GBP 45K-55KCI/CD | DBT | Dataform | GitLab | Google BigQueryEmployee referral bonus | Hybrid work | Profit share bonus | Share incentive plan | Uncapped leaveSenior-level Full TimeBath, England, United Kingdom2d ago
-
Data Engineer – Development & Analytics (Bedford, MA) USD 107K-170KAWS | Azure | Dashboarding | Data Pipelines | Data Warehousing401k match | Education reimbursement | HSA | PTO | Stock purchase planMid-level Full TimeBedford, United States2d ago
-
Data Technology Engineer (UK) GBP 65K-88KAPI Management | Apache Airflow | CI/CD | Database Management System | DockerMid-level ContractLondon, United Kingdom of Great Britain …2d ago
-
Staff Forward Deployed Engineer, GenAI, Google Cloud GBP 90K-130KAPI Integration | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeLondon, UK2d ago
-
Forward Deployed Engineer, GenAI, DACH, Google Cloud GBP 100K-120KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeLondon, UK2d ago
-
AI Safety | APIs | Agent systems | Cloud platform | CrewAISenior-level Full TimeLondon, UK2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Diverse and inclusive workplace | Remote-friendly work environmentMid-level Full TimeLondon, United Kingdom3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial team | Friendly work environment | Hands-off management | Opportunities for impactMid-level Full TimeBristol, United Kingdom3d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Flexible management | Remote-friendlyMid-level Full TimeLeeds, United Kingdom3d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFlexible hours | Freelance project-based work | Part-time engagementMid-level FreelanceUnited Kingdom - Remote R3d ago
-
Staff Engineer — Data Platform GBP 80K-110KAWS | Apache Airflow | Apache Flink | Apache Kafka | DBTFlexible days off | Health plan | Home office bonus | Language courses | Personal growth coursesSenior-level Full TimeLondon R3d ago
-
Lead Data Platform Engineer (eDV) GBP 64K-80KAgile | Amazon S3 | Amazon Web Services | Apache Spark | Automated testing25 days holiday plus bank holidays | Annual training allowance | Company paid medical insurance | Employee assistance plan | Life assuranceSenior-level Full TimeHybrid, UK R3d ago