Senior Data Engineer
Tasks
- Build data lakes
- Build distributed data processing systems
- Collaborate with engineers architects and data scientists
- Create data pipelines
- Create diagrams
- Define business metrics
- Design Workflow Orchestration
- Document systems
- Ingest data from diverse sources
- Integrate with internal and external APIs
- Maintain deployment monitoring and maintenance
- Monitor data quality
- Validate incoming and outgoing data
- Write unit tests
Perks/Benefits
Skills/Tech-stack
AWS Databricks | AWS Glue | Apache Airflow | Apache Kafka | Data Modeling | Data Warehousing | Docker | ETL | Elasticsearch | FastAPI | Flask | Graph Databases | Jupyter | Kubernetes | Neo4j | Pandas | PySpark | Python | SQL | Snowflake
Education
Roles
Related jobs
-
Lead Data Platform Engineer -6 Month Secondment GBP 85K-102KAPI Integration | AWS Glue | AWS Lake | AWS Lake Formation | AWS LambdaAnnual leave | Bank holidays | Healthcare | Pension | SharesaveSenior-level Full TimeNottingham, United Kingdom R8h ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 90K-110KAnomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group personal pension scheme with employer matchMid-level Full TimeRemote - United Kingdom R15h ago
-
Applied AI Architect, Digital Natives Business GBP 190K-230KClaude API | Cloud Architecture | Data Science | Evaluation | LLMSenior-level Full TimeLondon, UK R22h ago
-
Senior Data Engineer GBP 65K-85KAccess Controls | Alerting | Apache Airflow | Azure Data | Azure Data FactoryHybrid work options | Industry-leading technology | Remote work options | Well-being programs | Work flexibilitySenior-level Full TimeBasingstoke, United Kingdom R1d ago
-
Data Consultant GBP 45K-65KAWS | Analytics | BI Dashboards | ClickHouse | Data ModelingHealth insurance | Hybrid work | Paid time offMid-level Full TimeHybrid - London R1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSightFlexible benefits | Life assurance | LinkedIn Learning access | Paid Holidays | Pension planSenior-level Full TimeHybrid, London, England, United Kingdom R1d ago
-
Senior Software Engineer, Data GBP 80K-100KAirflow | Azure | Blob Storage | Cloud Storage | Data IntegrityHybrid work | On-call rotationSenior-level Full TimeLondon R1d ago
-
Senior Data Engineer (Databricks) GBP 65K-70KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCash back cards | Cycle scheme | Discounts and offers | Hybrid work mode | Income protection insuranceSenior-level Full TimeLondon, England, United Kingdom R1d ago
-
Data Engineer GBP 52K-75KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformRemote work option | Team collaborationMid-level Full TimeLondon R1d ago
-
Senior Data Quality Engineer GBP 72K-80KAirflow | Apache Beam | Apache Kafka | BDD | BehaveDiscounted shopping | Flexible working | Hybrid working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom R1d ago
-
Senior Machine Learning Engineer GBP 65K-81KAWS | AWS SageMaker | Airflow | Azure | DockerFlexible working | Hybrid work arrangement | Remote work flexibilitySenior-level Full TimeGibbs Building, United Kingdom R1d ago
-
Staff Machine Learning Engineer GBP 90K-120KAnomaly Detection | BigQuery | Bigtable | Data Pipelines | Degraded ModeAnnual training budget | Birthday leave | Enhanced parental leave | Equity package | Flexible time offSenior-level Full TimeLondon - Hybrid R2d ago
-
UniData/ UniVerse Data Engineer (Remote) GBP 55K-80KAPI Integration | APIs | Batch Processing | Data Modeling | Data integrationRemote workSenior-level Full TimeCambourne, United Kingdom of Great Britain … R2d ago
-
Senior Analytics Engineer USD 100KAirflow | Amazon Redshift | CI/CD | DBT | Data ModelingIn person work 3 days per week | Relocation supportSenior-level Full TimeLondon R2d ago
-
Data Engineer GBP 44K-44KAPIs | Azure Data | Azure Data Factory | CI/CD | Data FactoryHybrid working | OTE bonusMid-level Full TimeManchester R2d ago
-
Senior AI Engineer GBP 78K-100KAWS | Agentic architecture | Anthropic API | Azure | C++Annual leave | Community and charity initiatives | Cycle to work | Give as you earn | Hybrid workingSenior-level Full TimeBelfast, Northern Ireland, United Kingdom R2d ago
-
Senior AI Engineer GBP 78K-100KAWS | Agentic architecture | Anthropic API | Azure | DevOpsCommunity and Charity Involvement | Cycle to work | Give as you earn | Hybrid work | Learning budgetSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
AWS | Azure | Cloud platform | Data Analysis | Data ModelingCycle to work scheme | Employee assistance programme | Eye care | Free breakfast | Gym discountEntry-level Full TimeHavas Village London - 35, United … R2d ago
-
API Design | C# | C++ | Compute efficiency | Data PipelinesEducation reimbursement | Family support programs | Flexible time off | Health and wellbeing resources | Hybrid work modelExecutive-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R2d ago
-
Lead Engineer – Advanced AI Engineering GBP 84K-126KAPI | Agents | Agile | Artificial Intelligence | CI/CD30 days holiday | Annual bonus | Discounted shopping | Flexible working | Hybrid workingSenior-level Full TimeLondon 10 Gresham Street, United Kingdom R2d ago
-
Quantum Control Designer GBP 46K-60KIon Trap | Ion Trap Quantum Gates | Physics modeling | Python | QiskitDental insurance | Equity participation | Flexible holiday allowance | Flexible working | Group life insuranceMid-level Full TimeHaywards Heath, England, United Kingdom - … R2d ago
-
Data Engineer (Bioinformatics) GBP 62K-62KAgile | Airflow | Apache Parquet | Apache Spark | BGEN30 days holiday + bank holidays | Cycle to work scheme | EV scheme | Employee assistance programme | Employer pension schemeSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Staff Software Engineer - Data Platforms GBP 105K-105KAWS | Agile | Airflow | Ansible | AzureBank holidays | Cycle to work scheme | Enhanced parental leave | Home and tech savings | On-call rotationSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Data Engineer GBP 70K-85KAirflow | Ansible | Argo CD | CI/CD | Dagster35 hour working week | Additional annual leave | Employee assistance programme | Enhanced maternity/paternity pay | MacBook Pro providedSenior-level Full TimeCheltenham, England, United Kingdom - Remote R3d ago
-
Machine Learning Engineer GBP 78K-109KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London R3d ago