Data Engineer
Tasks
- Apply access control and privacy protections
- Build data ingestion pipelines
- Collaborate cross functionally on ingestion requirements
- Create ingestion templates and shared libraries
- Develop enrichment and standardization logic
- Implement data quality contracts
- Instrument pipeline observability metrics
- Maintain data lake components
- Manage dataset versioning and point in time correctness
- Mentor junior team members
- Perform data validation and anomaly detection
- Support SLOs and incident response
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | Alerting | Anomaly Detection | Apache Flink | Apache Spark | Batch Data Processing | Batch data | CI/CD | Cloud platform | DBT | Data Contracts | Data Governance | Data Lineage | Data Processing | Data Quality | Data Validation | Debezium | Google Cloud | Google Cloud Platform | Kafka | Kafka Connect | SLOs | Spark Streaming | Streaming Data | Streaming data processing
Education
N/A
Roles
Related jobs
-
Junior Data Engineer GBP 28K-28KAzure | Data Governance | Data Management | Data Modeling | Data SecurityAnnual leave | Flexible working | Free GP consultations | Loans | Mortgage adviceEntry-level Full TimeMilton Keynes, Milton Keynes, MK9 1EA, …22h ago
-
Senior AI / LLM Engineer GBP 70K-85KAI Studio | Agent Orchestration | Azure AI | Azure AI Studio | Azure AKSDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom22h ago
-
Senior Data Engineer GBP 65K-85KAccess Controls | Alerting | Apache Airflow | Azure Data | Azure Data FactoryHybrid work options | Industry-leading technology | Remote work options | Well-being programs | Work flexibilitySenior-level Full TimeBasingstoke, United Kingdom R1d ago
-
APIs | Agent systems | Cloud platform | Evaluation | Google CloudSenior-level Full TimeLondon, UK1d ago
-
Data Consultant GBP 45K-65KAWS | Analytics | BI Dashboards | ClickHouse | Data ModelingHealth insurance | Hybrid work | Paid time offMid-level Full TimeHybrid - London R1d ago
-
Data Engineer GBP 47K-55KAzure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactoryFlexible working | Hybrid working | Work from anywhere up to 30 days per yearEntry-level Full TimeLondon, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 80K-115KAPIs | AWS | AWS Lambda | Amazon CloudWatch | Amazon ECRSenior-level Full TimeBelfast1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSightFlexible benefits | Life assurance | LinkedIn Learning access | Paid Holidays | Pension planSenior-level Full TimeHybrid, London, England, United Kingdom R1d ago
-
Senior Data Engineer (Databricks) GBP 65K-70KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCash back cards | Cycle scheme | Discounts and offers | Hybrid work mode | Income protection insuranceSenior-level Full TimeLondon, England, United Kingdom R1d ago
-
Data Engineer GBP 52K-75KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformRemote work option | Team collaborationMid-level Full TimeLondon R1d ago
-
Mid-level Full TimeWelwyn, United Kingdom1d ago
-
Apache Spark | Azure | Azure Data | Azure Data Lake | Azure DatabricksAnnual bonus | Flexible working | Life assurance | Paid Time Off Volunteering | Paid holidaySenior-level Full TimeThe Bridge, United Kingdom1d ago
-
Senior Data Quality Engineer GBP 72K-80KAirflow | Apache Beam | Apache Kafka | BDD | BehaveDiscounted shopping | Flexible working | Hybrid working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom R1d ago
-
Senior Data Engineer GBP 56K-66KAI | Access Controls | Analytics | Azure | Cloud Computing35 hour working week | Annual leave | Christmas closure | Employee networks | Flexible workingSenior-level Full TimeAQA Manchester, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 65K-81KAWS | AWS SageMaker | Airflow | Azure | DockerFlexible working | Hybrid work arrangement | Remote work flexibilitySenior-level Full TimeGibbs Building, United Kingdom R1d ago
-
Mid-level Full TimeLondon1d ago
-
Data Architect / Engineer GBP 75K-95KAirflow | Change Data Ingestion | Data Governance | Data Ingestion | Data LineageSenior-level Full TimeLondon1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
A/B | A/B Testing | AWS | B testing | Causal Inference401k match | Dental insurance | Health insurance | Professional training resources | Remote work flexibilitySenior-level Full TimeBrierley Hill, UK1d ago
-
Senior Applied Scientist GBP 110K-135KAirflow | Apache Spark | Dagster | Databricks | Deep learningSenior-level Full TimeLondon1d ago
-
Staff Machine Learning Engineer GBP 90K-120KAnomaly Detection | BigQuery | Bigtable | Data Pipelines | Degraded ModeAnnual training budget | Birthday leave | Enhanced parental leave | Equity package | Flexible time offSenior-level Full TimeLondon - Hybrid R1d ago
-
Scientific Data Engineer GBP 41K-44KAmazon Web Services | Automated testing | Cloud Computing | Cloud platform | CondaBank holidays | Cycle to work scheme | Flexible working | Group Critical Illness | Group income protectionMid-level Full TimeLondon, England, United Kingdom1d ago
-
Applied AI Engineering Lead - VP, Markets Operations GBP 90K-126KAPIs | Automated testing | CI/CD | Compliance | Context ManagementSenior-level Full TimeLONDON, United Kingdom2d ago
-
Senior-level Full TimeUnited Kingdom2d ago
-
Senior Analytics Engineer USD 100KAirflow | Amazon Redshift | CI/CD | DBT | Data ModelingIn person work 3 days per week | Relocation supportSenior-level Full TimeLondon R2d ago