Senior Data Engineer
Tasks
- Build and scale data infrastructure
- Deploy and maintain infrastructure on AWS
- Implement ETL and ELT pipelines
- Implement privacy compliant identity and targeting methodologies
- Maintain technical documentation and runbooks
- Manage data tables with Apache Iceberg
- Monitor pipelines and handle incidents
- Optimize SQL in data warehouses
- Orchestrate data workflows
- Set up CI/CD deployment pipelines
Perks/Benefits
Skills/Tech-stack
AWS EKS | Aerospike | Amazon Web Services | Apache Airflow | Apache Flink | Apache Iceberg | Apache Spark | ArgoCD | By Design | CCPA | CI/CD | ClickHouse | Data Warehousing | Docker | ELT | ETL | GDPR | Identity and Privacy by Design | Kafka | Kubernetes | Privacy by Design | Prometheus | Python | SQL | Snowflake | Web Services
Education
N/A
Roles
Related jobs
-
Contractor - Senior Data Engineer (3 months +) GBP 60K-80KAWS | AWS DMS | AWS Lambda | Amazon CloudWatch | Amazon KinesisSenior-level ContractLondon, United Kingdom12h ago
-
Batch Machine Learning | CI/CD | Causal Inference | Containerization | Data PipelinesEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalized learningSenior-level Full TimeLondon, England, United Kingdom13h ago
-
Data Engineer GBP 38K-42KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultAnnual leave | Colleague mortgage | Cycle to work initiative | Discounted gym membership | Diverse and inclusive networksMid-level Full TimeSkipton - The Bailey, United Kingdom23h ago
-
MLOps Engineer GBP 76K-100KAirflow | Automated retraining | Autoscaling | BigQuery | Blue-Green DeploymentDiscounts | Enhanced parental leave | Holiday allowance | Learning and development programme | Life insuranceSenior-level Full TimeUnited Kingdom - Remote R23h ago
-
Mid-level Full TimeXC Birmingham Head Office, United Kingdom23h ago
-
AWS Step Functions | Agile | Amazon S3 | Amazon SQS | Apache AirflowLife assurance | Paid time off | Pension scheme | Training and developmentSenior-level Full TimeLondon - Central; Manchester; Cheltenham23h ago
-
Bioinformatician GBP 39K-44KArtificial Intelligence | CI/CD | Containerization | Data integration | Fair PrinciplesFlexible working arrangements | Generous paid time off | Onsite nursery | Pension scheme | Private medical insuranceMid-level Full TimeHinxton, United Kingdom23h ago
-
Staff Applied Scientist GBP 165K-190KCloud Computing | Deep learning | Deep learning frameworks | Explainable AI | GitFlexible work schedule | Hybrid work | Mentoring & coaching | Share options | Team collaboration daysSenior-level Full TimeLondon1d ago
-
AI architecture | APIs | Agent systems | Cloud platform | Data PipelinesSenior-level Full TimeLondon, UK2d ago
-
C++ | Data Processing | Data debugging | Data extraction | Distributed ComputingSenior-level Full TimeLondon, UK2d ago
-
Machine Learning Engineer GBP 110K-145KCI/CD | Docker | Feature Engineering | Kubernetes | Model Deployment401k matching | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceSenior-level Full TimeUnited Kingdom R2d ago
-
Airflow | BigQuery | Computer Vision | Deep learning | EmbeddingsBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Income replacement programsSenior-level Full TimeRemote - United Kingdom R2d ago
-
Staff Machine Learning Engineer, ML Efficiency GBP 81K-118KApache Spark | C++ | Caching | Cloud Cost Optimization | Cloud infrastructureBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group pension with employer matchSenior-level Full TimeRemote - United Kingdom R3d ago
-
Senior-level Full TimeLondon3d ago
-
Senior Data Engineer GBP 72K-88KApache Airflow | Async Processing | CI/CD | Cloud Build | Cloud ComposerCampus based work schedule | Global team collaboration | Hybrid working | Pathway to Lead Engineer | Support for certification and trainingSenior-level Full TimeDunton, Essex, United Kingdom3d ago
-
Data Business Engineer GBP 65K-80KAccess Control | Amazon Redshift | BigQuery | COGS Modeling | Data GovernanceMid-level Full TimeLondon, United Kingdom3d ago
-
Senior Robotics Research Engineer GBP 62K-78KC# | C++ | CI/CD | Concurrent programming | Continuous DeploymentAnnual leave | Cycle to work scheme | EAP | Employer pension matching | Exclusive discountsSenior-level Full TimeWelwyn Garden City, United Kingdom R3d ago
-
Senior Robotics Software Engineer GBP 62K-84KAgile | Automated testing | BigQuery | CI/CD | CUDAAnnual leave | Cycle to work scheme | Employee assistance program | Exclusive discounts | Free shuttle busSenior-level Full TimeHatfield, United Kingdom R3d ago
-
Data Infrastructure and AI Engineer GBP 35K-40KBenchmarking | C# | C++ | Cloud Native | Concurrency ControlEntry-level Full TimeEdinburgh, United Kingdom3d ago
-
Mid/Senior Solution Architect GBP 80K-110KAmazon Web Services | Azure Machine Learning | CI/CD | Cloud platform | DockerDiscounted lunch | Educational budget | Flexible working hours | Hybrid work | Language classesSenior-level Full TimeLondon, United Kingdom3d ago
-
Mid-level Full TimeManchester, England, United Kingdom3d ago
-
Data Engineer GCP (Remote) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformRemote work environmentMid-level Full TimeStoke-on-Trent, England, United Kingdom R3d ago
-
Data Engineer (GCP) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Data pipelineMid-level Full TimeStoke-on-Trent, England, United Kingdom3d ago
-
Data Engineer GBP 45K-45KAPI | Alerting | Automation | CI/CD | Data AnalysisAgile working | Career development | Family-friendly policies | Holiday | Learning and developmentMid-level Full TimeNorthampton, United Kingdom3d ago
-
Lead Data Engineer GBP 52K-52KBusiness Intelligence | Data Architecture | Data Cataloging | Data Engineering | Data GovernanceFlexible workingSenior-level Full TimeUnited Kingdom3d ago