Cloud Data Engineer
Tasks
- Build ETL ELT workflows for ingestion transformation validation reporting
- Build high performance data transformations using PySpark and SQL
- Collaborate with architects business analysts QA and stakeholders
- Design and optimize Snowflake data warehouse solutions
- Design scalable data pipelines using AWS
- Develop CI/CD pipelines and automate deployments
- Develop dbt models tests snapshots macros documentation
- Ensure data security governance compliance and access controls
- Implement data quality reconciliation audit controls exception handling
- Integrate data from databases APIs cloud storage third party systems
- Optimize data processing jobs for performance scalability cost efficiency
- Prepare technical documentation and operational runbooks
- Support production deployment monitoring incident management troubleshooting
Perks/Benefits
- Access to external certifications
- Hybrid working
- Learning courses
- Training and development opportunities
- Wellbeing programs
Skills/Tech-stack
AWS | AWS Glue | AWS IAM | AWS KMS | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Amazon Athena | Amazon Aurora | Amazon CloudWatch | Amazon EMR | Amazon RDS | Amazon Redshift | Amazon S3 | Avro | Bitbucket | CI/CD | CSV | DBT | Data Lake | Data Lake Architecture | Data Vault | Dimensional Modeling | ELT | ETL | Git | GitHub | GitHub Actions | GitLab | GitLab CI | GitLab CI/CD | JSON | Jenkins | ORC | Parquet | PySpark | RBAC | SQL | Secrets Manager | Snowflake | Snowflake Schema | Snowpipe | Star Schema | Step Functions | Stored Procedures | Streams | Tasks
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeAltrincham, England, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 75K-90KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - Remote R1d ago
-
Data Engineer GBP 55K-85KAWS Lambda | AWS Step Functions | Automated testing | Bitemporal Data | Data IntegrityMid-level Full TimeLondon UK1d ago
-
Data Engineer GBP 52K-75KAWS | Apache Flink | Apache Spark | Elasticsearch | Google CloudFlexible hybrid schedule | Opportunity for impact | Remote work option | Work with cutting-edge technologyMid-level Full TimeLondon R1d ago
-
Data Science Specialist GBP 70K-80KArtificial Intelligence | CI/CD | Containers | Data Analysis | Exploratory Data AnalysisDental coverage | Gym membership discount | Healthcare discount | Holiday purchase scheme | Paid carer’s leaveSenior-level Full TimeChelmsford, GB, CM1 1NP2d ago
-
AWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension scheme | Employer pension contribution | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcareMid-level Full TimeSheffield, GB, S1 4NB2d ago
-
Senior Software Engineer, Training & Experimentation USD 180K-250KAPI Development | AWS | Asynchronous processing | Automated testing | Azure401k matching | Company holidays | Company winter break | Dental coverage | Flexible scheduleSenior-level Full TimeLondon, England, United Kingdom; New York, … R2d ago
-
Embedded Software Engineer GBP 55K-62KAgile | C++ | Confluence | DO-178C | DOORSCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeMid-level Full TimeGlasgow, Scotland, United Kingdom2d ago
-
Scientific Data Engineer - Product Safety GBP 70K-74KAWS | Apache Spark | CI/CD | Data Lakehouse | Data ModelingAnnual paid leave | Life insurance | Pension scheme | Private medical insurance | Work-life balanceSenior-level Full TimeBracknell, BERKSHIRE, United Kingdom2d ago
-
Data Engineer III GBP 80K-90KAWS | Automated testing | CI/CD | CockroachDB | DBTCo-working space access | Company retreat | Equipment stipend | Fully remote | Home office stipendSenior-level Full TimeUnited Kingdom R2d ago
-
Security Analytics Engineer GBP 72K-80KCI/CD | DBT | Data Governance | Data Lineage | Data Modeling25 days holiday per year | Access to cycle garage and showers | Dental scheme | Free soft drinks | Hybrid workingSenior-level Full TimeUnited Kingdom, London R3d ago
-
AI Engineer (Agentic Systems) GBP 78K-109KAgent Orchestration | CI/CD | Cloud APIs | Code review | Guardrails24 7 GP helpline | Continuous L and D | Flexible working environment | Healthcare coverage | Mental health supportMid-level Full TimeBelfast, Northern Ireland, United Kingdom3d ago
-
Product Content Engineer GBP 55K-90KA/B | A/B Testing | AI Evaluation | B testing | Bias MitigationSenior-level Full TimeLondon, UK3d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure Machine LearningEmployer pension matching | Hybrid work | Paid time off | Private medical insuranceSenior-level Full TimeAlderley Edge, GB3d ago
-
Senior Applied Scientist GBP 92K-130KCloud | Complex Planning | Data Analysis | Dataset Processing | Deep learningHybrid work option | Learning and development | Remote work flexibility | Stock options | Team meetupsSenior-level Full TimeLondon3d ago
-
Senior AI Solution Engineer GBP 65K-75KAPI Integration | Bias Mitigation | CI/CD | Cloud Computing | ContainerizationBenefits package | Career growth | Hybrid working | Mentorship | Ongoing developmentSenior-level Full TimeWarminster, Wiltshire, United Kingdom R3d ago
-
Senior Machine Learning Engineer (3967) GBP 72K-85KAnomaly Detection | CI/CD | Classification | Clustering | Computer VisionAgile environment | Knowledge sharing | MentorshipSenior-level Full TimeUnited Kingdom - Remote R3d ago
-
Data Engineer GBP 69K-94KApache Airflow | Apache Spark | Azure | Batch Processing | Data LakesAccessibility accommodations | Critical illness cover | Flexible hybrid work environment | Holiday allowance | Life insuranceEntry-level Full TimeManchester, United Kingdom R3d ago
-
Senior Quantitative Engineer, Systematic Cross Commodity GBP 100K-130KApache Kafka | C++ | CI/CD | Ceph | Data ProcessingSenior-level Full TimeLondon, United Kingdom3d ago
-
Senior AI Engineer - Centre of Excellence GBP 87K-119KAWS | Access Control | Agentic Workflows | Architecture Review | Audit LoggingFlexible working | Ongoing training programsSenior-level Full TimeUK Offshore/Offsite, United Kingdom3d ago
-
Bioinformatics Scientist/Engineer – DRAGEN Array GBP 63K-95KBioinformatics algorithms | CI/CD | Data Analysis | Genomic Data Analysis | Genomic dataEmployee resource groups | Flexible time off | Health and wellbeing support | Opportunities to give back | Pension contributionSenior-level Full TimeEngland - Great Abington, United Kingdom3d ago
-
Senior Cloud Data Platform Engineer GBP 72K-80KAWS | Azure | Azure DevOps | DBX | Data ArchitectureSenior-level Full TimeGlasgow Campus, United Kingdom3d ago
-
365 Admin Center | Access Control | Admin Center | Azure Data | Azure Data LakeEntry-level Contract Full Time TemporaryCanary Wharf, 1 Churchill Place, United …3d ago
-
Senior-level Full TimeGlasgow Campus, United Kingdom3d ago
-
Lead AI Software Engineer GBP 70K-90KAngular | Automated testing | CI/CD | Cloud Native | Code reviewEngineering leadership opportunities | Hybrid work | Professional developmentSenior-level Full TimeLondon, GB R3d ago