Cloud Data Engineer
Tasks
- Build ETL ELT workflows for ingestion transformation validation reporting
- Build high performance data transformations using PySpark and SQL
- Collaborate with architects business analysts QA and stakeholders
- Design and optimize Snowflake data warehouse solutions
- Design scalable data pipelines using AWS
- Develop CI/CD pipelines and automate deployments
- Develop dbt models tests snapshots macros documentation
- Ensure data security governance compliance and access controls
- Implement data quality reconciliation audit controls exception handling
- Integrate data from databases APIs cloud storage third party systems
- Optimize data processing jobs for performance scalability cost efficiency
- Prepare technical documentation and operational runbooks
- Support production deployment monitoring incident management troubleshooting
Perks/Benefits
- Access to external certifications
- Hybrid working
- Learning courses
- Training and development opportunities
- Wellbeing programs
Skills/Tech-stack
AWS | AWS Glue | AWS IAM | AWS KMS | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Amazon Athena | Amazon Aurora | Amazon CloudWatch | Amazon EMR | Amazon RDS | Amazon Redshift | Amazon S3 | Avro | Bitbucket | CI/CD | CSV | DBT | Data Lake | Data Lake Architecture | Data Vault | Dimensional Modeling | ELT | ETL | Git | GitHub | GitHub Actions | GitLab | GitLab CI | GitLab CI/CD | JSON | Jenkins | ORC | Parquet | PySpark | RBAC | SQL | Secrets Manager | Snowflake | Snowflake Schema | Snowpipe | Star Schema | Step Functions | Stored Procedures | Streams | Tasks
Education
N/A
Roles
Related jobs
-
Senior AI Reliability Engineer (Platform) GBP 90K-115KAI Agents | AWS | Airflow | Alerting | AuditabilityEnglish language fluency | On-call rotationSenior-level Full TimeLondon office17h ago
-
Analytics Engineer (Contractor) GBP 60K-75KCommon table expressions | DBT | Data Documentation | Data Governance | Data ModelingMid-level ContractLondon21h ago
-
Lead Data Engineer GBP 72K-90KBusiness Intelligence | CI/CD | Cloud Computing | Data Engineering | ETLCharity and community events | Competitive salary | Continuous training and development | Cycle2work scheme | Employee ownership trustSenior-level Full TimeLeeds, United Kingdom1d ago
-
Automation | Business Intelligence | CRM | Data Modeling | Generative AIEntry-level Full TimeLondon1d ago
-
Machine Learning Engineer GBP 82K-102KCI/CD | Containerization | Distributed Computing | Experimentation | GPUEmployee discount | Employee sample sales | Paid annual leave | Personalized learning | Private medical care schemeEntry-level Full TimeLondon, England, United Kingdom1d ago
-
Google Cloud Platform Data Engineer GBP 70K-78KAgile | Apache Beam | Apache Spark | Automated testing | BigQueryAnnual leave | Company pension | Income protection | Life insurance | Performance-based bonusSenior-level Full TimeBristol, United Kingdom1d ago
-
Bioinformatics Engineer, London GBP 73K-73KApache Beam | Cloud platform | Dagster | DataFrame | Google CloudHybrid workingMid-level Full TimeLondon R1d ago
-
Data Visualisation Engineer - Data Analytics GBP 50K-59KDashboard Development | Data Governance | Data Visualization | Power BI | ReportingAnnual leave | Employer pension matching | Hybrid work | Private medical insuranceMid-level Full TimeAlderley Edge, GB1d ago
-
Senior AI Solutions Engineer GBP 78K-109KData Leakage Prevention | Data leakage | Docker | Evaluation | GenAICode reviews | Mentoring | Runbooks and incident supportSenior-level Full TimeLondon, United Kingdom1d ago
-
Mid-level Full TimeDurrington Head Office, United Kingdom1d ago
-
Senior Data Engineer GBP 60K-70KAmazon Athena | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Scientist & Machine Learning Researcher GBP 44K-55KAWS | AWS CLI | Agile | Azure | Computer VisionContributory pension scheme | Cycle to work | Dental | Enhanced family-friendly policies | Enhanced sick payMid-level Full TimeGloucester, South Gloucestershire, United Kingdom1d ago
-
Senior ML Engineer, Doc Fraud GBP 70K-85KAWS | Code review | Documentation | Evaluation Pipelines | GPU OptimizationCareer growth | Collaborative culture | Hybrid work option | Learning opportunities | Remote work optionSenior-level Full TimeUnited Kingdom - London (Onfido)1d ago
-
Power Analyst – Data Scientist GBP 45K-45KCI/CD | Databricks | Excel | Git | KerasChildcare vouchers | Corporate gym memberships | Cycle to work scheme | Electric car lease programme | Health assessmentsMid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 45KAgile | Apache Spark | Automated testing | Azure | Azure DataAnnual leave | Bonus scheme | Flexible benefits | Flexible working | Pension schemeMid-level Full TimeEnterprise House, United Kingdom1d ago
-
Senior Data Engineer GBP 64KApache Spark | Automation | Azure | CI/CD | Change ManagementAnnual leave | Discounts and perks | Enhanced family leave | Flexible benefits | Life assuranceSenior-level Full TimeLancaster House, United Kingdom1d ago
-
Data Engineer GBP 49K-55KArtificial Intelligence | Automation | Data Governance | Data Ingestion | Data ModelingBenefit Hub | Competitive annual leave | Contributory pension | Group income protection | Hybrid workingMid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 80K-100KAWS | Access Control | Alerting | Apache Airflow | Apache SparkCareer growth opportunities | Dental insurance | Employer pension contribution | Group life assurance | Health insuranceMid-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Engineer (Databricks) GBP 74K-80KAWS | AWS DMS | Agile | Amazon S3 | CI/CDAgile team collaboration | Connected team | Innovative culture | Professional developmentSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Analytics Engineer GBP 50K-55KAWS | AWS Glue | Amazon Redshift | Apache Airflow | Azure DataAnnual Holiday Vouchers | Bonus scheme | Discounted flights | Flexible benefits | Free easyJet Plus membershipMid-level Full TimeUnited Kingdom-London-London Luton Airport1d ago
-
Remote AI Engineer - Knowledge (m/f/d) EUR 85K-95KAPI | AWS | Access Control | DBT | DagsterBetterHelp Access | Birthday day off | Bonus vacation time | Co-working support | Extra days offMid-level Full TimeRemote Germany R1d ago
-
Remote AI Engineer - Agents (m/f/d) EUR 85K-95KAPI Integration | AWS | Alerting | Asynchronous programming | AuthenticationAnnual personal and professional development | BetterHelp Access | Birthday day off | Co-working support | Flexible working hoursMid-level Full TimeRemote Germany R1d ago
-
Senior Analytics Engineer GBP 80K-95KApache Airflow | DBT | Data Modeling | Data Quality | Data WarehouseBike storage | Comprehensive health and dental coverage | Cycle to work scheme | Dental insurance | Flexible paid time offSenior-level Full TimeLondon, England1d ago
-
Data and AI - Data Architect or Engineer GBP 75K-110KAI enablement | AWS Glue | Amazon EMR | Amazon Redshift | Apache Spark25 days annual leave | Additional holidays | Company pension | Dental cover | Flexible work optionsSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Embedded system Test Engineer GBP 45K-50KAgile | Analog I/O | Analog electronics | Analog to Digital | Analog to digital I OMid-level Full TimeGlasgow, Lanarkshire, United Kingdom1d ago