AWS Cloud Data Engineer
Tasks
- Build batch and real-time data workflows
- Build data models using DBT
- Design and develop data pipelines with Databricks and Apache Spark
- Develop modular reusable data pipelines
- Implement data testing and validation
- Ingest data from APIs streaming and databases
- Manage data documentation and lineage in dbt
- Transform and process data with PySpark SQL and Delta Lake
- Write SQL transformations
Perks/Benefits
- Learning and development opportunities
- Mental health support
- Training courses access
- Wellbeing programs
Skills/Tech-stack
AWS CloudFormation | AWS Glue | AWS Lambda | Amazon S3 | Amazon VPC | Apache Airflow | Apache Iceberg | Apache Spark | Boto3 | DBT | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ECS | EKS | IAM | PySpark | Python | SQL | Service Catalog | Snowflake | Snowflake Snowsight | Snowpipe | Terraform
Education
N/A
Related jobs
-
Senior AI Engineer - LLMs and Finetuning GBP 84K-109KAWS | Benchmarking | Data Generation | Dataset Engineering | Distributed TrainingEnhanced parental leave | Flexible working arrangements | Group life assurance | Hybrid working | Paid sabbaticalSenior-level Full TimeLondon6h ago
-
Senior AI / LLM Engineer GBP 70K-92KAI Governance | AI Studio | AKS | Agent Orchestration | Azure AIDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom21h ago
-
Software Engineer (Trading Systems) GBP 50K-70K.NET | API Development | API Integration | Alpha Data Platform | Charles RiverMid-level ContractLondon, United Kingdom of Great Britain …22h ago
-
Senior Backend AI Engineer GBP 28K-30KAPI Design | AWS | Azure | Backend Development | Cloud platformEmployee assistance programme | Employee wellbeing support | Flexible working options | Free virtual GP service | Holiday allowanceSenior-level Full TimeWelwyn Garden City, United Kingdom of …23h ago
-
Staff AI Engineer GBP 78K-90KCI/CD | Data Engineering | Data Modeling | Data Pipelines | Data PreprocessingCareer growth | Hybrid work | Remote workSenior-level Full TimeLondon - Remote in the UK R1d ago
-
C++ | Data Mining | Data Regression | Deep learning | Distributed ComputingSenior-level Full TimeLondon, UK1d ago
-
Senior Software Specialist - AI/ML - Monetisation GBP 100K-140KAds Auction | Behavior Modeling | Bidding | Budgeting | C++Senior-level Full TimeLondon, UK1d ago
-
Data Engineer GBP 42K-45KAPI Integration | Apache Kafka | BigQuery | Cloud Platforms | Data GovernanceCycle to work scheme | Discounts for family and partners | Health cash plan | Life insurance | Paid time offMid-level Full TimeLondon, England, United Kingdom1d ago
-
Lead Software Engineer - Data & AI GBP 84K-126KAWS | Amazon Athena | Amazon SageMaker | Apache Flink | Apache KafkaSenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Senior AI Engineer (AI Platform) GBP 72K-90KAI Foundry | API Gateway | API Management | APIM | APIsDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
AI Engineer GBP 90K-125KAWS | Agent systems | Agentic Workflows | Azure | Cloud PlatformsBank holidays | Carry over holiday | Cycle to work scheme | Dental insurance | Happy hoursMid-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer – Data Science & Technology GBP 38K-50KData Architecture | Dimensional Modeling | ELT | ETL | NumPyAccess to fitness facilities | Charitable contribution match | Charity volunteer days | Continued learning opportunities | Employee assistance programsMid-level Full TimeLondon, United Kingdom1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
Mid-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
Junior Analytics Engineer GBP 30K-35KAzure Synapse | Data Documentation | Data Governance | Data Modelling | Data QualityMentoring programs | Training programsEntry-level Full TimeLondon, United Kingdom1d ago
-
Data Analytics Engineer- Senior Consultant II GBP 60K-65KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureContinuous Learning Hub | Cycle to work scheme | Discounted gym membership | Employee assistance programme | Flexible working optionsSenior-level Full TimeBelfast 10 Mays Meadow, United Kingdom1d ago
-
Lead Cyber Automation and AI Engineer GBP 84K-109KArchitecture Troubleshooting | Artificial Intelligence | Automation | Cloud | ContainerizationEmployee development opportunities | Flexible working arrangements | Team collaborationSenior-level Full TimeWaterloo Street, United Kingdom1d ago
-
AI Solution Lead GBP 58K-75KAPI Integration | Azure Machine Learning | CI/CD | Data Governance | DevSecOpsContributory pension | Cycle to work | Dental | Enhanced family leave | Enhanced sick paySenior-level Full TimeWarminster, Wiltshire, United Kingdom1d ago
-
Senior-level Full TimeHolborn - London, United Kingdom1d ago
-
Senior-level Full TimeHolborn - London, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 70K-80KAWS | CI/CD | Data Pipelines | Databricks | Deep learningCross-functional collaboration | Hybrid work | MentorshipSenior-level Full TimeHolborn - London, United Kingdom1d ago
-
Forward Deployed Engineer - AI Engineer GBP 80K-110KAPI Design | AWS | Agent Orchestration | Agent systems | Asynchronous programmingBe Well programs | Coaching | Hybrid work | Professional development | Travel as neededMid-level Full TimeNo City (KGB51625) England,Wales,N Ireland, United …1d ago
-
Senior Generative AI Engineer GBP 78K-109KAPI Development | Containerization | Data Privacy | Docker | Feature EngineeringHackathons | Hybrid work | Mental health support programs | Training and development | Wellbeing programsSenior-level Full TimeLondon, GB1d ago
-
Data Engineer GBP 60K-75KAmazon S3 | Apache Airflow | Apache Iceberg | Apache Spark | CI/CDCompany share options | Flexible hybrid working contribution | Generous holiday allowance | Private medical insurance | Wellbeing benefitsMid-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer GBP 70K-70KAgile | Behavior-Driven Development | CI/CD | Code review | Data EngineeringDiscounted gym membership | Electric vehicle leasing | Experience days | Hybrid work | Life assuranceSenior-level Full TimeLondon, United Kingdom1d ago