AWS Data Engineer
Kensington, London
dmg events
dmg events is a leading organiser of face-to-face events and a publisher of trade magazines. dmg events organises over 80 events across 25 countries diverse industries including Construction, Energy, Coatings, Transport, Hospitality & Design.
Introduction
We are looking for an experienced AWS Data Engineer to join our team to support the development of the Customer Data Platform (CDP) project. As a Data Engineer, you will work closely with the Lead Engineer, Business Analysts and third-party professional services to lay the groundwork to enable the business to truly become data-driven, creating the one source of truth for our customer data.
Responsibilities
• Designing, building and maintaining the data lake solution and associated pipelines
• Develop and own the data strategy on coding best practices
• Contribute to the overall architecture by identifying gaps and efficiencies in the design
• Ensuring that data quality is considered at every point of the data journey and working closely with the business to ensure the correct rules and identifiers are in place
• Coaching the junior members of the Data team to be more cloud engineering focussed
• Maintaining, testing and implementing disaster recovery procedures.
Skills/Qualifications
• 5+ years as a Data Engineer within the AWS cloud environment
• Hands-on experience with the following:
o S3/Redshift
o AWS Glue
o AWS Lambda
o API Gateway
o Amazon AppFlow (Desirable)
o FindMatches (Desirable)
• Expertise in moving and transforming data using Python, Spark & Scala
• Experience in using REST APIs for data transfer
• Solid understanding of master data management and its integration into the broader infrastructure
• Knowledge and experience with testing, releasing, and CI/CD pipeline deployments into AWS using tools like Bitbucket, Jenkins, ServiceNow
• Understanding of Agile methodologies, processes and procedures
• Demonstrated ability to be a self-starter and take ownership of their work
• Experience in using SalesForce would be considered an advantage
dmg events is an equal opportunity employer. If you have not had feedback from us within 14 days, please consider your application as unsuccessful for this round.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: Agile APIs Architecture AWS AWS Glue Bitbucket CI/CD Data management Data quality Data strategy Engineering Jenkins Lambda Pipelines Python Redshift Salesforce Scala Spark Testing
Perks/benefits: Career development Team events
Region:
Europe
Country:
United Kingdom
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsStaff Machine Learning Engineer jobsBI Developer jobsData Scientist II jobsStaff Data Scientist jobsPrincipal Data Engineer jobsData Manager jobsSenior AI Engineer jobsJunior Data Analyst jobsData Science Manager jobsResearch Scientist jobsBusiness Data Analyst jobsPrincipal Software Engineer jobsData Specialist jobsLead Data Analyst jobsData Science Intern jobsData Analyst Intern jobsSoftware Engineer II jobsSr. Data Scientist jobsData Analyst II jobsData Engineer III jobsSoftware Engineer, Machine Learning jobsBI Analyst jobsAzure Data Engineer jobsJunior Data Engineer jobs
Snowflake jobsEconomics jobsLinux jobsOpen Source jobsData Warehousing jobsRDBMS jobsComputer Vision jobsGoogle Cloud jobsAirflow jobsHadoop jobsKafka jobsNoSQL jobsMLOps jobsJavaScript jobsBanking jobsData warehouse jobsKPIs jobsClassification jobsScikit-learn jobsScala jobsPhysics jobsOracle jobsLooker jobsStreaming jobsTerraform jobs
PostgreSQL jobsSAS jobsPySpark jobsR&D jobsBigQuery jobsData Mining jobsScrum jobsPandas jobsGitHub jobsCX jobsDistributed Systems jobsJira jobsRedshift jobsdbt jobsIndustrial jobsRobotics jobsUnstructured data jobsMicroservices jobsPharma jobsReact jobsJenkins jobsData strategy jobsMySQL jobsE-commerce jobsGPT jobs