AWS Data Engineer
Kensington, London
dmg events
dmg events is a leading organiser of face-to-face events and a publisher of trade magazines. dmg events organises over 80 events across 25 countries diverse industries including Construction, Energy, Coatings, Transport, Hospitality & Design.
Introduction
We are looking for an experienced AWS Data Engineer to join our team to support the development of the Customer Data Platform (CDP) project. As a Data Engineer, you will work closely with the Lead Engineer, Business Analysts and third-party professional services to lay the groundwork to enable the business to truly become data-driven, creating the one source of truth for our customer data.
Responsibilities
• Designing, building and maintaining the data lake solution and associated pipelines
• Develop and own the data strategy on coding best practices
• Contribute to the overall architecture by identifying gaps and efficiencies in the design
• Ensuring that data quality is considered at every point of the data journey and working closely with the business to ensure the correct rules and identifiers are in place
• Coaching the junior members of the Data team to be more cloud engineering focussed
• Maintaining, testing and implementing disaster recovery procedures.
Skills/Qualifications
• 5+ years as a Data Engineer within the AWS cloud environment
• Hands-on experience with the following:
o S3/Redshift
o AWS Glue
o AWS Lambda
o API Gateway
o Amazon AppFlow (Desirable)
o FindMatches (Desirable)
• Expertise in moving and transforming data using Python, Spark & Scala
• Experience in using REST APIs for data transfer
• Solid understanding of master data management and its integration into the broader infrastructure
• Knowledge and experience with testing, releasing, and CI/CD pipeline deployments into AWS using tools like Bitbucket, Jenkins, ServiceNow
• Understanding of Agile methodologies, processes and procedures
• Demonstrated ability to be a self-starter and take ownership of their work
• Experience in using SalesForce would be considered an advantage
dmg events is an equal opportunity employer. If you have not had feedback from us within 14 days, please consider your application as unsuccessful for this round.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
2
1
0
Category:
Engineering Jobs
Tags: Agile APIs Architecture AWS AWS Glue Bitbucket CI/CD Data management Data quality Data strategy Engineering Jenkins Lambda Pipelines Python Redshift Salesforce Scala Spark Testing
Perks/benefits: Career development Team events
Region:
Europe
Country:
United Kingdom
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Scientist II jobsSr. Data Engineer jobsPrincipal Data Engineer jobsStaff Data Scientist jobsBI Developer jobsStaff Machine Learning Engineer jobsData Manager jobsSenior AI Engineer jobsData Science Intern jobsJunior Data Analyst jobsBusiness Data Analyst jobsData Science Manager jobsResearch Scientist jobsPrincipal Software Engineer jobsData Specialist jobsSoftware Engineer II jobsData Analyst Intern jobsLead Data Analyst jobsSr. Data Scientist jobsData Engineer III jobsDevOps Engineer jobsJunior Data Engineer jobsBI Analyst jobsAI/ML Engineer jobsData Engineering Manager jobs
Snowflake jobsEconomics jobsLinux jobsOpen Source jobsKafka jobsData Warehousing jobsHadoop jobsNoSQL jobsAirflow jobsRDBMS jobsMLOps jobsComputer Vision jobsJavaScript jobsGoogle Cloud jobsBanking jobsPhysics jobsKPIs jobsClassification jobsScala jobsLooker jobsScikit-learn jobsData warehouse jobsOracle jobsPostgreSQL jobsTerraform jobs
GitHub jobsStreaming jobsSAS jobsScrum jobsR&D jobsPySpark jobsPandas jobsCX jobsBigQuery jobsData Mining jobsDistributed Systems jobsJira jobsdbt jobsIndustrial jobsRobotics jobsMicroservices jobsRedshift jobsReact jobsJenkins jobsUnstructured data jobsData strategy jobsNumPy jobsRAG jobsMySQL jobsPharma jobs