Data Engineer

In this role, key duties and responsibilities include:

• Create and maintain both batch (ETL/ELT) and real-time data pipelines and architecture  
• Ensure all data provided by Data Platform is of the highest quality and is delivered in a timely manner and in line with agreed SLAs  
• Assemble large and complex data sets that meet functional and non-functional business requirements  
• Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.  
• Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies  
• Collaborate with stakeholders including data architects, Executive, Product, Data and IT team members from the beginning to the delivery of a project  
• Build a scalable, modern, and trusted data ecosystem, making sure it is responsive, available and in line with business requirements  
• Take part in sprints, workloads, and deliverables through agile methodologies  
• Manage quality assurance, verification of accuracy and consistency of data, specifically KPI measures sent to the business

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• Experience working in an online, gaming, or fast-moving industry required
• 3+ years of work experience in data engineers and data platforms 
• Must have experience in successfully implementing data-centric applications, such as data warehouses, operational data stores, and data integration projects  
• Experience with SQL, ETL, data modeling, and Python
• Experience working with terabyte to petabyte scale data
• Excellent Verbal and written Communication skills
• Strong analytical and problem-solving skills that balance with creative approaches  
• Ability to take ownership of projects with diligence and consistency in carrying out tasks with a high level of attention to detail and priority
• Collaborative, able to engage in interactive discussions with the rest of the team and able to communicate technical concepts clearly and concisely
  

Technical Skills

• Strong experience with large-scale production databases and SQL  
• Solid understanding of cloud data services: AWS services such as S3, Athena, EC2, RedShift, EMR, EKS, RDS and Lambda  
• Proficient with one or more big data & new data technologies such as DBT, NIFI, Airflow, Kafka  
• Knowledge in working with time-series/analytics databases such as Elasticsearch  
• Understanding of containerization and orchestration technologies like Docker/Kubernetes  
• Familiarity with Marketing tooling and/or CRM systems is preferred  
• Familiarity with using business intelligence tools such as Domo, Superset or other similar tooling 

Personal Characteristics

• Proactive, agile, innovative and solution orientated work approach with strong sense of ownership and accountability for his’s/her’s work and impact on business
• Thrives working in a fast-paced and challenging environment
• Ability to think outside of the box, be innovative, adaptable, identify continuous improvement areas and come up with creative solutions to challenges
• Detail-oriented and organized. 
• Strong work ethic and ability to work in a collaborative environment. 
• Ability to multitask and prioritize. 
• Adaptability and flexibility 
• Constructively challenges with positive arguments
• Comfortable with being challenged / seeking challenge