Senior Data Engineer

Description

As a Senior Data Engineer within our development team, you will play an important role in design, implementation, and ongoing performance optimization of anything data oriented in the R&D department, including ETL/ELT processes, working closely with architects and development teams.  

Your duties and responsibilities include:  

• Lead the design and implementation of scalable data architecture solutions. 
• Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems). 
• Identify ways to improve data reliability, efficiency, and quality. 
• Collaborate with data scientists, data analysts, and other stakeholders to achieve optimal data performance. 
• Optimize complex SQL queries and perform performance tuning. 
• Participate in Scrum and Agile development processes. 
• Implement and manage relational and non-relational databases. 

Requirements

Must-have Qualifications 

• 5+ years of experience leading, designing, and implementing data architecture at an enterprise level. 
• 5+ years of experience working with relational databases (for example, PostgreSQL, MSSQL or MySQL). 
• 2+ years of experience working with Elasticsearch. 
• 2+ years of experience working with non-relational databases (for example, MongoDB or Cassandra). 
• Be exceptionally strong in SQL development - complex queries and performance tuning.  
• Implement and manage ETL/ELT processes for data integration and transformation. 
• Proficiency in Azure and Azure Data Factory for data integration and transformation. 
• Experience with Databricks or similar data processing platforms. 
• Experience with Scrum and Agile methodology. 
• Fluent in spoken and written English. 

Advantages 

• Experience with big data technologies such as Hadoop, Spark, or Kafka. 
• Familiarity with data warehousing solutions. 
• Knowledge of data governance and data security practices. 
• Certification in Azure or other relevant technologies. 
• University or college degree in Computer Science or a related discipline.