Senior Data Engineer

Senior Data Engineer will be responsible for:

You are part of a team that is responsible for our new software generation in the cloud

You will be responsible for interpreting data, analyzing results using statistical techniques

You make recommendations about the methods and ways in which our company obtains and analyses data to improve quality and the efficiency of data systems

Your responsibilities also include developing and implementing data analyses, data collection systems and other strategies that optimize statistical efficiency and quality

Acquiring data from primary or secondary data sources and maintaining databases is also part of the profile

Provide expertise in data wrangling, exploratory data analysis and feature engineering with large data sets

Support the development of proofs of concepts to demonstrate the application of AI/ML capabilities in solving customer problems in collaboration with product and other development teams

You work in an agile team with agile methods

Requirements:

-          You have successfully completed a degree in computer science, mathematics and experience in data science (e.g., machine learning)

-          Experience with designing, building, and optimizing data and model training pipelines

-          Hands on experience in python or similar scripting language

-          Good hands-on experience in relational database and ability to analyse large datasets

-          Exposure to NoSQL

-          Experience in ETL tools and processes

-          Worked on cloud either AWS

-          Experience in tools like spark or Kafka

-          Ability to write comprehensive reports Dedicated team player with a high sense of responsibility and interest in complex business management issues

-          Strong communication skills. You communicate complex solutions across teams and clients

-          An analytical mind and inclination for problem-solving

Good to have:

-          Frameworks: Airflow, DBT, Debezium, among others

Cloud : Azure

-          Familiarity with Jira and Confluence

-          Production experience in publishing machine learning model through API

-          Microsoft SQL server