Senior Data Engineer (DataBricks)

Softeta is looking for an experienced Data Engineer to join their growing team. As a Data Engineer, you will have the opportunity to work on cutting-edge data projects and contribute to the development of innovative data solutions.

You will be responsible for data processing for a modern platform created by a community of craftsmen that connects professionals in various fields with those who seek their services.

In this role, you will have to work with big data, data migration, and ELT creation.

Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes;
• Data modeling, data cleansing;
• Automating data processing workflows using tools such as Airflow or other workflow management tools;
• Optimizing the performance of databases, including designing and implementing data structures and using indexes appropriately
• Implement data quality and data governance processes.
• Being a data advocate and helping unlock business value by using data.

Technologies - MS SQL, Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Airflow, Python.

Requirements

• 4+ years of experience as a Data Engineer;
• Experience with Azure (Certifications are a Plus)
• Experience with Databricks, Azure Data Lake, Data Factory and Apache Airflow
• CI/CD or infrastructure as code
• Architecture: knowledge of Medallion Architecture or Multihop architecture
• Experience developing and administering ETL processes in the Cloud (Azure, AWS or GCP) environment;
• Strong programming skills in Python and SQL;
• Strong problem-solving and analytical skills.

Benefits

• Diverse and technically challenging projects;
• Remote workplace model;
• Flexible schedule and Agile/SCRUM environment;
• Technical equipment which you can choose.
• Salary range - from 4000 EUR to 6000 EUR before taxes, from 30 EUR/h to 40 EUR/h for contractors.