Azure Data Engineer - Remote Job

Company Description

We are a multinational team of individuals who believe that with the right knowledge and approach, technology is the answer to the challenges that business face today. We have been bringing this knowledge and approach to our customers since 2016, helping them translate technology into their success.

With Swiss roots and our own development team in Lima and throughout the region, we offer the best of both cultural areas: the talent and passion of Latin American professionals combined with Swiss organization skills and mindset.

Job Description

We are looking for professionals with strong Azure experience to incorporate to our talent pool for future vacancies with our external clients.

The benefit of being part of our talent pool, is that when we evaluate you, you would already have the process advanced and it would only be a matter of talking when the position opens to confirm if you are interested. Besides the fact that we will always have you as a priority every time there is a vacancy that matches your profile.

Qualifications

• Only for residents in Latin America.
• Minimum of 6 years of experience.
• Hands-on experience using ADF to connect to different sources (RDBMS, Salesforce, flat files) and bring data into ADLS.
• Hands-on experience handling incremental load and full load approaches.
• Hands-on experience handling semi-structured data such as JSON.
• Hands-on experience using Databricks with delta lake concepts.
• Strong SQL skills with (Slow Change Types [SCD], Joins, Common Table Expressions [CTEs], Hierarchies, etc.).
• Hands-on experience with PySpark.
• Hands-on experience using Databricks Notebooks and optimization techniques.
• Experience with Azure Cloud Services for Data Engineering.
• Understanding of Data Layers: Raw, Refined and Curated Models.
• Experience with Databricks: programming and automating notebooks using ADF.
• Performance optimization of Spark or PySpark code, including techniques such as partitioning and data caching.
• Hands-on experience in creating a user-defined function (UDF) in Databricks and how it can be applied to a DataFrame.
• Management and operation of DataFrames for Data Engineering activities.
• Advanced English proficiency
• Desirable: Scala