Big Data Engineer

On behalf of our client, who is an unique provider of digital business transformation solutions and technologies for enterprises in the areas of Digital, Connected Solutions and Consumer Technologies, we are looking for Big Data Engineer.      

 
Responsibilities: 

•  Use your knowledge and experience in various projects for our customers;
  
• Design and develop robust cloud-based data pipelines using ETL technology (Python/SQL/AWS based services);
  
• Organizing data in relational databases/data lakes/data warehouses;
  
• Work closely with data scientists to create intelligent decision-making systems;
  
• Communicate with key business stakeholders to gather requirements and present your work;
  
• Participate in code reviews;
  
• Document your work
  

Requirements

• BS or Master's Degree in Computer Science, Statistics, or other data-related fields 
  
• 3 + years of industry experience in building solutions with: 
  - Building data pipelines with large datasets
  - Designing databases/data warehouses (preferable in Snowflake). 
  - Designing systems using AWS infrastructure from the scratch (e.g. S3, EMR, ECS, Athena, Lambda, Redshift etc.)
  
• Experience in Databricks 
  
• Experience in containerization (Docker, Docker swarm, Docker compose)
  
• Scheduling and monitoring workflows (e.g. in Apach Airflow)
  
• Programming language: Python/SQL/NoSQL
  
• Fluent in English 
  

Nice to have:

•  Experience with Big Data technologies such as Hive, Spark, Kafka, or others is an asset. 
  
•  Working on Linux  
  
  

Benefits

• Competitive salary on Contract of Employment or B2B (paid holidays, sick leave);
  
• Participate in Social Events, training and work in an international environment;
  
• Attractive Medical Package;
  
• Access to Udemy;
  
• Remote work and flexible working hours.