Data Engineer in Product Analytics

Warszawa (Jana Pawła II 22)

Apply now Apply later

We are looking for you, if you have:

  • hands-on experience building complex data pipelines,
  • strong experience in data processing and optimization using Apache Spark, 
  • good knowledge of data manipulation and transformation,
  • experience with Apache Airflow, Python, SQL, 
  • knowledge of software engineering best practices, 
  • deployment and provisioning automation tools (e.g., Docker, Kubernetes, CI/CD). 

You'll get extra points for:

  • hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (S3/Spark and/or Kafka/Flink), 
  • knowledge of reporting tools (e.g. Superset, PowerBI),  
  • experience with monitoring and observability (ELK stack), 
  • bash scripting and Linux systems, 
  • security, authentication, and authorization (LDAP / Kerberos / PAM), 
  • experience working in cloud environment (e.g., GCP).

Your responsibilities:

  • creation, schedule and optimization of the data processing pipelines using Apache Spark, Apache Flink and Apache Airflow deployed on our data analytics platform,
  • creation of data assets and interacting with the customers to help them create dashboards with meaningful insights.

 

Information about the squad:

ING Analytics is a major driving force in ING’s transformation, aimed at helping us to become a data-driven digital leader and creating tangible value for ING and its customers through world-class analytics models, products, and services.  

The Analytics Engineering team is a team of 70+ engineers (and growing rapidly) that has the mission to enable this transformation. We do this by combining Big Data technology with Data Science to deliver high-value solutions and products for our organization. We work in a fun and creative environment, and we are dedicated to bringing out the best in both each other and our projects. 

You will work as an engineer in our Product Analytics squad. This is a new squad with the objective of bringing insights on the usage of software products produced in our Bank Technology department. The squad has a start-up, no nonsense mentality and focus on delivering MVP’s and roadmap for production ready PA tools.  

  

The role naming convention in the global ING job architecture will be “Engineer III”.

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  3  0  0

Tags: Airflow Architecture Big Data CI/CD Data Analytics Data pipelines Distributed Systems Docker ELK Engineering Flink GCP Kafka Kubernetes Linux MVP Pipelines Power BI Python Security Spark SQL Streaming Superset

Perks/benefits: Startup environment

Region: Europe
Country: Poland

More jobs like this