Data Engineer
Frankfurt, Hessen, Germany
payabl.
Discover payabl. – Your payment platform for secure payment services, payment processing, and business payments. From online payments to card payments online, we provide the solutions you need.payabl. empowers businesses to grow through payments innovation and banking services. Our ambition is to expand our strong portfolio of global financial services we provide to businesses and make them all available in one place on our platform we call payabl.one. As a licensed financial company with principal membership with card schemes, we specialize in global payments and providing businesses with multi-currency accounts.
This role is about:
Data Team, where you play a vital role in collecting, analyzing, and interpreting data to support decision-making across the organization. Your tasks include data collection, ensuring quality, and developing databases. You're skilled in SQL, Python for data manipulation and visualization tools. Collaborative and communicative, you work with various teams to understand their needs and provide actionable insights. Passionate about staying updated with new technologies, you drive innovation and contribute to a culture of continuous improvement.
You will:
- Data Architecture Design: Design and implement scalable, reliable, and efficient data pipelines and infrastructure to ingest, process, and store large volumes of structured and unstructured data.
- Data Modeling: Develop and maintain data models to support analytics and reporting needs, ensuring data integrity, consistency, and optimization for performance. Design and implement OLAP (Online Analytical Processing) cubes and structures for multidimensional analysis.
- Data Integration: Integrate data from various sources, both internal and external, ensuring compatibility, consistency, and reliability across datasets.
- Data Quality and Governance: Implement processes and tools to ensure data quality, consistency, and compliance with regulatory requirements. Establish data governance policies and procedures.
- Performance Optimization: Monitor and optimize data pipelines and systems for performance, scalability, and cost-effectiveness. Troubleshoot and resolve issues as they arise.
- Collaboration: Collaborate with cross-functional teams, including analysts, software engineers, and business stakeholders, to understand data requirements and deliver solutions that meet business objectives.
- Documentation: Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.
What we need:
- Proven experience in data engineering or related roles, with a strong understanding of data structures, algorithms, data management principles, and best practices
- Have experience working with real-time or near-real-time ingestion
- Proficiency in programming languages such as Python, Java, or Scala
- Working knowledge of Unix OS / Shell scripting
- Experience with ETL / ELT pipeline design, implementation, and maintenance (Airflow, Luigi)
- Experience with SQL, relational, non-relational, and column-oriented databases (e.g., PostgreSQL, MySQL, MongoDB, Apache Druid, ClickHouse)
- Experience with big data technologies and frameworks such as Hadoop, Spark, Kafka
- Experience with data warehouse platforms such as Snowflake and Databricks, including data modeling, performance optimization, and administration.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP)
- Experience with containerization and orchestration technologies such as Docker and Kubernetes
- Experience with data visualization tools (e.g., Tableau, Power BI, Superset)
- Experience with finance data (transactions, clearing reports)
The perks of being a payabl.er:
- 🚗 Drive in Style: After your probation, a sleek company car is all yours at the soonest availability.
- ⏳ Future-Proof Your Finances: Jump on board, and after your probation period, we'll kickstart your Provident Fund.
- 🌱 Grow Without Limits: Our environment is all about nurturing your talents and fueling your ambition with endless opportunities for professional development.
- Speak Like a Local: Greek language classes, offered twice a week for all team members.
- 💳 Shop and Save: Get exclusive access to a discount card at various local businesses.
- 🌍Thrive in a multicultural workplace that celebrates diversity and values your unique contributions. Here, every perspective is appreciated, and every voice is heard.
- Lead the Charge in Pioneering Projects: Be at the forefront of innovation by playing a key role in groundbreaking projects.
- 🏝 Max Out Your Downtime: With 25 days off plus public holidays, and an extra 10 days for when you're under the weather, we make sure you have ample time to relax, recharge, and return brighter.
- 📚 Support for Your Educational Aspirations: We're here to support your educational pursuits because we believe in investing in your growth.
- 🍔 Wolt Your Way Through Lunch: Enjoy a Wolt lunch allowance of €150 per month
The benefits list above, states the benefits for Cyprus location only. As the role is open to multiple locations such as Germany and the benefits list will differ depending on your location.
Onsite work model for Cyprus. Germany has the option to work on Hybrid work model.
Ready to Join Us?
Let's embark on a journey to redefine the landscape of payments together. We're not just offering a role; we're inviting you to be a part of something bigger. Join our team, and let's innovate, disrupt, and lead the future of payments. Together, we can make an impact that resonates. Welcome to the team!
If this role seems like a good match, please submit your resume all applications are treated with the strictest confidentiality. Please note that we may keep your CV for a period of one (1) year for future relevant job opportunities. For more information about how we process your data please see our privacy policy at https://www.payabl.com/privacy-policy
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture AWS Azure Banking Big Data Databricks Data governance Data management Data pipelines Data quality Data visualization Data warehouse Docker ELT Engineering ETL Finance GCP Hadoop Java Kafka Kubernetes MongoDB MySQL OLAP Pipelines PostgreSQL Power BI Privacy Python Scala Shell scripting Snowflake Spark SQL Superset Tableau Unstructured data
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.