Data Engineer
Bnei Brak, Israel, IL
eToro
Trade and invest on a trusted multi-asset platform. Get ideas from 35M users, practise with a demo account or copy top-performing traders automatically.Description
eToro’s award-winning trading and investing platform is at the forefront of Fintech technology. Our Research and Development department develops cutting-edge technologies, focusing on field-relevant areas, such as blockchain and artificial intelligence. We promote an organizational culture which is both professional and fun.
What you’ll be doing
- Gathering requirements from internal customers
- Design, manage and maintain analytics products and pipeline solutions.
- Create new ETL/ELT processes and optimize existing by different tools (Python, PySpark, Databricks, etc.)
- Debugging, monitoring, and troubleshooting pipeline solutions
- Provide analysts and other internal customers with technical support related to data activity
Requirements
- 3+ years experience working as a Data Engineer
- At least 2 years of experience with Python
- PySpark/Databricks - Big Advantage
- Experience in writing ETL\ELT Processes
- Have experience in designing, building, optimizing, and maintaining big data pipelines on the public cloud (preferably Azure).
- Knowledge in SQL.
- Transfer current data structures to cloud/big data
- Working with Spark and ETL flows
- Good analytical skills and original thinking
- Good system-level understanding of problems
- ETL with Stream Technology - Big Advantage
- Work in production environment in large scale be part of OnCall routine
- Work with CI/CD in various platforms
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure Big Data Blockchain CI/CD Databricks Data pipelines ELT ETL FinTech Pipelines PySpark Python Research Spark SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.