Data Engineer
London, UNITED KINGDOM, United Kingdom
Visa
Visa digitaalinen ja mobiilimaksuverkko on eturintamassa uusien maksujen, sähköisten ja kontaktivarojen maksutekniikan, jotka muodostavat rahan maailmanCompany Description
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.
Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.
Job Description
- Develop a deep understanding of Visa’s data assets and how they can be used to support Data Science activities across the company
- Execute data engineering projects ranging from small to large either individually or as part of a project team.
- Build and maintain ETL pipelines in Spark, Python or HIVE that process transaction and account level data and standardize data fields across various data sources
- Troubleshoot
- Design, develop, and maintain reusable data assets
- Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy, integrity and consistency
- Collaborate with Data Engineering teams in North America and other Global regions to production and maintenance of key data assets.
This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.
Qualifications
Required qualifications:
- Bachelor’s Degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
- Entry level experience of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, MLlib, GraphX, iPython, sci-kit,Pandas etc.)
- Working knowledge in writing and optimizing efficient SQL queries with Python, Hive, Scala handling Large Data Sets in Big-Data Environments.
- Experience managing large-scale datasets using Big Data and distributed processing platforms such as Hadoop, Hive and Spark
- Experience with Visualization Tools like Tableau, Power BI, D3
- Experience with modern DevOps practices (including Git and CI/CD)
- Experience with Unix/Shell and exposure to Scheduling tools such as Airflow.
- Strong problem-solving skills
Preferred qualifications:
- Functional knowledge of cloud computing platforms such as AWS, Azure or GCP
- Background in payments or banking
Additional Information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS Azure Banking Big Data CI/CD Computer Science D3 DevOps Economics Engineering ETL Finance GCP Git Hadoop Pandas Pipelines Power BI Python Scala Spark SQL Statistics Tableau
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.