Senior Manager, Data Engineering Specialist

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

The Business and Strategy Analytics team is part of the Intelligence and Data Solutions team, that partners with the Asia Pacific Regional President’s Office to enable Visa internal business units to optimize performance and profitability and make data-driven decisions. The team provides management intelligence to democratize data insights across the organization and strategic analytics to identify opportunities and deep dive on key payment trends and shape the future of payments.

What a Sr. Manager Data Engineer Specialist does at Visa

The successful candidate will enable the foundational data layer for senior management reports and dashboards. You will be critical for developing, maintaining and enhancing the backend data robustness and efficiency. You will have expertise in data engineering, data architecture and data governance, and you will act as a bridge between end-users and Visa technology team. Specific responsibilities include:

• Design and implement scalable data architecture on Hadoop ecosystem to support senior management reporting needs
• Create and maintain optimal data pipelines, data marts and architecture(s), based on our Global Technology Stack
• Develop and maintain ETL pipelines using Python, Spark, and other big data technologies
• Create data models and structures to efficiently process and store large volumes of data
• Implement data quality controls and monitoring systems to ensure accuracy and reliability
• Optimize data systems for performance, scalability, and cost-efficiency
• Document data flows, architectures, and processing methodologies
• Continuous focus on improving Infrastructure efficiency by analyzing logs of queries, tuning settings, translating queries if required.
• Review scripts for best practices, educating user base and building training assets for beginner and intermediate users.
• Policy guidance and administration of tools including git, ETL schedulers, Spark, Tableau etc. to ensure optimum utilization and efficiency.

The role reports to the Management Intelligence Head, Business and Strategy Analytics Asia Pacific and will be based in Singapore.

This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications
8 or more years of relevant work experience with a Bachelor Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD

Preferred Qualifications
9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD

What you will need

Technical

• 10+ years of data engineering and support experience.
• Deep knowledge of distributed data architecture, commonly used BI tools, and approaches/packages used in machine learning build
• Expertise in creating production software/systems in Python and/or Scala, and a proven track record of identifying and resolving performance bottlenecks in production systems.
• Experience with complex, high volume, multi-dimensional data, as well as machine learning models based on unstructured, structured, and streaming datasets.
• Advanced experience in writing and optimizing efficient SQL queries and Python/PySpark scripts. Scala experience will be an added advantage.
• Expertise in dashboard and report development using visualization tools such as Tableau, PowerBI or MicroStrategy
• Experience in developing production systems incorporating best-in-class software engineering practices such as DevOps, CI/CD, and automation technologies
• Working knowledge of Hadoop ecosystem and associated technologies, e.g., Hive, Apache Spark, MLlib, GraphX, sci-kit, and Pandas
• Minimum Bachelor’s degree Computer Science, Data Science, Engineering or a related field
• Certification in Hadoop (Cloudera or Hortonworks) and Apache Spark preferred

Business

• Results oriented with strong analytical and problem-solving skills, with demonstrated intellectual and analytical rigor
• Good understanding of the Payments/Banking Industry and associated data assets used in enterprise reporting
• Team oriented, collaborative, diplomatic, and flexible style, with the ability to tailor data driven results to various audience levels
• Detail-oriented and able to ensure highest level of quality/rigor in reports & data analysis
• Proven skills in translating analytics output to actionable recommendations, and delivery
• Experience in presenting ideas and analysis to stakeholders
• Exhibit intellectual curiosity and strive to continually learn

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.