Data Engineer (Hive, Hadoop, ETL, MS SQL, Python/Java, 1-3 years)

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Verifi a Visa entity operates a network enabling data sharing among Acquirers, Merchants & Issuers for fraud prevention, dispute prevention and revenue recovery. Below are the key product solutions which are managed by this technology team 

Intelligence Suite - Risk management platform that allows merchant to customize services to protect their business, gain greater customer insights and seamlessly keep pace with emerging fraud threats

The Verifi reporting and analytics team is responsible for all facets of architecture, software development and production support of data pipelines, ETL process, reporting and analytics system.

The reporting and analytics team support Visa's Business users in Billing, Client Services, Issuer Processing and Global Contact Center Teams in providing access to data and insights from multiple applications.

As a Data Engineer supporting reporting and analytics group, you will be responsible for designing, developing and implementing Data integration and Analytics solutions on relational databases (MS SQL Server) using Wherescape Red ETL tool to enable self-service reporting. Based on deep understanding and knowledge of ETL and data engineering techniques, you will develop and maintain data and tools to provide self-service to Business users. Your ability to work across functions and teams will allow you to drive results and foster the right culture and environment to achieve Engineering Excellence and Innovation.

Essential Functions:

Support Data warehouse Engineering in the architecture, development, and employment of MS SQL Database on LUW in high SLA environments.

Solid understanding on data model for facts and dimensions. Ability to provide logical and physical design for the given business requirements.

Design scalable data warehouse solution using SQL Server and Hadoop.

Engage in proof of concepts on new SQL Server features and advocate the business benefits to the leadership team.

Provide data warehouse engineering for off the shelf and external merchant facing applications.

Implementation of databases, storage structures, high-availability solutions, replication, encryption, and disaster recovery solutions.

Follow the industry best practice in writing TSQL code and unit test cases.

Proactive performance analysis, troubleshooting and resolution of database issues.

Work very closely with the application team and DBA team to ensure delivery of database services within the SLA's and performance target set.

Integrate the DWH code with the Redgate for the automated deployment.

Support P1/P2 database issues which impacts the customer applications.

Manage, support, and maintain database technology and infrastructure, adhering to the architectural guidelines and policies.

Address vulnerabilities and TSR findings reported by the DBA team.

Ability to work well as a team and as an individual with minimal supervision.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications
•1 - 3 years of work experience with a Bachelor’s Degree or Master's Degree in computer / information science with relevant work experience in IT industry

• We need enthusiastic, energetic and self-learning candidates with loads of curiosity and flexibility.

• Proven hands-on capability on development of data pipelines / Data engineering.

• Basic level Experience in creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop, Hive, Spark, MongoDB, NoSQL, as well as traditional data technologies (RDBMS).

• Experience / knowledge developing large scale, enterprise class distributed pipelines that require high availability, low latency & strong data consistency computing is desirable

• Ability to program in one or more scripting languages such as Python and one or more programming languages such as Java or Scala

• Design and development skills with Big Data technologies like Hadoop, Spark, Hive.

• Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git desirable

• Demonstrated knowledge in POC's and prototypes using Gen AI / ML is an advantage.

• Extensive experience in implementing SQL Server 2017, SQL 2019, and MySQL 8.0 features.
• Experience in writing complex SQL queries is required.
• Hands on experience in Wherescape RED or equivalent ETL tool.
• Experience in providing data analysis and data validation is required
• Experience in scripting, scheduling and version control technologies is required
• Good understanding of the high availability and disaster recovery options. Expert in SQL Server native replication.
• Experience with tools development, automation (CI/CD, Auto Deployment with Redgate, System Availability, etc.).
• Extended experience in Agile Release Management practices, governance, and planning.
• Ability to quickly identify and manage/mitigate risks.
• Ability to influence Senior Leadership on direction of engineering efficiencies and integration management through data, roadmaps, short/long term plans, etc.
• Strong ability to build and sustain working and strategic relationships across technology.
• Strong leadership skills with demonstrated ability to lead global, cross-functional teams.
• Strong analytical and problem-solving skills.
• Ability to maintain composure under pressure and tight deadlines.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.