Senior Data Engineer (5 years of experience in Hive SQL, PySpark, BI)

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

As a Data Engineer in Finance Technology DevOps team, this person will primarily work on Data & BI tool stack with exploration into AI/ML.  The candidate will participate in the development of Schematic Data Model & Business Intelligence services such cubes, reports, dashboards and visualization. He would play a pivotal role in researching and developing appropriate machine learning algorithms and AI models to solve complex problems. The candidate will additionally need to perform all activities within the Dev-Ops model not limited to design, development, testing, maintenance and support (Level 2).  Proven expertise in extending tools capabilities using APIs, SDK, and Web Customization is required.

Job Scope

This is an individual contributor role responsible for solving complex problems using wide ranging commercial and open-source tools. This role serves as a technical/functional specialist and works independently with guidance only in the most complex situations.

Responsibilities

• Collaborate with product manager, business partners and application platform teams to develop efficient and scalable reporting solutions.
• Participates in requirements elaboration sessions to ensure user needs are well understood and captured. 
• Build deep understanding of data and business (Revenue Apps) domain knowledge.
• Exhibit strong skills in data modeling. data warehouse concepts, data structures and building cube in multidimensional data model with proficiency on DAX scripting & high conceptual understanding of SQL scripting.
• Responsible for the design, development, testing, implementation and support functional semantic data marts using various modeling techniques from underlying data stores/data warehouse/data marts and facilitate Business Intelligence Data Solutions.
• Must demonstrate proficiency in administrating and maintaining the BI components involving OLAP & Reporting tools / components using Tableau/ Power BI.
• Assist as necessary with user acceptance testing of the reporting systems.
• Following Dev Ops Model, Agile implementation, CICD method of deployment & JIRA creation / management for projects.
• Assist owner with periodic evaluation of next generation & modernization of platform.  
• Exhibit Leadership Principles such as Accountability & Ownership of High Standards: Given the criticality & sensitivity of data . Customer Focus : Going Above & Beyond in finding innovative solution and product to best serve the business needs and there-by Visa.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs. 

Qualifications

Basic Qualifications:

• 5+ years of relevant work experience and a Bachelor's degree, OR 7+ years of relevant work experience

Preferred Qualifications:

• Bachelor's in Engineering, Analytics, Data Science, Statistics, Math or Business required.
• Understanding and familiarity of Datawarehouse concepts including Data Modeling, Data Warehouse structure, OLAP including BI suite of exposure to Data Analysis, Visualization Reporting & Storytelling.
• 5 or more years of hands-on experience in implementing End-to-End Business Intelligence suite, understanding / suggesting ETL strategy & influencing the data model decisions for reporting. 
• 5 or more years of hands-on experience with SAS / SQL / Hive / PySpark for extracting, aggregating & storing data leveraging from Big Data technologies like Hadoop, Spark, Scala, and MapReduce.
• 5 or more years of hands-on experience in OLAP (SSAS - Tabular) & Reporting (Tableau, Power BI or any BI etc.) with expertise in DAX, SQL / PLSQL scripting or any SQL variant.
• 3 or more years of hands-on experience on:
  • Developing sophisticated data visualizations using Tableau, Power BI or other viz tools.
  • Implementing Out-Of-the-Box capabilities within Tableau / PBI / SSAS using cmd / SDK / APIs.
  • Implementing build integration, test and deployment automation on above tools.
  • Implementing ETL layers with understanding E2E Data flow & SCD's concepts.
• Proven expertise in identifying the performance bottleneck in Tableau, SSAS and database components. Advice team on appropriate tuning techniques w.r.t SQL & DAX scripting.
• Expert in leading-edge areas such as Machine Learning, Deep Learning, Gen AI and MLOps is
• Hand-on experience implementing solutions using NLP, LLM & Predictive Model with understanding on specific area like xgboost, classification, neural networks etc. is good to have.
• Working knowledge in Data & BI administration (Yarn, Splunk, Profiler, Perfmon,  Security Architecture, User creation & Audit etc.) will be an added advantage.
• Understanding and familiarity of billing system and finance domain preferred.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.