Associate Data Engineer

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa Consulting & Analytics (VCA) team is a key part of the Global Solutions organization, a high-performing team of data engineer, scientists, data analysts and statisticians helping major organizations adapt and evolve to meet the changes taking place in technology, finance, and commerce, with cutting-edge, creative and advanced analytic solutions.

Visa is looking for Associate Data Engineer, who will be the responsible for contributing in data Engineering engagements with our partners and supporting end-to-end delivery. 

He/She will be a member of VCA Data Engineering team in CEMEA region. The position will be based in Visa’s Bangalore office.

The individual will be accountable for supporting and driving the design, development and implementation of analytics-driven strategies as well as high-impact solutions for Visa clients.

RESPONSIBILITIES

·       Expert in bigdata technologies, responsible for both service delivery and operational excellence of services built using Hadoop technologies.

·       Exhibit a robust comprehension of data interpretation and employ suitable visualization methods to provide actionable insights.

·       Design, develop, and uphold relational databases for storing data and conducting data mining. Carry out datawarehouse design and testing, including data design, database architecture, metadata, and repository creation to facilitate dashboard/report development.

·       Execute processes for extracting, transforming, and loading (ETL) data from diverse sources into a centralized data warehouse/data lake to organize data for efficient retrieval and improved quality.

·       Gather, analyze, transform, and interpret raw data from various sources. Design and develop BI solutions, data models, and KPI measures.

·       Create and maintain interactive dashboards and reports using BI tools such as Tableau, Power BI, Apache Superstore, and utilize visual elements like charts, graphs, maps, and visual design principles.

·       Adhere to quality assurance standards and best practices, demonstrate proficiency in different testing methodologies and tools, and debugging. Lead bug triage by identifying, documenting, and prioritizing system bugs based on their business impact.

·       Enhance dashboard performance by improving data processing speeds, query performance, and refining data models to ensure efficient, reliable, and timely data retrieval and analysis for BI applications.

·       Automate BI processes (e.g., data extraction, transformation, visualizations, testing, deployment) as much as possible. Conduct CI/CD activities by automating the integration, testing, and deployment of BI solutions, enabling quicker, reliable, and frequent updates to data pipelines, reports, and dashboards.

·       Safeguard data and BI solutions' security, implement data security measures, and comply with all relevant regulations and best practices.

·       Manage access controls, set up, and maintain the data visualization platform, ensuring the system's overall health and performance using usage reports.

·       Document all processes, methodologies, and instructions related to the BI solutions. Ensure documentation is up-to-date and accessible to relevant stakeholders.

·       Deploy the dashboard as per user requirements and company standards.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications
• A BS/BTech in Computer Science with 3+ years or 2+ years with Advance degree s professional experience as a Data Engineer or in a similar role.
Preferred Qualifications
• Possessing strong programming skills in one of the preferred languages Python.
• Experience in building scalable data pipelines using Spark/Hive with Airflow/Control M scheduler/executor frameworks.
• Expert-level skills in writing and optimizing complex SQL using Bigdata technologies such as Hive/Sqoop/Spark-SQL.
• Proficient in building resilient data-pipelines with complex data modelling using huge datasets in a BAU environment.
• Proficiency with Linux command line and systems administration.
• Proven ability to develop unconventional solutions. Sees opportunities to innovate and leads the way.
• Authoritative in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
• Experience with building applications to stream and process datasets at low latencies using Kafka.
• Proven ability to work well in a high performing team with agile development approaches and technology.
• Proven ability to work well in a high performing team with agile development approaches and technology.
• Familiar with Docker and containerization practices, which are key for ensuring the reproducibility and scalability of data processing workflows and for deploying solutions across various environments.
• Experience in data visualization tools such as Tableau, Power BI, QlikView, looker, D3.js is a plus.
• Certification in domain of Data warehouse / ETL or cloud or Visualization is a plus.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.