Data Engineer - Sr. Consultant level - 11+ to 14 Yrs , Bigdata Developer , Kafka

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

You’ll be a senior contributor in our Data Engineering team, working across various projects to spot patterns in how we build our Snowflake Data Warehouse. You’ll help us minimise our cloud costs, drive best practices across all our Data Disciplines and scale and automate our data governance. 

Enable VXBS (Visa Cross-Border Solutions) to Make Better Decisions, Faster 

At the core of this mission sits our data platform. We’re great believers in powerful, real-time analytics and empowerment of the wider business. We optimise for simplicity and re-usability – all our data lives in one place and is made available via our data warehouse in Snowflake. 

What you’ll be working on: 

Working in a multi-disciplinary data engineering team, you will: 

• Support the building of robust data models downstream of backend services (mostly in Snowflake) that support internal reporting, financial and regulatory use cases. 

• Focus on optimisation of our Data Warehouse, spotting opportunities to reduce complexity and cost. 

• Help define and manage best practices for our Data Warehouse. This may include payload design of source data, logical data modelling, implementation, metadata, and testing standards. 

• Set standards and ways of working with data across VXBS, working collaboratively with others to make it happen. 

• Take established best practices and standards defined by the team and apply them within other areas of the business. 

• Investigate and effectively work with colleagues from other disciplines to monitor and improve data quality within the warehouse. 

• Contribute to prioritisation of data governance issues. 

​This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications:
8+ years of relevant work experience with a Bachelor’s Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD, OR 11+ years of relevant work experience.

You should Apply if 

You have experience and a passion for Data Modelling, ETL projects, and Big Data as a developer or engineer 

You have good experience in Python, Java or similar languages 

You have proven experience with AWS 

SQL and data modelling is second nature to you 

You are comfortable with general Data Warehousing concepts 

You strive for improvement in your work and that of others, proactively identifying issues and opportunities 

You have experience building robust and reliable data sets requiring a high level of control 

You have proven experience with stream technologies like Kafka, Kinesis, Pulsar, etc 

Preferred Qualifications:
9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD

Any experience working within a finance function or knowledge of accounting. 

Experience working in a highly regulated environment (e.g. finance, gaming, food, health care). 

Knowledge of regulatory reporting and treasury operations in retail banking 

Have previously used dbt, Databricks, or similar tooling 

Experience working with IaC tools such as Terraform, AWS CloudFormation, or Ansible 

Experience working with orchestration frameworks such as Airflow/Prefect 

Design and implementation knowledge of stream processing frameworks like Flink, Spark Streaming etc. 

Used to AGILE ways of working (Kanban, Scrum) 

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.