Data Engineer-Python, SQL and Unix (Big data)
Bangalore, INDIA, India
Visa
Visa digitaalinen ja mobiilimaksuverkko on eturintamassa uusien maksujen, sähköisten ja kontaktivarojen maksutekniikan, jotka muodostavat rahan maailmanCompany Description
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.
Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.
Job Description
We are seeking a highly motivated and detail-oriented Entry Level Data Engineer to join our dynamic team. The ideal candidate will have a strong foundation in relational databases, SQL, and distributed systems concepts, with hands-on experience in Python and Apache Spark. As a Data Engineer, you will be responsible for building and maintaining scalable data pipelines, ensuring data integrity, and supporting data-driven decision-making processes for Platform Products Technology organization.
Key Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines to support various data processing and analytics needs.
- Implement and optimize SQL queries to extract, transform, and load (ETL) data from various data sources into our data warehouse.
- Work with relational databases to ensure data consistency, integrity, and performance.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.
- Develop and maintain data models and schemas to support business intelligence and reporting activities.
- Utilize distributed computing frameworks, such as Apache Spark, to process large datasets efficiently.
- Debug and troubleshoot data-related issues, ensuring data quality and reliability.
- Document data engineering processes, workflows, and best practices.
This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.
Qualifications
Basic Qualifications:
Bachelor's degree, OR 3+ years of relevant work experience
Preferred Qualifications:
Bachelor's degree, OR 3+ years of relevant work experience
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent practical experience).
Strong proficiency in SQL and experience working with relational databases (e.g., MySQL, PostgreSQL, SQL Server).
Solid understanding of distributed systems concepts, including parallel processing, data partitioning, and fault tolerance.
Hands-on experience with Python for data manipulation, scripting, and automation.
Practical experience with Apache Spark for distributed data processing.
Basic understanding of data warehousing concepts and ETL processes.
Excellent problem-solving skills and attention to detail.
Strong communication skills, with the ability to work effectively in a team-oriented environment.
Additional Information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Big Data Business Intelligence Computer Science Data pipelines Data quality Data warehouse Data Warehousing Distributed Systems Engineering ETL MySQL Pipelines PostgreSQL Python RDBMS Spark SQL
Perks/benefits: Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.