Senior Engineer - IT (ETL)

Job Description:

Qualifications:

Competencies/Skills: Individual Contributor

· 4+ years of hands-on and good experience in Hive Query Language, SQL, Python, PySpark & SparkSQL

· 4+ years’ experience in performance tuning of report under high data volumes

· 4+ years’ experience in performance tuning of HQL queries

· 4+ years’ experience in writing SparkSQL queries

· Knowledge of tuning HQL and aware of indexes, partitioning, bucketing concepts on Hive tables

· Knowledge of tools, concepts and methodologies of BI/DWH

. Knowledge of Databricks is preferred

· Knowledge of Agile Methodology/ SAFe Practices

· Ability to understand the domain and communicate with client/business

· Self-motivated and ability to work on his/her individual capacity

· Ability to identify automation opportunities and implement automation

· Ability to problem solve and do root cause analysis

· Knowledge of debugging complex queries and improving their performance 

· Knowledge of reverse engineering and documentation 

· Good understanding of various data models, both relational and dimensional and their associated principles.

· Responsible for proof-of-concept of new approaches and ideas & technology evaluation.

· Good data analytical skills 

Education and Experience:

Education: B.Tech Computers/MCA

Experience: 4 to 6 years in development projects with BI/ DWH background.

Summary-

The major responsibility of this role is to do BI & DWH project implementations using Hive Query Language, PySpark & SparkSQL. He/she is responsible for understanding business requirement and do the development. Candidate will be responsible for successful deployment and support of the code.

Life at Guardian: https://youtu.be/QEtkY6EkEuQ

Location:

This position can be based in any of the following locations:

Current Guardian Colleagues: Please apply through the internal Jobs Hub in Workday