Data Engineer
Chennai, India
Guardian
We provide life insurance, disability insurance, dental insurance, and other benefits that help protect people and inspire their well-being.Job Description:
Qualifications:
We are seeking a highly skilled and motivated Data & Analytics Engineer to join the Enterprise Data & AI team. In this role, you will play a crucial part in designing, building, and maintaining the data pipelines that powers our predictive & descriptive use cases. Your expertise will help us transform raw data into actionable insights, ensuring that our data solutions are robust, scalable, and efficient. The ideal candidate will have a passion for data engineering, thrive in a collaborative environment and are excited about using cutting-edge technologies to drive business success.
You will
Design, build and maintain robust & scalable data pipelines to feed descriptive analytics, predictive analytics, and reporting use cases.
Work closely with business partners, data scientists & BI team to understand the business process, data needs and translate them into an effective data solution.
Construct meaningful data assets sourced from structured, semi structured, and unstructured data.
Ensure data quality, accuracy and integrity of the data assets created.
Automate the data pipelines end to end.
Participate in data modeling and schema design.
Collaborate with cross-functional teams to identify the right data sources for the use cases.
Perform data discovery and analysis on various data sources.
Find and tell the compelling narrative of the data that aligns to the intended audience.
Create and maintain Data Dictionary for the data pipelines.
Participate in code reviews and documentation efforts to maintain high-quality code and data documentation.
You have
Bachelor’s degree in STEM related field or equivalent.
4 + years of experience in Data Engineering or similar role.
Strong understanding of data engineering principles, best practices, and software development life cycle.
Proficiency in SQL, Python, PySpark and bash scripts.
Knowledge of Databricks.
Experience with the design and development of ETL/ELT process.
Experience working in a Datawarehouse.
Understanding of Data modeling and in particular Dimension modeling.
Experience in Alteryx is a plus.
Strong analytical and problem-solving skills.
Excellent communication and collaboration skills to work across multiple groups within the organization.
Location:
This position can be based in any of the following locations:
Chennai, GurgaonCurrent Guardian Colleagues: Please apply through the internal Jobs Hub in Workday
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Databricks Data pipelines Data quality ELT Engineering ETL Pipelines PySpark Python SDLC SQL STEM Unstructured data
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.