Lead/Senior Data Engineer
Noida, Uttar Pradesh
ShyftLabs
ShyftLabs is not just a software company; we're your partners in propelling digital transformation at unprecedented speed. As experts, we specialize in crafting end-to-end solutions through our collaborative approach. With a deep-rooted...Job Responsibilities:
- Lead the data strategy, and own the vision and roadmap of data products to enable decision making and self-service for business and analytics teams
- Solid experience in emerging and traditional data stack components such as: batch and real time data ingestion, ETL, ELT, orchestration tools, on-prem and cloud DW, Python, structured, semi and unstructured databases.
- Collaborate closely with the Data Engineering and Product team to execute on the set roadmap of data ingestion, integration and data transformation.
- Work cross-functionally with enterprise-wide stakeholders including (but not limited to) Analytics, Data Science, FP&A, Accounting, merchandising, pricing teams.
- Build a continuous monitoring process and tools to track the data management, data quality, and execute cleaning activities.
- Track the overall data transformation initiative and provide feedback or suggestions from a risk management perspective.
- Design, provide training and mentor/coach other team members.
- Work with stakeholders to ensure that data related business requirements for protecting sensitive data are clearly defined, communicated, and well understood and considered as part of operational prioritization and planning
- Ensure the safe storage and transmission of data in line with privacy and compliance laws, data regulations, and internal company policies
- An ideal candidate will possess strong problem solving and conceptual thinking abilities in addition to communication, interpersonal and leadership skills.
Basic Qualifications:
- Bachelor’s or Advanced degree in Information Systems, Information Management, Engineering, or related field
- 7+ years of experience in data management, data warehousing and handling data engineering
- 3+ years of experience in Lead role managing set of engineers including hiring and performance evaluations.
- 5+ years of Experience in SQL and Snowflake
- 3+ years experience on Python
- 2+ years of experience in retail domain
- 3+ years managing big data technology stack and restful APIs.
- Good hands-on experience in Airflow and DBT
- Good hands on experience in ETL/ELT
- Experience with AWS Tools and Technologies (Redshift, S3, EC2, Glue)
- Expertise with Data modeling skills, Advanced SQL with Oracle, MySQL, and Columnar Databases
- Strong knowledge of designing data pipelines and understanding details around orchestration, integration, data transformations.
- Excellent communication skills, both verbal and written, and the ability to build trust-based relationships with business partners
- Technical knowledge in BI tools such as MicroStrategy, Looker.
- Proven record of handling, managing, collaborating and delivering data products on time and meeting quality standards.
- Competencies
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs AWS Big Data Data management Data pipelines Data quality Data strategy Data Warehousing dbt EC2 ELT Engineering ETL Looker MySQL Oracle Pipelines Privacy Python Redshift Snowflake SQL
Perks/benefits: Career development Competitive pay
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.