Senior Data Engineer (Bangalore)
Bengaluru (Bangalore), Karnataka, India
Location: Bangalore (Hybrid)
We are seeking a Senior Data Engineer to join our team and leverage their expertise in Snowflake, dbt, and data transformation tools to build and maintain scalable data pipelines. You will be responsible for extracting, transforming, and loading (ETL) data from Microsoft SQL Server (MSSQL) into our Snowflake data warehouse, ensuring clean, reliable data for analysis and reporting.
WHAT YOU WILL DO
- Design, develop, and maintain data pipelines using Snowflake, dbt, or Coalesce.
- Write and optimize SQL queries within dbt for efficient data transformation in Snowflake.
- Utilize Coalesce or similar data transformation tools to migrate data from MSSQL to Snowflake.
- Cleanse, validate, and transform data to ensure accuracy and consistency.
- Design and implement data models in dbt to transform raw data into analytical-ready datasets.
- Automate data pipelines and ensure their reliability and scalability.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and translate them into technical solutions.
- Develop and implement unit tests for data pipelines and data models.
- Monitor and troubleshoot data pipelines for any issues.
- Document data pipelines and models for future reference.
WHO YOU ARE
- Bachelor's degree in Computer Science, Data Science, Statistics, or a related field
- 5-7 years of experience as a Data Engineer or similar role.
- Proven experience with Snowflake, including writing SQL queries and leveraging its functionalities.
- Expertise in dbt, including model development, testing, and deployment.
- Experience with Python language.
- Experience with data transformation tools like dbt, Coalesce, or Hevo Data.
- Strong understanding of data warehousing concepts and best practices.
- Experience with ETL/ELT processes.
- Experience with ClickHouse.
- Excellent SQL programming skills (T-SQL and Snowflake SQL).
- Experience with version control systems (e.g., Git).
- Familiarity with data quality concepts and techniques.
- Excellent communication and collaboration skills.
ADDITIONAL KNOWLEDGE/SKILLS/ABILITIES
- Experience with cloud platforms (e.g., AWS, Azure).
- Experience with data orchestration tools (e.g., Airflow, Luigi).
- Experience with data governance and security practices.
- Experience with Windows PowerShell, Linux Shell
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS Azure Computer Science Data governance Data pipelines Data quality Data warehouse Data Warehousing dbt ELT ETL Git Linux ML models MS SQL Pipelines Python Security Snowflake SQL Statistics Testing T-SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.