Senior Data Engineer

• Designed and developed end-to-end ETL data engineering pipeline Implemented Medallion architecture as the design pattern using Data Lakehouse with Delta Lake.

• Ingested and stored multi-source data into Azure Data Lake Storage (ADLS) Gen2, improving data accessibility.
• Processed and transformed raw data using Azure Data Factory, Azure Databricks, and Pyspark.
• Used Databricks as an analytics platform to transform and move data across layers by creating
  delta tables.
• Used Azure services such as Azure SQL, Azure Key Vault, and Azure Synapse Analytics.
• Integrated Azure DevOps for Cl/CD pipelines, automating the deployment and data engineering workflows.
• Collaborated with data scientists and analysts on data transformations and analytics.

Requirements

ETL Tools                   :        SSIS and Power Query, Azure Data Factory

Reporting Tool            :         Power BI, SSRS, Qlik

OLAP Tools                 :         SSAS and Azure SSAS

Database                   :         SQL Server 2016, SQL Server 2017, Azure SQL

Languages                 :         T-SQL, DAX, Power Query and U-SQL

Operating Systems    :         Windows 8.1 & Windows 10 and Windows Server. 

• 8+yrs of extensive experience in business intelligence applications design, development, and maintenance of SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS),

• Power BI Service, and SQL Server Analytical Services, Tabular Models, SQL Server.

• 2+ Years of experience in Python, Qlik, Azure Data Factory (ADF) Azure Synapse analytics, Azure Analysis Services.