Azure Data Engineer - Consultant
Bangalore, Karnataka, India
KPMG India
KPMG is a global network of professional firms providing Audit, Tax and Advisory services.- Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 5 years work experience).
- At least 2+ years of consulting or client service delivery experience on Azure
- At least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Azure Synapse
- Extensive experience providing practical direction with using Azure Native services.
- Extensive hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Azure Logic App Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Cosmo DB etc.
- Minimum of 2+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, PySpark and SparkSQL, Databricks, HD Insight and live streaming technologies such as EventHub, Azure Stream Analytics etc.
- Well versed in DevSecOps and CI/CD deployments
- Cloud migration methodologies and processes including tools like Azure Data Factory, Data Migration Service, etc.
- Minimum of 2+ years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques.
- Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.
- Experience with private and public cloud architectures, pros/cons, and migration considerations.
Primary Roles and Responsibilities
An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.
Preferred Skills
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure Cloud
- Familiarity with the Azure Purview for metadata management, Data Governance, Data Lineage, Data Catalog etc.
- Knowledge of Azure RBAC and IAM. Understanding access controls and security on Azure Cloud.
- Inclined with Microsoft vision and road map around latest tools and technologies in market.
- Knowledge on Microsoft Fabric, Microsoft Co-pilot, Gen AI fundamentals and industry supporting use cases.
- Microsoft certification’s role based. (DP600, DP203,DP900, AI102, AI900..)
- Microsoft Powerbi hands on and working knowledge, to create reports/dashboards and generate insights for business users.
- Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 5 years work experience).
- At least 2+ years of consulting or client service delivery experience on Azure
- At least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Azure Synapse
- Extensive experience providing practical direction with using Azure Native services.
- Extensive hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Azure Logic App Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Cosmo DB etc.
- Minimum of 2+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, PySpark and SparkSQL, Databricks, HD Insight and live streaming technologies such as EventHub, Azure Stream Analytics etc.
- Well versed in DevSecOps and CI/CD deployments
- Cloud migration methodologies and processes including tools like Azure Data Factory, Data Migration Service, etc.
- Minimum of 2+ years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques.
- Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.
- Experience with private and public cloud architectures, pros/cons, and migration considerations.
Primary Roles and Responsibilities
An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.
Preferred Skills
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure Cloud
- Familiarity with the Azure Purview for metadata management, Data Governance, Data Lineage, Data Catalog etc.
- Knowledge of Azure RBAC and IAM. Understanding access controls and security on Azure Cloud.
- Inclined with Microsoft vision and road map around latest tools and technologies in market.
- Knowledge on Microsoft Fabric, Microsoft Co-pilot, Gen AI fundamentals and industry supporting use cases.
- Microsoft certification’s role based. (DP600, DP203,DP900, AI102, AI900..)
- Microsoft Powerbi hands on and working knowledge, to create reports/dashboards and generate insights for business users.
- Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 5 years work experience).
- At least 2+ years of consulting or client service delivery experience on Azure
- At least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Azure Synapse
- Extensive experience providing practical direction with using Azure Native services.
- Extensive hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Azure Logic App Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Cosmo DB etc.
- Minimum of 2+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, PySpark and SparkSQL, Databricks, HD Insight and live streaming technologies such as EventHub, Azure Stream Analytics etc.
- Well versed in DevSecOps and CI/CD deployments
- Cloud migration methodologies and processes including tools like Azure Data Factory, Data Migration Service, etc.
- Minimum of 2+ years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques.
- Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.
- Experience with private and public cloud architectures, pros/cons, and migration considerations.
Primary Roles and Responsibilities
An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.
Preferred Skills
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure Cloud
- Familiarity with the Azure Purview for metadata management, Data Governance, Data Lineage, Data Catalog etc.
- Knowledge of Azure RBAC and IAM. Understanding access controls and security on Azure Cloud.
- Inclined with Microsoft vision and road map around latest tools and technologies in market.
- Knowledge on Microsoft Fabric, Microsoft Co-pilot, Gen AI fundamentals and industry supporting use cases.
- Microsoft certification’s role based. (DP600, DP203,DP900, AI102, AI900..)
- Microsoft Powerbi hands on and working knowledge, to create reports/dashboards and generate insights for business users.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Azure Big Data CI/CD Computer Science Consulting Databricks Data governance Data pipelines Data warehouse DevOps ETL Generative AI Git Java Jenkins Pipelines Power BI Privacy PySpark Python RDBMS Security SQL Streaming
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.