Data Engineer- Azure - Senior Associate

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Associate

Job Description & Summary

A career in our Advisory Acceleration Centre is the natural extension of PwC’s leading class global delivery capabilities. We provide premium, cost effective, high quality services that support process quality and delivery capability in support for client engagements.

Job Level - Data Engineer- Azure -

Exp - 4+ yrs

Must Have:

• 4+  years of experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight,  Azure Analysis services

• Should be aware of Data Management concepts and Data Modelling

• Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory

• Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc.

• Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory

• Should have clear understanding of DW lifecycle and contributed in preparing 

  •  Detail Level Design document

  •  Unit Test plans

  •  Code review reports

• Must have strong sql, understand joins, groups, functions & Stored procedures

• Must have experience  in Unit and Integration Test creation and verification

• Proficient in creating documentation related to Project Architecture, Project end User Manual and Operations Hand off guide

• Should have good understanding of Data Migration processes, methods and project lifecycle

• Good in Unix Shell Scripting skills

• Strong analytical skills and troubleshooting skills

• Should be well versed with quality processes and implementation

• Excellent communication skills

• Strong understanding of Cloud data migration processes, methods and project lifecycle

• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit

● 4+ years of experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
● Should be aware of Data Management concepts and Data Modelling
● Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory
●
● Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data
appliances, RDBMS, etc.
● Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory
● Should have clear understanding of DW lifecycle and contributed in preparing
○ Detail Level Design document
○ Unit Test plans
○ Code review reports
● Must have strong sql, understand joins, groups, functions & Stored procedures
● Must have experience in Unit and Integration Test creation and verification
● Proficient in creating documentation related to Project Architecture, Project end User Manual and Operations Hand off guide

● Should have good understanding of Data Migration processes, methods and project lifecycle
● Good in Unix Shell Scripting skills
● Strong analytical skills and troubleshooting skills
● Should be well versed with quality processes and implementation
● Excellent communication skills
● Strong understanding of Cloud data migration processes, methods and project lifecycle
● Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in
source code management like Code Pipeline, Code Build and Code Commit

Desired Knowledge / Skills:
● Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming
● Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2O
● Experience in Azure functions
● Knowledge in Python

Professional and Educational Background:
● BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

No

Government Clearance Required?

No

Job Posting End Date