Lead Consultant

INDIA - NOIDA- BIRLASOFT OFFICE, IN

Full Time Senior-level / Expert USD 51K - 95K *

Birlasoft

At Birlasoft we combine the power of domain, enterprise, and digital technologies to reimagine business potential. Surpassing expectations, breaking convention!

View all jobs at Birlasoft

Apply now Apply later

Posted 4 hours ago

Azure Data Engineer with Databricks and PySpark

Job Description:

Years of experience 8 to 10 Years – 5B – Sr Tech Lead

Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)
Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
Experience in creating Technical Specification Design, Application Interface Design.
Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark
Develop batch processing and integration solutions and process Structured and Non-Structured Data
Demonstrated in-depth skills with Azure Databricks and PySpark, and SQL
Collaborate and engage with BI & analytics and the business team.
Minimum 3 year of Project experience in Azure Databricks
Minimum 5 years of experience in ADF
Minimum 2+ years of experience in PySpark
Overall ETL experience should be 6+ years including DWH
Good to have knowledge on Agile methodology and framework
Good Communication and attitude to scale up
Good Team Player