Lead Consultant
INDIA - NOIDA- BIRLASOFT OFFICE, IN
Applications have closed
Birlasoft
At Birlasoft we combine the power of domain, enterprise, and digital technologies to reimagine business potential. Surpassing expectations, breaking convention!Azure Data Engineer with Databricks and PySpark
Job Description:
Years of experience 8 to 10 Years – 5B – Sr Tech Lead
- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)
- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
- Experience in creating Technical Specification Design, Application Interface Design.
- Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark
- Develop batch processing and integration solutions and process Structured and Non-Structured Data
- Demonstrated in-depth skills with Azure Databricks and PySpark, and SQL
- Collaborate and engage with BI & analytics and the business team.
- Minimum 3 year of Project experience in Azure Databricks
- Minimum 5 years of experience in ADF
- Minimum 2+ years of experience in PySpark
- Overall ETL experience should be 6+ years including DWH
- Good to have knowledge on Agile methodology and framework
- Good Communication and attitude to scale up
- Good Team Player
Location: Mumbai, Pune, Noida
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Categories:
Consulting Jobs
Leadership Jobs
Tags: Agile Azure Databricks Data pipelines Data warehouse ETL Pipelines PySpark SQL
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Sr. Data Engineer jobsBusiness Intelligence Developer jobsPrincipal Data Engineer jobsBI Developer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsPrincipal Software Engineer jobsJunior Data Analyst jobsData Science Intern jobsDevOps Engineer jobsData Science Manager jobsSoftware Engineer II jobsData Manager jobsLead Data Analyst jobsData Analyst Intern jobsStaff Software Engineer jobsAccount Executive jobsBusiness Data Analyst jobsAI/ML Engineer jobsSr. Data Scientist jobsData Specialist jobsData Governance Analyst jobsSenior Backend Engineer jobsData Engineer III jobsBusiness Intelligence Analyst jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsEconomics jobsLinux jobsKPIs jobsKafka jobsTerraform jobsGitHub jobsJavaScript jobsRDBMS jobsPostgreSQL jobsData Warehousing jobsClassification jobsNoSQL jobsStreaming jobsScikit-learn jobsBanking jobsComputer Vision jobsPrompt engineering jobsRAG jobsPhysics jobsGoogle Cloud jobsOracle jobs
Pandas jobsdbt jobsHadoop jobsScala jobsBigQuery jobsGPT jobsR&D jobsData warehouse jobsReact jobsLangChain jobsScrum jobsDistributed Systems jobsPySpark jobsLooker jobsMicroservices jobsIndustrial jobsELT jobsCX jobsSAS jobsJira jobsOpenAI jobsRedshift jobsModel training jobsRobotics jobsTypeScript jobs