Associate Consultant - Data Engineer
Bangalore, Karnataka, India
We are seeking a highly-skilled and experienced Junior Azure Data Engineer to join our Tax Technology and Innovation team. This role involves utilising data engineering technologies to automate and optimise complete tax processes. The successful candidate will be responsible for the design, development, and maintenance of Azure data platforms for both our internal team and client engagements.
Responsibilities:
- Design, build, and maintain Azure data services for internal and client platforms, including Azure SQL Database, Azure Data Lake, Data Factory, Stream Analytics, Azure Analysis Services, Azure Databricks, and MS Fabric.
- Develop and implement ETL processes, data pipelines, and data integration solutions in PySpark clusters.
- Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
- Collaborate with the team to design optimised data models for traditional warehouses as well as the latest delta lakes.
- Ensure data security, compliance, and best practices are always maintained.
- Optimise system performance, ensuring the fastest possible data retrieval and efficient data updates.
- Keep up-to-date with emerging database technologies and trends.
Requirements:
- Bachelor's degree in Computer Science, Information Systems, or a related field. A Master's degree is preferred.
- Proven work experience as a Data Engineer or similar role.
- Expertise in Azure data services and tools, including Azure Databricks and MS Fabric.
- Proficiency in PySpark and experience with other programming languages (SQL, Python, Java).
- Experience in designing optimised data models in traditional warehouses and delta lakes.
- Strong analytical skills and the ability to create useful data insights and visualisation.
- Excellent problem-solving and communication skills.
- Knowledge of other cloud platforms is a plus.
- Certifications in Azure Data Engineering or related fields would be a plus.
We are seeking a highly-skilled and experienced Junior Azure Data Engineer to join our Tax Technology and Innovation team. This role involves utilising data engineering technologies to automate and optimise complete tax processes. The successful candidate will be responsible for the design, development, and maintenance of Azure data platforms for both our internal team and client engagements.
Responsibilities:
- Design, build, and maintain Azure data services for internal and client platforms, including Azure SQL Database, Azure Data Lake, Data Factory, Stream Analytics, Azure Analysis Services, Azure Databricks, and MS Fabric.
- Develop and implement ETL processes, data pipelines, and data integration solutions in PySpark clusters.
- Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
- Collaborate with the team to design optimised data models for traditional warehouses as well as the latest delta lakes.
- Ensure data security, compliance, and best practices are always maintained.
- Optimise system performance, ensuring the fastest possible data retrieval and efficient data updates.
- Keep up-to-date with emerging database technologies and trends.
Requirements:
- Bachelor's degree in Computer Science, Information Systems, or a related field. A Master's degree is preferred.
- Proven work experience as a Data Engineer or similar role.
- Expertise in Azure data services and tools, including Azure Databricks and MS Fabric.
- Proficiency in PySpark and experience with other programming languages (SQL, Python, Java).
- Experience in designing optimised data models in traditional warehouses and delta lakes.
- Strong analytical skills and the ability to create useful data insights and visualisation.
- Excellent problem-solving and communication skills.
- Knowledge of other cloud platforms is a plus.
- Certifications in Azure Data Engineering or related fields would be a plus.
Experience & Background
_ Graduate/Post-Graduate qualification B.Tech./BCA/MBA/M-Tech/MCA
_ Relevant experience for 8+ years
_ Excellent Communication Skills
_ Excellent Presentation Skills
_ Any exposure to Tax Technologies a definite positive.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure Computer Science Databricks Data pipelines Engineering ETL Java Pipelines PySpark Python Security SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.