Senior Consultant | Azure Databricks | Bengaluru | Engineering
Bengaluru, IN
Deloitte
Insights zu unseren Diensleistungen im Bereich Audit, Consulting, Financial Advisory, Risk Adivisory und Tax sowie unseren zahlreichen Industrien.Technology & Transformation
Engineering, Data and Analytics: Databricks
Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance.
As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed and realize your full potential.
Roles: Databricks Data Engineering – Consultant, Senior Consultant, Manager, Associate Director
We are seeking highly skilled Databricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Databricks platform. Your experience in data engineering, along with a deep understanding of Databricks, will be instrumental in building solutions to drive data-driven decision-making across a variety of customers.
Mandatory Skills: Databricks, Spark, Python / SQL
Responsibilities
· Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.
· Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices.
· Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions.
· Develop data models and schemas to support reporting and analytics needs.
· Ensure data quality, integrity, and security by implementing appropriate checks and controls.
· Monitor and optimize data processing performance, identifying, and resolving bottlenecks.
· Stay up to date with the latest advancements in data engineering and Databricks technologies.
Qualifications
· Bachelor’s or master’s degree in any field
· 2-6 years of experience in designing, implementing, and maintaining data solutions on Databricks
· Experience with at least one of the popular cloud platforms – Azure, AWS or GCP
· Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes
· Knowledge of data warehousing and data modelling concepts
· Experience with Python or SQL
· Experience with Delta Lake
· Understanding of DevOps principles and practices
· Excellent problem-solving and troubleshooting skills
· Strong communication and teamwork skills
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Databricks Data quality Data Warehousing DevOps ELT Engineering ETL GCP PySpark Python Security Spark SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.