IN Director Core Databricks Architect Data and Analytics Advisory Mumbai

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Director

Job Description & Summary

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

Those in intelligent automation at PwC will focus on conducting process mining, designing next generation small- and large-scale automation solutions, and implementing intelligent process automation, robotic process automation and digital workflow solutions to help clients achieve operational efficiencies and reduce costs.

Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations.

Job Description & Summary: A career within Data and Analytics services will provide you with the opportunity to help organizations uncover enterprise insights and drive business results using smarter data analytics. As a Core Databricks Architect, you will lead the design and implementation of scalable, secure, and high-performance data platforms using Databricks-native capabilities. You will drive Lakehouse architecture adoption, optimize Spark workloads, and ensure governance, reliability, and innovation across enterprise data initiatives.

Responsibilities:

Key Responsibilities: · Architect and implement enterprise-grade Lakehouse solutions using Databricks-native tools (Delta Lake, Unity Catalog, DBSQL). · Define platform strategy including workspace setup, governance, access control, and multi-cloud deployment models. · Lead performance tuning of Spark jobs, cluster configurations, caching strategies, and workload orchestration. · Design and implement real-time and batch data pipelines using Structured Streaming and Spark APIs. · Establish best practices for CI/CD, job monitoring, alerting, and cost optimization within Databricks. · Collaborate with data scientists, ML engineers, and business stakeholders to operationalize models using Workflows. · Own platform reliability, SLAs, and incident response for Databricks-based services. · Guide integration with external systems via REST APIs, JDBC, and connectors (e.g., SAP, Kafka, Snowflake). · Mentor engineering teams and lead architecture reviews, POCs, and platform evangelism. · Stay current with Databricks roadmap and contribute to strategic platform decisions. Education: · Bachelor or higher degree in Computer Science, Engineering, Information Systems, or other quantitative fields. Experience: · 10+ years of experience in data engineering and architecture. · 5+ years of deep, hands-on experience with Databricks platform across multiple enterprise implementations. · Proven expertise in: o Delta Lake optimization, schema evolution, and time travel o Unity Catalog setup, RBAC, and data lineage o PySpark, Spark-SQL, Structured Streaming o Databricks Workflows and DBSQL for orchestration and analytics o CI/CD pipelines using GitHub Actions, Azure DevOps, or similar · Experience in platform governance, workspace isolation, and compliance (e.g., GDPR, HIPAA). · Strong stakeholder management and ability to influence technical and business leadership. Desirable Criteria · Experience with multi-cloud Databricks deployments (Azure, AWS, GCP). · Integration experience with SAP, Kafka, Snowflake, and enterprise APIs.

· Thought leadership in Lakehouse architecture—whitepapers, conferences, or community contributions. · Exposure to data mesh, data contracts, and modern data governance frameworks Key Behaviors · Empathetic: Cares about our people, our community and our planet · Curious: Seeks to explore and excel · Creative: Imagines the extraordinary · Inclusive: Brings out the best in each other

Mandatory skill sets:

‘Must have’ knowledge, skills and experiences Databricks (Delta Lake, Unity Catalog, DBSQL), PySpark, Spark-SQL, Structured Streaming, CI/CD, platform governance

Preferred skill sets:

‘Good to have’ knowledge, skills and experiences Multi-cloud Databricks, SAP integration, Kafka, Snowflake, REST APIs, data mesh principles

Years of experience required:

10+ years relevant experience

Education qualification:

BE, B.Tech, ME, M,Tech, MBA, MCA (60% above)

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: MBA (Master of Business Administration), Bachelor of Engineering, Bachelor of Technology

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Databricks Platform

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Agile Methodology, Analytical Thinking, Automation Algorithms, Automation Engineering, Automation Framework Design and Development, Automation Programming, Automation Solutions, Automation Studio, Automation System Efficiency, Blue Prism, Business Analysis, Business Performance Management, Business Process Analysis, Business Process Automation (BPA), Business Transformation, Business Value Optimization, C++ Programming Language, Coaching and Feedback, Cognitive Automation, Communication, Conducting Discovery, Configuration Management (CM) {+ 48 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date