Associate Director- Platforms Data Quality (Ataccama)

Hyderabad (Office)

Novartis

Working together, we can reimagine medicine to improve and extend people’s lives.

View all jobs at Novartis

Apply now Apply later

Job Description Summary

Location: Hyderabad

In this role you will be responsible for connecting with multiple stakeholders, developing new DQ pipelines in Ataccama, migration of legacy DQ jobs in Ataccama.


 

Job Description

Major Accountabilities

  • Drive planning, design, development and delivery of system solutions for a specific business or technology area, in alignment with design and architectural standards and business requirements.

  • Support scoping, fit-gap workshops for projects/enhancements, propose solutions for key gaps, provide effort estimations and alignment with business teams.

  • Good understanding on Data Quality concepts and end to end implementation of Data Quality life cycle. Proficiency in Data Base concepts, writing complex SQL queries and performance tuning. Experience in developing products and understanding of product management philosophy.

  • Fair knowledge of DQ in Big Data space with good understanding of cloud computing and Data Lake, especially AWS tech stack (S3, Snowflake, Databricks, Glue Data Catalog, Unity Data Catalog etc.,).

  • Experience to work on AWS data lakes to store and process both structured and unstructured data sets. Good understanding of larger data management and data governance space will be an added advantage. Ensure that project/enhancements work is delivered to agreed time, cost and quality constraints following the release calendars.

  • Create robust data engineering pipelines using Python, Databricks, Spark to ingest, process, and transform data, ensuring it is ready for analytics and reporting. Be proficient in writing scripting or programming language to handle large volume of data processing. Adopt DevOps methodologies and tools for continuous integration and deployment (CI/CD) and automate to enhance data engineering processes.

  • Take complete accountability and ownership of large data quality projects with limited guidance. Contribute to development of best practices for Data Engineering and Data Quality space.

  • Provide guidance and mentorship juniors and team members by sharing best practices and knowledge. Ensure adherence to stringent Data Security and Access Control policies of Novartis while deploying and delivering a data quality solution. Ability to work in Agile develop methodology.

Minimum Requirements

  • Bachelor's degree or related field 15+ years exp

  • Exposure to software engineering principles and hands on experience in Ataccama, DQ tools, Databricks, Python, Spark, Pyspark and DevOps tools.

  • Excellent problem solving, communication, and organizational skills.

  • Advanced SQL skills and experience with relational Database concepts and performance tuning.

  • Strong understanding of Data Integration patterns, Data Modelling and Visualization concepts.

  • Proficiency in at least one programming language, such as JAVA, Python, Spark, PySpark.

  • Experience with cloud platforms such as AWS or Azure, Docker & Kubernetes.

Why consider Novartis?

Our purpose is to reimagine medicine to improve and extend people’s lives and our vision is to become the most valued and trusted medicines company in the world. How can we achieve this? With our people. It is our associates that drive us each day to reach our ambitions. Be a part of this mission and join us!
Learn more here:

https://www.novartis.com/about/strategy/people-and-culture

Commitment to Diversity and Inclusion:
Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.
Join our Novartis Network: If this role is not suitable to your experience or career goals but you wish to stay connected to hear more about Novartis and our career opportunities, join the Novartis Network here:
https://talentnetwork.novartis.com/network


 

Skills Desired

Agile Project Management, Business Partnering, Change Management, IT Service Delivery, Performance Management
Apply now Apply later
  • Share this job via
  • 𝕏
  • or

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Agile AWS Azure Big Data CI/CD Databricks Data governance Data management Data quality DevOps Docker Engineering Java Kubernetes Pipelines PySpark Python RDBMS Security Snowflake Spark SQL Unstructured data

Perks/benefits: Career development

Region: Asia/Pacific
Country: India

More jobs like this