IN-Senior Associate Gen AI Automation Tester Emerging Technologies Advisory Bengaluru

Bengaluru Millenia

Full Time Mid-level / Intermediate USD 43K - 80K *

PwC

We are a community of solvers combining human ingenuity, experience and technology innovation to help organisations build trust and deliver sustained outcomes.

View all jobs at PwC

Apply now Apply later

Posted 2 hours ago

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Emerging Technologies

Management Level

Senior Associate

Job Description & Summary

At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to deliver innovative software products and solutions.

In emerging technology at PwC, you will focus on exploring and implementing cutting-edge technologies to drive innovation and transformation for clients. You will work in areas such as artificial intelligence, blockchain, and the internet of things (IoT).

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Job Description & Summary: A career in our New Technologies practice, within Application and Emerging Technology services, will provide you with a unique opportunity to help our clients identify and prioritize emerging technologies that can help solve their business problems. We help clients design approaches to integrate new technologies, skills, and processes so they can drive business results and innovation. Our team helps organizations to embrace emerging technologies to remain competitive and improve their business by solving complex questions. Our team focuses on identifying and prioritizing emerging technologies, breaking into new markets, and preparing clients to get the most out of their emerging technology investments.

Responsibilities:

Design, develop, and maintain automated test frameworks and scripts for chat interface applications
utilizing LLMs, ensuring comprehensive coverage of all functionalities and user scenarios.
Understand Retrieval Augmented Generation(RAG) strategy to improve testing for knowledge-
intensive tasks by retrieving relevant documents or data that can be used as references or benchmarks
for evaluating the LLM's responses
Evaluate chat interactions for adherence to conversational design principles, ensuring responses are
accurate, relevant, and delivered within acceptable time frames.
Perform thorough regression testing when bugs are resolved and when there are updates to LLMs or
application features.
Collaborate with development teams to understand application features and integration points for
Large Language Models, identifying potential areas for automation.
Execute automated and manual test cases, analyze test results, identify and document defects, and
work closely with developers to ensure they are addressed promptly.
Monitor the performance of LLMs in the chat interface, identifying any issues with latency, accuracy,
or relevance of responses.
Stay up-to-date with the latest developments in AI, machine learning, and chatbot technologies to
continually improve testing strategies and tools.
Collaborate with product managers and UX designers to ensure the chat application meets the highest
standards of user satisfaction and engagement.
Ensure compliance with data privacy and security policies during the testing process, especially when
handling sensitive user data.
Provide detailed reports and documentation on test activities, results, insights, and recommendations
for improving the application's quality and performance.
Tools Exposure Expected:.