QA Automation Specialist
Bangalore-Affluence, India
Nasdaq
Get the latest stock market news, stock information & quotes, data analysis reports, as well as a general overview of the market landscape from Nasdaq.Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions, constantly aiming to rewrite tomorrow.
As a Test Automation Specialist (AI), you will play a key role in the delivery of complex technical systems of varying sizes to new and existing customers and will be part of discovering new technologies within the FinTech industry.
We are now looking for a Test Automation Specialist (AI) to strengthen the Engineering team in Bangalore. You will be responsible for testing and making test strategy and execution for AI based products within Investor Relations and Sustainable Lens Software Products .
We are looking for candidates who share those values along with a genuine desire and drive to deliver top technology solutions to today's markets.
With this position we offer
Join the engineering organization for Nasdaq Investor Relations and Sustainable Lens products. The main objective for the team in Bangalore is to build state of the art IR and ESG solutions for corporates. As our new member, you will work with a group of enthusiastic and experienced team members. Together with your team, you will be responsible for delivery of enhancements and supporting rearchitected of the enterprise product to new software paradigms.
Your role and responsibilities:
We are seeking a highly skilled Test Automation Specialist to join our AI product development team. The ideal candidate will have expertise in designing and implementing automated testing frameworks for sophisticated AI and machine learning systems.
Furthermore, you will:
We develop and maintain comprehensive automated test suites for generative AI models, including language models, and multimodal systems
We create innovative testing strategies to validate the quality, coherence, and safety of AI-generated content
We design and implement automation frameworks to test generative AI products across multiple platforms and use cases
We collaborate closely with AI researchers, data scientists, and product developers to understand product requirements and unique testing challenges of generative systems
We develop tools and scripts to generate diverse test data sets and simulate real-world generative AI scenarios
We implement automated tests for prompt engineering, fine-tuning processes, and model versioning
Continuously improve testing methodologies to keep pace with constantly evolving generative AI technologies
We analyze test results and provide detailed reports on model performance, potential biases, and areas for improvement
We expect you to have
Bachelor's or Master's degree or equivalent experience in Computer Science, AI/ML, or related technical field
5+ years of proven experience in software test automation, with at least 2 years focused on AI/ML systems, preferably generative AI
Strong programming skills in Python.
Expertise in test automation tools and frameworks suitable for AI testing tools/frameworks like RAGAS, Deep eval, TrueLens, AWS Bedrock Evaluator, pytest, Robot Framework.
Hands-on experience/knowledge of AI frameworks like Langchain or LlamaIndex.
In-depth understanding of natural language processing, computer vision, and generative AI concepts
Experience with large language models (e.g., GPT family, BERT)
Familiarity with prompt engineering and techniques for evaluating generative AI outputs
Knowledge of ethical AI principles and experience in testing for bias and fairness in AI systems
Education Qualification: Bachelor/Master or equivalent experience in computer science.
It would be great if you
Experience with cloud platforms (AWS) for AI deployment and testing at scale
Familiarity with containerization and orchestration tools (Docker, Kubernetes)
Knowledge of vector databases.
Does it sound like you? What happens now?
As the selection process is ongoing, please submit your application in English as soon as possible. We will get back to you in 2-3 weeks.
What will it be like working here?
Nasdaq is a vibrant and entrepreneurial company where everyone is encouraged to take initiative, challenge status quo, and take intelligent risks. We want everyone to feel welcome and bring their authentic self to work. Every day, we are building a culture where we all feel connected, supported and empowered. We are a Hybrid-first environment that embraces work-life balance and fosters well-being.
What do we offer you?
Annual monetary bonus.
An opportunity to become a Nasdaq shareholder
Employee Stock Purchase Program Nasdaq stocks with a discount
Health Insurance Program
Flexible working schedule and hybrid way of work
Flex day program (up to 6 paid days off a year)
Internal mentorship program – get a mentor or become one
Wide selection of online learning resources, e.g., Udemy
Come as you are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information or any other status protected by applicable law.
Nasdaq is a leading global provider of trading, clearing, exchange technology, listing, information, and public company services. As the creator of the world's first electronic stock market, its technology powers more than 100 marketplaces in 50 countries. Nasdaq is home to over 4,000 total listings with a market value of approximately $12 trillion.
To learn more, about our business visit business.nasdaq.com. Check out more about our Life at Nasdaq.
Come as You Are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS BERT Computer Science Computer Vision Docker Engineering FinTech Generative AI GPT Kubernetes LangChain LLMs Machine Learning NLP Prompt engineering Python Testing
Perks/benefits: Career development Equity / stock options Flex hours Health care Insurance Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.