Software Engineer SQA - AI/ML Products
Gurgaon, HR, IN
ā ļø We'll shut down after Aug 1st - try fooš¦ for all jobs in tech ā ļø
Boston Scientific
Boston Scientific is dedicated to transforming lives through innovative medical solutions that improve the health of patients around the world.Additional Locations:Ā India-Haryana, Gurgaon
Diversity - Innovation - Caring - Global Collaboration - Winning Spirit - High Performance
At Boston Scientific, weāll give you the opportunity to harness all thatās within you by working in teams of diverse and high-performing employees, tackling some of the most important health industry challenges. With access to the latest tools, information and training, weāll help you in advancing your skills and career. Here, youāll be supported in progressing ā whatever your ambitions.
Software Engineer SQA ā AI/ML Products
Join Boston Scientific at the forefront of innovation as we embrace AI to transform healthcare and deliver cuttingāedge solutions. We are seeking a Software Quality Assurance (SQA) Engineer who will champion the reliability and usability of AIādriven features, ensuring that machineālearning models and LLM pipelines deliver safe, accurate, and coherent outcomes.Ā
Ā
Your responsibilities will include:
- Develop and execute comprehensive test plans for AI/ML features including chatbots, recommendation engines, RAG search, and copilots.
- Design and maintain automation frameworks (Selenium, Cypress, Playwright, PyTest) for UI, API, and modelālevel testing.
- Implement evaluation harnesses using LangSmith, RAGAS, LangTest, and custom scripts to score relevance, hallucination, fairness, and toxicity.
- Validate RAG pipelines endātoāend: embeddings, retrieval quality, prompt integrity, and response grounding.
- Monitor postādeployment AI performance for drift, regression, and latency; partner with MLOps teams to triage incidents.
- Collaborate with product managers, data scientists, and engineers to define expected outcomes and edgeācase scenarios.
- Document test results, file defects, and drive rootācause analysis to closure.Ā
Ā
Required Qualifications:
- 6+ years of software quality assurance or testāautomation experience, including AI/ML products.
- Proficiency in Python or JavaScript and experience with RESTful API testing (Postman, Swagger).
- Handsāon with automation tools such as Selenium, Cypress, Playwright, or PyTest.
- Knowledge of LLM evaluation frameworks (LangSmith, RAGAS) and vector database APIs.Ā
- Strong foundation in QA processes: test planning, regression testing, CI/CD integration, and defect lifecycle management.Ā
Ā
Preferred Qualifications:
- Experience testing RAG or agentic AI workflows at scale.
- Familiarity with monitoring solutions for model drift and data drift (Vertex AI, Azure Monitor, Fiddler).
- Exposure to ethicalāAI or biasātesting methodologies.
- Background in healthcare or other regulated domains.Ā
Ā
Requisition ID:Ā 608453
Ā
As a leader in medical science for more than 40 years, we are committed to solving the challenges that matter most ā united by a deep caring for human life. Our mission to advance science for life is about transforming lives through innovative medical solutions that improve patient lives, create value for our customers, and support our employees and the communities in which we operate. Now more than ever, we have a responsibility to apply those values to everything we do ā as a global business and as a global corporate citizen.
Ā
So, choosing a career with Boston Scientific (NYSE: BSX) isnāt just business, itās personal. And if youāre a natural problem-solver with the imagination, determination, and spirit to make a meaningful difference to people worldwide, we encourage you to apply and look forward to connecting with you!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index š°
Tags: APIs Azure Chatbots CI/CD JavaScript LLMs Machine Learning MLOps Pipelines Playwright Python RAG Selenium Testing Vertex AI
Perks/benefits: Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.