Sr. Quality Assurance Analyst

The Senior Data Quality Assurance Analyst represents the business to ensure applications meet business requirements and are free of major defects.  This role is involved in all aspects of product development, identifies risks and creates mitigation plans.  The Senior Analyst assists in evolving formal quality processes & best practices, coordinating and mentoring team members, reporting status, and implementing test automation in existing frameworks.

The main focus will be on testing Large Language Model (LLM) chatbot for document retrieval, along with other software projects including Machine Learning (ML) and Data Analytics/Data Warehouse applications.

Basic Qualifications Required - Experience, Skills, and Knowledge

• Bachelor of Science in a related field or equivalent work experience
• 3 years of test strategy and IT QA Experience
• Experience with programming languages or as a software developer
• Knowledge of LLM, RAG, and ML concepts
• Experience with test automation tools (Selenium, Pytest, etc.)
• Experience with data repositories/data warehouse
• Strong SQL, proven experience working with large volume of data required, MS SQL Server preferred
• Experience with SDLC in Enterprise applications

Preferred Experience, Skills, and Knowledge

• Experience testing LLM chatbot/RAG, NLP, GenAI, or Machine Learning (ML)
• Experience with test automation framework
• Experience with Python. R/Scala/C++/Java helpful
• Experience with API testing, Prompt Engineering
• Experience with Azure Databricks/Data Factory/DevOps, SSIS, web services
• Familiar with on-premise and cloud infrastructures, MS SQL Server and Azure preferred
• Experience with Data Lake, Data Lakehouse, Data Pipelines
• Familiar with MS Fabric, Unity Catalog, medallion lakehouse architecture
• Familiar with Machine Learning development Lifecycle
• Knowledge of MLOps, LLMOps, PlatformOps
• Experience as QA team lead