HRT Analyst II

The quality of search results and AI generated responses is critical for the success of LexisNexis online products.  To help ensure that the quality of search and our generative AI solutions keep improving, we continuously evaluate the results of both search queries and prompts entered into our generative AI products.  We do this by having  subject matter experts evaluate the quality of our results/responses (Human Relevance Test or HRT).  

There are hundreds of these tests conducted each year.  To help manage and administer these tests, LexisNexis requires a Test Analyst.

The Test Analyst will be working closely with the leader of our Testing Program, who will help train the Test Analyst and direct activities.  

The Test Analyst role will be responsible for the timely set-up and smooth running of tests.  This includes managing the admin around the tests, working with internal engineers to help troubleshoot any issues, assisting with reporting, and serving as a point-of-contact for queries about the testing. This is a unique opportunity to work across a broad range of products and teams, and to have a significant impact on our customers’ search experience

Accountabilities:

• Setting up tests (using our internal testing tool) based on specification provided. Training will be provided.
• Checking and validating test configuration
• Trouble-shoot issues with test execution, liaising with internal engineers and search development teams as needed
• Maintenance of dashboards e.g. tracking test status and results

Qualifications:

• Bachelor’s Degree
• High attention to detail
• Intermediate to advanced Excel skills
• Willing to be trained and become expert in our internal search testing platform (STF)
• Willing to develop product and domain knowledge as needed to support test set-up and validation
• Good communication skills
• Knowledge/experience of agile development methodology a plus
• Experience in data visualization or reporting a plus
• Strong analytical skills
• QA experience highly desirable
• Ability to think independently and solve problems
• Highly flexible, able to quickly adapt to changing priorities and happy to jump in and take on additional tasks as needed

Additional requirements:

• We operate as an agile development team, with daily stand-ups; must be able to attend daily stand-ups US-based teams (little bit of UK and South Africa) at mid-shift (4AM-12NN EST)
• As a small team, we also all pitch in as and where needed to ensure the smooth flow of work. Flexibility is therefore essential!

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.