Psychometrician I

About the Team  

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. College Board’s Psychometrics provides its partners with measurement solutions that set the standard for quality, efficiency and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board’s mission of access and equity in Education.   

About the Opportunity   

You will hold a lead position in ensuring the psychometric integrity and impact of College Board’s ACCUPLACER and CLEP assessments — two nationally recognized programs that empower colleges to make informed placement and credit-granting decisions. This is an exciting opportunity to drive high-impact work at the intersection of data, innovation, and education. In this role, you won’t just support these assessments—you’ll own the psychometric lifecycle. From designing and conducting statistical analyses to overseeing critical activities, your work will ensure these programs meet the highest standards of technical quality, fairness, and operational excellence. Your contributions will help evolve ACCUPLACER and CLEP to stay ahead of the curve—relevant, rigorous, and ready to meet the needs of higher education. You’ll play a central role in modernizing our systems by designing and implementing innovative tools and automation solutions that streamline workflows, boost scalability, and strengthen the entire assessment infrastructure. This role is ideal for someone who thrives at the intersection of research, technology, and applied psychometrics. 

In this role, you will:  

Operational Psychometrics (60%) 

• Design and execute routine psychometric analyses for CLEP and ACCUPLACER assessments, including but not limited to item calibration, pretest analysis, differential item functioning (DIF), and standard-setting studies, utilizing both standard and customized psychometric tools and statistical software packages. 

• Lead initiatives to refine and enhance operational processes to ensure rigor, efficiency, and scalability. 

• Integrate emerging technologies—including generative AI and machine learning approaches—into psychometric workflows to address complex measurement challenges and improve operational effectiveness. 

• Independently develop, document, and implement statistical analysis of code and reporting systems for internal and external stakeholders. 

• Prepare and oversee the production of high-quality technical reports, ensuring that findings are communicated clearly, accurately, and in alignment with College Board standards. 

• Conduct comprehensive quality assurance and control procedures independently, with a focus on identifying and implementing improvements to optimize accuracy and efficiency. 

Psychometric Research (30%) 

• Conduct independent and collaborative research in alignment with the program’s strategic research agenda and the broader goals of the Psychometrics division. 

• Investigate and apply innovative methodologies and technologies to improve assessment design, analysis, and interpretation—particularly in the context of AI and machine learning. 

• Develop and deliver presentations to internal and external audiences, communicating research findings and practical implications. 

• Serve as first author and lead presenter at major national conferences in the field of educational measurement.  

• Contribute to scholarly publications as a named author in peer-reviewed academic journals. 

Collaboration and Partnerships (10%) 

• Serve as a representative of the psychometric integrity and credibility of CLEP and ACCUPLACER assessments in interactions with internal teams and external partners. 

• Provide expert consultation and support to other College Board divisions and external researchers, particularly in the context of product development, innovation, and research initiatives. 

About You  

You have:  

• A Doctorate in Psychometrics, educational measurement or a related field  

• At least three years of post-PhD experience in the field of psychometrics 

• Experience in an operational setting with item adaptive testing, item response theory, classical test theory, equating, item and test analyses, DIF, automated test assembly (ATA), standard setting, and other psychometric analyses are required 

• Operational experience with multiple statistical analysis tools (e.g., Python, R, SAS, flexMIRT, and GENOVA) 

• Demonstrated ability to conduct in-person or remote standard setting studies  

• Demonstrated ability to leverage advanced technologies, such as GenAI or machine learning models, to improve operational efficiency 

• Ability to quickly and accurately work with new datasets and assessment data.  

• Excellent oral and written communication skills, including technical presentation, public speaking, interpersonal, and writing and editing skills  

• Strong problem-solving skills 

• The ability to travel 2-4 times a year to College Board offices or on behalf of College Board business 

• Authorization to work in the United States 

About Our Process   

• Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days. 

• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.    

What We Offer 

At College Board, we offer more than just a paycheck—we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation, grounded in your qualifications, experience, impact, and the market. 

A Thoughtful Approach to Compensation 

• The hiring range for this role is $96,000-145,000.00 

• Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board. 

• We aim to make our best offer upfront—rooted in fairness, transparency, and market data. 

• We adjust salaries by location to ensure fairness, no matter where you live. 

You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Check out our careers page for more. 

LI-GG1

LI-#REMOTE