Detail Page

Physical Review Physics Education Research
written by Trevor I. Smith and Nasrine Bendjilali
Several recent studies have employed item response theory (IRT) to rank incorrect responses to commonly used research-based multiple-choice assessments. These studies use Bock's nominal response model (NRM) for applying IRT to categorical (nondichotomous) data, but the response rankings only utilize half of the parameters estimated by the model. We present a mathematical argument for why this practice of using half of the NRM parameters when ranking responses is appropriate based on the primary question of multiple-choice tests: How can we use students' responses to test items to estimate their overall knowledge levels? We provide additional motivation for this practice by recognizing the similarities between Bock's NRM and the probability function of the canonical ensemble with degenerate energy states. As physicists often do, we exploit these mathematical similarities to gain new insights into the meaning of the IRT parameters and a richer understanding of the relationship between these parameters and student knowledge.
Physical Review Physics Education Research: Volume 18, Issue 1, Pages 010133
Subjects Levels Resource Types
Education Foundations
- Achievement
- Assessment
= Formative Assessment
= Instruments
= Summative Assessment
- Research Design & Methodology
= Data
= Validity
General Physics
- Physics Education Research
Mathematical Tools
- Statistics
- Graduate/Professional
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevPhysEducRes.18.010133
NSF Number:
DUE-1836470
Record Creator:
Metadata instance created April 28, 2022 by Lyle Barbato
Record Updated:
August 10, 2023 by Caroline Hall
Last Update
when Cataloged:
April 25, 2022
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
T. Smith and N. Bendjilali, , Phys. Rev. Phys. Educ. Res. 18 (1), 010133 (2022), WWW Document, (https://doi.org/10.1103/PhysRevPhysEducRes.18.010133).
AJP/PRST-PER
T. Smith and N. Bendjilali, Motivations for using the item response theory nominal response model to rank responses to multiple-choice items, Phys. Rev. Phys. Educ. Res. 18 (1), 010133 (2022), <https://doi.org/10.1103/PhysRevPhysEducRes.18.010133>.
APA Format
Smith, T., & Bendjilali, N. (2022, April 25). Motivations for using the item response theory nominal response model to rank responses to multiple-choice items. Phys. Rev. Phys. Educ. Res., 18(1), 010133. Retrieved May 3, 2024, from https://doi.org/10.1103/PhysRevPhysEducRes.18.010133
Chicago Format
Smith, Trevor I., and Nasrine Bendjilali. "Motivations for using the item response theory nominal response model to rank responses to multiple-choice items." Phys. Rev. Phys. Educ. Res. 18, no. 1, (April 25, 2022): 010133, https://doi.org/10.1103/PhysRevPhysEducRes.18.010133 (accessed 3 May 2024).
MLA Format
Smith, Trevor I., and Nasrine Bendjilali. "Motivations for using the item response theory nominal response model to rank responses to multiple-choice items." Phys. Rev. Phys. Educ. Res. 18.1 (2022): 010133. 3 May 2024 <https://doi.org/10.1103/PhysRevPhysEducRes.18.010133>.
BibTeX Export Format
@article{ Author = "Trevor I. Smith and Nasrine Bendjilali", Title = {Motivations for using the item response theory nominal response model to rank responses to multiple-choice items}, Journal = {Phys. Rev. Phys. Educ. Res.}, Volume = {18}, Number = {1}, Pages = {010133}, Month = {April}, Year = {2022} }
Refer Export Format

%A Trevor I. Smith %A Nasrine Bendjilali %T Motivations for using the item response theory nominal response model to rank responses to multiple-choice items %J Phys. Rev. Phys. Educ. Res. %V 18 %N 1 %D April 25, 2022 %P 010133 %U https://doi.org/10.1103/PhysRevPhysEducRes.18.010133 %O application/pdf

EndNote Export Format

%0 Journal Article %A Smith, Trevor I. %A Bendjilali, Nasrine %D April 25, 2022 %T Motivations for using the item response theory nominal response model to rank responses to multiple-choice items %J Phys. Rev. Phys. Educ. Res. %V 18 %N 1 %P 010133 %8 April 25, 2022 %U https://doi.org/10.1103/PhysRevPhysEducRes.18.010133


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Save to my folders

Contribute

Similar Materials