Detail Page

Physical Review Physics Education Research
written by Trevor I. Smith, Kyle J. Louis, Bartholomew J. Ricci IV, and Nasrine Bendjilali
Research-based assessment instruments (RBAIs) are ubiquitous throughout both physics instruction and physics education research. The vast majority of analyses involving student responses to RBAI questions have focused on whether or not a student selects correct answers and using correctness to measure growth. This approach often undervalues the rich information that may be obtained by examining students' particular choices of incorrect answers. In the present study, we aim to reveal some of this valuable information by quantitatively determining the relative correctness of various incorrect responses. To accomplish this, we propose an assumption that allows us to define relative correctness: students who have a high understanding of Newtonian physics are likely to answer more questions correctly and also more likely to choose better incorrect responses than students who have a low understanding. Analyses using item response theory align with this assumption, and Bock's nominal response model allows us to uniquely rank each incorrect response. We present results from over 7000 students' responses to the Force and Motion Conceptual Evaluation.
Physical Review Physics Education Research: Volume 16, Issue 1, Pages 010107
Subjects Levels Resource Types
Classical Mechanics
- General
Education Foundations
- Assessment
= Conceptual Assessment
- Research Design & Methodology
= Evaluation
= Statistics
General Physics
- Physics Education Research
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- Professional/Practitioners
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevPhysEducRes.16.010107
NSF Number:
DUE-1836470
Keywords:
FCME validity, IRT, concept inventory validity
Record Creator:
Metadata instance created June 15, 2020 by Lyle Barbato
Record Updated:
January 20, 2023 by Caroline Hall
Last Update
when Cataloged:
January 30, 2020
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
T. Smith, K. Louis, B. Ricci, and N. Bendjilali, , Phys. Rev. Phys. Educ. Res. 16 (1), 010107 (2020), WWW Document, (https://doi.org/10.1103/PhysRevPhysEducRes.16.010107).
AJP/PRST-PER
T. Smith, K. Louis, B. Ricci, and N. Bendjilali, Quantitatively ranking incorrect responses to multiple-choice questions using item response theory, Phys. Rev. Phys. Educ. Res. 16 (1), 010107 (2020), <https://doi.org/10.1103/PhysRevPhysEducRes.16.010107>.
APA Format
Smith, T., Louis, K., Ricci, B., & Bendjilali, N. (2020, January 30). Quantitatively ranking incorrect responses to multiple-choice questions using item response theory. Phys. Rev. Phys. Educ. Res., 16(1), 010107. Retrieved May 16, 2024, from https://doi.org/10.1103/PhysRevPhysEducRes.16.010107
Chicago Format
Smith, T, K. Louis, B. Ricci, and N. Bendjilali. "Quantitatively ranking incorrect responses to multiple-choice questions using item response theory." Phys. Rev. Phys. Educ. Res. 16, no. 1, (January 30, 2020): 010107, https://doi.org/10.1103/PhysRevPhysEducRes.16.010107 (accessed 16 May 2024).
MLA Format
Smith, Trevor I., Kyle J. Louis, Bartholomew J. Ricci, and Nasrine Bendjilali. "Quantitatively ranking incorrect responses to multiple-choice questions using item response theory." Phys. Rev. Phys. Educ. Res. 16.1 (2020): 010107. 16 May 2024 <https://doi.org/10.1103/PhysRevPhysEducRes.16.010107>.
BibTeX Export Format
@article{ Author = "Trevor I. Smith and Kyle J. Louis and Bartholomew J. Ricci and Nasrine Bendjilali", Title = {Quantitatively ranking incorrect responses to multiple-choice questions using item response theory}, Journal = {Phys. Rev. Phys. Educ. Res.}, Volume = {16}, Number = {1}, Pages = {010107}, Month = {January}, Year = {2020} }
Refer Export Format

%A Trevor I. Smith %A Kyle J. Louis %A Bartholomew J. Ricci %A Nasrine Bendjilali %T Quantitatively ranking incorrect responses to multiple-choice questions using item response theory %J Phys. Rev. Phys. Educ. Res. %V 16 %N 1 %D January 30, 2020 %P 010107 %U https://doi.org/10.1103/PhysRevPhysEducRes.16.010107 %O application/pdf

EndNote Export Format

%0 Journal Article %A Smith, Trevor I. %A Louis, Kyle J. %A Ricci, Bartholomew J. %A Bendjilali, Nasrine %D January 30, 2020 %T Quantitatively ranking incorrect responses to multiple-choice questions using item response theory %J Phys. Rev. Phys. Educ. Res. %V 16 %N 1 %P 010107 %8 January 30, 2020 %U https://doi.org/10.1103/PhysRevPhysEducRes.16.010107


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Save to my folders

Contribute

Similar Materials