Detail Page

Physical Review Physics Education Research
written by Philip Eaton, Barrett Frank, and Shannon Willoughby
Items that are chained, or blocked, together appear on many of the conceptual assessments utilized for physics education research. However, when items are chained together there is the potential to introduce local dependence between those items, which would violate the assumption of item independence required by classical test theory, unidimensional item response theory, and other measurement theories. Local dependence can be divided into two categories: (i) underlying local dependence, which can be adequately modeled with multidimensional measurement theories, and (ii) surface local dependence (SLD), which cannot be modeled using multidimensional measurement theories. The act of chaining items is thought to be one of the many potential sources of SLD between items. Using previous local dependence research results, this study proposes two methods for detecting the presence of local dependence and SLD between items on an assessment. These methods were applied to the Force Concept Inventory (FCI) and the Force and Motion Conceptual Evaluation (FMCE). It was found that the assumption of item independence was violated for both assessments, implying that unidimensional measurement theories may not adequately model either the FCI or FMCE. Further, both detection methods identified the potential for a minimal amount of SLD present for FCI and a significant amount of SLD present for the FMCE. This implies that even multidimensional measurement theories may not be capable of adequately modeling the FMCE when scoring items individually. This result supports the claim made by Thornton et al. that the items on the FMCE should be scored in groups; however, the currently proposed grading scheme was found to be inadequate.
Physical Review Physics Education Research: Volume 16, Issue 2, Pages 020122
Subjects Levels Resource Types
Education Foundations
- Assessment
= Conceptual Assessment
= Instruments
- Research Design & Methodology
= Data
= Validity
- Sample Population
General Physics
- Physics Education Research
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- Administrators
- Educators
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 3.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevPhysEducRes.16.020122
Keywords:
FCI validity, FMCE validity
Record Creator:
Metadata instance created May 12, 2021 by Bruce Mason
Record Updated:
May 26, 2022 by Caroline Hall
Last Update
when Cataloged:
October 1, 2020
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
P. Eaton, B. Frank, and S. Willoughby, , Phys. Rev. Phys. Educ. Res. 16 (2), 020122 (2020), WWW Document, (https://doi.org/10.1103/PhysRevPhysEducRes.16.020122).
AJP/PRST-PER
P. Eaton, B. Frank, and S. Willoughby, Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation, Phys. Rev. Phys. Educ. Res. 16 (2), 020122 (2020), <https://doi.org/10.1103/PhysRevPhysEducRes.16.020122>.
APA Format
Eaton, P., Frank, B., & Willoughby, S. (2020, October 1). Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation. Phys. Rev. Phys. Educ. Res., 16(2), 020122. Retrieved May 2, 2024, from https://doi.org/10.1103/PhysRevPhysEducRes.16.020122
Chicago Format
Eaton, P, B. Frank, and S. Willoughby. "Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation." Phys. Rev. Phys. Educ. Res. 16, no. 2, (October 1, 2020): 020122, https://doi.org/10.1103/PhysRevPhysEducRes.16.020122 (accessed 2 May 2024).
MLA Format
Eaton, Philip, Barrett Frank, and Shannon Willoughby. "Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation." Phys. Rev. Phys. Educ. Res. 16.2 (2020): 020122. 2 May 2024 <https://doi.org/10.1103/PhysRevPhysEducRes.16.020122>.
BibTeX Export Format
@article{ Author = "Philip Eaton and Barrett Frank and Shannon Willoughby", Title = {Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation}, Journal = {Phys. Rev. Phys. Educ. Res.}, Volume = {16}, Number = {2}, Pages = {020122}, Month = {October}, Year = {2020} }
Refer Export Format

%A Philip Eaton %A Barrett Frank %A Shannon Willoughby %T Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation %J Phys. Rev. Phys. Educ. Res. %V 16 %N 2 %D October 1, 2020 %P 020122 %U https://doi.org/10.1103/PhysRevPhysEducRes.16.020122 %O application/pdf

EndNote Export Format

%0 Journal Article %A Eaton, Philip %A Frank, Barrett %A Willoughby, Shannon %D October 1, 2020 %T Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation %J Phys. Rev. Phys. Educ. Res. %V 16 %N 2 %P 020122 %8 October 1, 2020 %U https://doi.org/10.1103/PhysRevPhysEducRes.16.020122


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Save to my folders

Contribute

Similar Materials