Detail Page

Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory
written by Xian Wu, Matthew W. Guthrie, Erin M. Scanlon, and Yaoguang Li
There have been myriad conceptual inventories developed and used by the physics education research community (e.g., FCI, FMCE, BEMA, CSEM). However, continued examination of the psychometric properties of these inventories is important for improving inventory development and usage practices. In this study, we investigate the dimensionality of the Energy and Momentum Conceptual Survey (EMCS) test items and explore the structure of students' understanding of these concepts (i.e., whether the student response data showed multiple distinct test traits). To investigate the psychometric properties of this survey, we surveyed a sample of 253 students participated in the pretest and 201 students for the posttest assessments. Statistical analyses, guided by Item Response Theory (IRT), were conducted using R software. The results of Bootstrap modified parallel analysis tests (BMPAT) revealed significant differences between unidimensional models and the actual data, indicating the presence of multidimensionality (i.e., dimensions correspond to the
physics concepts/abilities being tested) in the EMCS test items. Exploratory analyses suggested that a 2 or 3-dimensional model best fits the data. However, categorizing items based on designated concepts did not improve the model fit. The findings imply that students may interpret the items differently than intended by the test designers.
Physics Education Research Conference 2023
Part of the PER Conference series
Sacramento, CA: July 19-20, 2023
Pages 397-402
Subjects Levels Resource Types
Education Foundations
- Assessment
= Conceptual Assessment
= Instruments
= Methods
- Cognition
- Learning Theory
= Cognitive Modeling
- Research Design & Methodology
= Data
= Statistics
= Validity
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- application/pdf
  • Currently 0.0/5

Want to rate this material?
Login here!


Mirror:
https://doi.org/10.1119/perc.2023…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:
American Association of Physics Teachers
DOI:
10.1119/perc.2023.pr.Wu
Keyword:
PERC 2023
Record Creator:
Metadata instance created September 20, 2023 by Lyle Barbato
Record Updated:
October 11, 2023 by Lyle Barbato
Last Update
when Cataloged:
October 15, 2023
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
X. Wu, M. Guthrie, E. Scanlon, and Y. Li, , presented at the Physics Education Research Conference 2023, Sacramento, CA, 2023, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16616&DocID=5796).
AJP/PRST-PER
X. Wu, M. Guthrie, E. Scanlon, and Y. Li, Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory, presented at the Physics Education Research Conference 2023, Sacramento, CA, 2023, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16616&DocID=5796>.
APA Format
Wu, X., Guthrie, M., Scanlon, E., & Li, Y. (2023, July 19-20). Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory. Paper presented at Physics Education Research Conference 2023, Sacramento, CA. Retrieved May 2, 2024, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16616&DocID=5796
Chicago Format
Wu, X, M. Guthrie, E. Scanlon, and Y. Li. "Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory." Paper presented at the Physics Education Research Conference 2023, Sacramento, CA, July 19-20, 2023. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16616&DocID=5796 (accessed 2 May 2024).
MLA Format
Wu, Xian, Matthew W. Guthrie, Erin Scanlon, and Yaoguang Li. "Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory." Physics Education Research Conference 2023. Sacramento, CA: 2023. 397-402 of PER Conference. 2 May 2024 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16616&DocID=5796>.
BibTeX Export Format
@inproceedings{ Author = "Xian Wu and Matthew W. Guthrie and Erin Scanlon and Yaoguang Li", Title = {Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory}, BookTitle = {Physics Education Research Conference 2023}, Pages = {397-402}, Address = {Sacramento, CA}, Series = {PER Conference}, Month = {July 19-20}, Year = {2023} }
Refer Export Format

%A Xian Wu %A Matthew W. Guthrie %A Erin Scanlon %A Yaoguang Li %T Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory %S PER Conference %D July 19-20 2023 %P 397-402 %C Sacramento, CA %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16616&DocID=5796 %O Physics Education Research Conference 2023 %O July 19-20 %O application/pdf

EndNote Export Format

%0 Conference Proceedings %A Wu, Xian %A Guthrie, Matthew W. %A Scanlon, Erin %A Li, Yaoguang %D July 19-20 2023 %T Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory %B Physics Education Research Conference 2023 %C Sacramento, CA %P 397-402 %S PER Conference %8 July 19-20 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16616&DocID=5796


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Analyzing the dimensionality of the Energy and Momentum Conceptual Survey using Item Response Theory:


Know of another related resource? Login to relate this resource to it.
Save to my folders

Contribute

Related Materials

Similar Materials