Detail Page

Physical Review Physics Education Research
written by Yang Xiao, Guiqing Xu, Jing Han, Hua Xiao, Jianwen Xiong, and Lei Bao
Concept inventories (CIs) are commonly used in pre-post instruction to study student conceptual change. For consistency in assessment interpretation, a CI's assessment construct is desired to maintain invariance across different test times. In this study, the longitudinal measurement invariance (LMI) analysis under the confirmatory factor analysis framework was used to examine the stability of the factor structure between pretest and post-test of two commonly used CIs, i.e., the Force Concept Inventory (FCI) and Conceptual Survey of Electricity and Magnetism (CSEM). A number of existing and modified models were examined in this paper. The results confirmed that all factor models of the FCI fitted well with both pre- and post-test data. For CSEM, acceptable fits were obtained with a reduced version of the CI. When reliability analysis was performed for the factors of these models, most modified models were found to be more reliable than the existing models. The modified models were further tested in LMI analysis, in which a sequence of models with increasingly restrictive parameter constraints was examined. For the FCI, LMI analysis demonstrated the existence of partial strict invariance, i.e., common factor structures, factor loadings, and item thresholds, and equally observed residual variances for all the items except items 2 and 29. For the CSEM, after excluding 10 items, a reduced version was found to hold the strict invariance criteria. These findings reveal that changes in scores of the whole FCI and the reduced CSEM can be attributed to changes in the latent constructs measured by the CIs, which confirms these two CIs as reliable instruments to study students' conceptual change over time in introductory physics courses.
Physical Review Physics Education Research: Volume 16, Issue 2, Pages 020103
Subjects Levels Resource Types
Classical Mechanics
- General
Education Foundations
- Research Design & Methodology
= Data
= Evaluation
= Validity
Electricity & Magnetism
- General
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- Professional/Practitioners
- Administrators
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 3.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevPhysEducRes.16.020103
NSF Number:
DUE-1712238
Keywords:
CSEM validity, E&M concept inventory, FCI validity, concept assessments, concept inventory validity, electricity and magnetism assessment, posttest inventory, pretest inventory
Record Creator:
Metadata instance created February 12, 2022 by Adrian Madsen
Record Updated:
March 26, 2022 by Caroline Hall
Last Update
when Cataloged:
July 14, 2020
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
Y. Xiao, G. Xu, J. Han, H. Xiao, J. Xiong, and L. Bao, , Phys. Rev. Phys. Educ. Res. 16 (2), 020103 (2020), WWW Document, (https://doi.org/10.1103/physrevphyseducres.16.020103).
AJP/PRST-PER
Y. Xiao, G. Xu, J. Han, H. Xiao, J. Xiong, and L. Bao, Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism, Phys. Rev. Phys. Educ. Res. 16 (2), 020103 (2020), <https://doi.org/10.1103/physrevphyseducres.16.020103>.
APA Format
Xiao, Y., Xu, G., Han, J., Xiao, H., Xiong, J., & Bao, L. (2020, July 14). Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism. Phys. Rev. Phys. Educ. Res., 16(2), 020103. Retrieved March 1, 2024, from https://doi.org/10.1103/physrevphyseducres.16.020103
Chicago Format
Xiao, Y, G. Xu, J. Han, H. Xiao, J. Xiong, and L. Bao. "Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism." Phys. Rev. Phys. Educ. Res. 16, no. 2, (July 14, 2020): 020103, https://doi.org/10.1103/physrevphyseducres.16.020103 (accessed 1 March 2024).
MLA Format
Xiao, Yang, Guiqing Xu, Jing Han, Hua Xiao, Jianwen Xiong, and Lei Bao. "Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism." Phys. Rev. Phys. Educ. Res. 16.2 (2020): 020103. 1 Mar. 2024 <https://doi.org/10.1103/physrevphyseducres.16.020103>.
BibTeX Export Format
@article{ Author = "Yang Xiao and Guiqing Xu and Jing Han and Hua Xiao and Jianwen Xiong and Lei Bao", Title = {Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism}, Journal = {Phys. Rev. Phys. Educ. Res.}, Volume = {16}, Number = {2}, Pages = {020103}, Month = {July}, Year = {2020} }
Refer Export Format

%A Yang Xiao %A Guiqing Xu %A Jing Han %A Hua Xiao %A Jianwen Xiong %A Lei Bao %T Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism %J Phys. Rev. Phys. Educ. Res. %V 16 %N 2 %D July 14, 2020 %P 020103 %U https://doi.org/10.1103/physrevphyseducres.16.020103 %O application/pdf

EndNote Export Format

%0 Journal Article %A Xiao, Yang %A Xu, Guiqing %A Han, Jing %A Xiao, Hua %A Xiong, Jianwen %A Bao, Lei %D July 14, 2020 %T Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism %J Phys. Rev. Phys. Educ. Res. %V 16 %N 2 %P 020103 %8 July 14, 2020 %U https://doi.org/10.1103/physrevphyseducres.16.020103


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Save to my folders

Contribute

Similar Materials