Detail Page

Physical Review Physics Education Research
written by Yang Xiao, Kathleen M. Koenig, Jing Han, Qiaoyi Liu, Jianwen Xiong, and Lei Bao
Standardized concept inventories (CIs) have been widely used in science, technology, engineering, and mathematics education for assessment of student learning. In practice, there have been concerns regarding the length of the test and possible test-retest memory effect. To address these issues, a recent study developed a method to split a CI into two equivalent short CIs, which have been shown to provide equivalent mean score measures. However, the previous approach does not fully examine common requirements of test equating. This study extends the existing method with test equating analysis to form a revised algorithm for developing and validating equivalent short CIs. The method is applied to split the Conceptual Survey of Electricity and Magnetism (CSEM) into two half-length CSEMs (HCSEMs). Through a series of test-equating and validation analysis, the HCSEMs are confirmed to measure the same content clusters and the same construct of students' understanding as that of the original CSEM at a similar level of reliability regarding their question design features. Furthermore, a best performing equating function to convert scores among the two HCSEMs and the CSEM is identified through comparisons of four commonly used equating functions. The conversions are further validated using the existing data sets as well as a data set collected from an empirical study using randomized testing. The results confirm that the three CIs can provide equivalent measures in different subpopulations. Overall, the results from this study have shown that the revised algorithm can provide a more complete framework in developing and validating equivalent short CIs. In addition, this method can also be applied to develop and validate parallel CIs in general.
Physical Review Physics Education Research: Volume 15, Issue 1, Pages 010122
Subjects Levels Resource Types
Education Foundations
- Assessment
= Conceptual Assessment
= Instruments
- Research Design & Methodology
= Data
= Validity
Electricity & Magnetism
- General
General Physics
- Physics Education Research
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- Administrators
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevPhysEducRes.15.010122
NSF Numbers:
DUE-1044724
DUE-1431908
DRL-1417983
DUE-1712238
Keywords:
Abridged CSEM, CSEM validity, Shortened CSEM
Record Creator:
Metadata instance created May 9, 2019 by Lyle Barbato
Record Updated:
June 14, 2022 by Caroline Hall
Last Update
when Cataloged:
April 24, 2019
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
Y. Xiao, K. Koenig, J. Han, Q. Liu, J. Xiong, and L. Bao, , Phys. Rev. Phys. Educ. Res. 15 (1), 010122 (2019), WWW Document, (https://doi.org/10.1103/PhysRevPhysEducRes.15.010122).
AJP/PRST-PER
Y. Xiao, K. Koenig, J. Han, Q. Liu, J. Xiong, and L. Bao, Test equity in developing short version conceptual inventories: A case study on the Conceptual Survey of Electricity and Magnetism, Phys. Rev. Phys. Educ. Res. 15 (1), 010122 (2019), <https://doi.org/10.1103/PhysRevPhysEducRes.15.010122>.
APA Format
Xiao, Y., Koenig, K., Han, J., Liu, Q., Xiong, J., & Bao, L. (2019, April 24). Test equity in developing short version conceptual inventories: A case study on the Conceptual Survey of Electricity and Magnetism. Phys. Rev. Phys. Educ. Res., 15(1), 010122. Retrieved May 1, 2024, from https://doi.org/10.1103/PhysRevPhysEducRes.15.010122
Chicago Format
Xiao, Y, K. Koenig, J. Han, Q. Liu, J. Xiong, and L. Bao. "Test equity in developing short version conceptual inventories: A case study on the Conceptual Survey of Electricity and Magnetism." Phys. Rev. Phys. Educ. Res. 15, no. 1, (April 24, 2019): 010122, https://doi.org/10.1103/PhysRevPhysEducRes.15.010122 (accessed 1 May 2024).
MLA Format
Xiao, Yang, Kathleen Koenig, Jing Han, Qiaoyi Liu, Jianwen Xiong, and Lei Bao. "Test equity in developing short version conceptual inventories: A case study on the Conceptual Survey of Electricity and Magnetism." Phys. Rev. Phys. Educ. Res. 15.1 (2019): 010122. 1 May 2024 <https://doi.org/10.1103/PhysRevPhysEducRes.15.010122>.
BibTeX Export Format
@article{ Author = "Yang Xiao and Kathleen Koenig and Jing Han and Qiaoyi Liu and Jianwen Xiong and Lei Bao", Title = {Test equity in developing short version conceptual inventories: A case study on the Conceptual Survey of Electricity and Magnetism}, Journal = {Phys. Rev. Phys. Educ. Res.}, Volume = {15}, Number = {1}, Pages = {010122}, Month = {April}, Year = {2019} }
Refer Export Format

%A Yang Xiao %A Kathleen Koenig %A Jing Han %A Qiaoyi Liu %A Jianwen Xiong %A Lei Bao %T Test equity in developing short version conceptual inventories: A case study on the Conceptual Survey of Electricity and Magnetism %J Phys. Rev. Phys. Educ. Res. %V 15 %N 1 %D April 24, 2019 %P 010122 %U https://doi.org/10.1103/PhysRevPhysEducRes.15.010122 %O application/pdf

EndNote Export Format

%0 Journal Article %A Xiao, Yang %A Koenig, Kathleen %A Han, Jing %A Liu, Qiaoyi %A Xiong, Jianwen %A Bao, Lei %D April 24, 2019 %T Test equity in developing short version conceptual inventories: A case study on the Conceptual Survey of Electricity and Magnetism %J Phys. Rev. Phys. Educ. Res. %V 15 %N 1 %P 010122 %8 April 24, 2019 %U https://doi.org/10.1103/PhysRevPhysEducRes.15.010122


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Save to my folders

Contribute

Similar Materials