Free-response research-based assessments, like the Colorado Upper-division Electrostatics Diagnostic (CUE), provide rich, fine-grained information about students' reasoning. However, because of the difficulties inherent in scoring these assessments, the majority of the large-scale conceptual assessments in physics are multiple choice. To increase the scalability and usability of the CUE, we set out to create a new version of the assessment that preserves the insights afforded by a free-response format while exploiting the logistical advantages of a multiple-choice assessment. We used our extensive database of responses to the free-response CUE to construct distractors for a new version where students can select multiple responses and receive partial credit based on the accuracy and consistency of their selections. Here, we describe the development of this modified CUE format, which we call coupled multiple response (CMR), and present data from direct comparisons of both versions. We find that the two formats have the same average score and perform similarly on multiple measures of validity and reliability, suggesting that the new version is a potentially viable alternative to the original CUE for the purpose of large-scale research-based assessment. We also compare the details of student responses on each of the two versions. While the CMR version does not capture the full scope of potential student responses, nearly three-quarters of our students' responses to the free-response version contained one or more elements that matched options provided on the CMR version.
Physical Review Special Topics - Physics Education Research: Volume 10, Issue 2, Pages 020124
ComPADRE is beta testing Citation Styles!
Record Link
<a href="https://www.compadre.org/portal/items/detail.cfm?ID=13427">Wilcox, Bethany, and Steven Pollock. "Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics." Phys. Rev. ST Phys. Educ. Res. 10, no. 2, (October 9, 2014): 020124.</a>
AIP Format
B. Wilcox and S. Pollock, , Phys. Rev. ST Phys. Educ. Res. 10 (2), 020124 (2014), WWW Document, (https://doi.org/10.1103/PhysRevSTPER.10.020124).
AJP/PRST-PER
B. Wilcox and S. Pollock, Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics, Phys. Rev. ST Phys. Educ. Res. 10 (2), 020124 (2014), <https://doi.org/10.1103/PhysRevSTPER.10.020124>.
APA Format
Wilcox, B., & Pollock, S. (2014, October 9). Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics. Phys. Rev. ST Phys. Educ. Res., 10(2), 020124. Retrieved October 4, 2024, from https://doi.org/10.1103/PhysRevSTPER.10.020124
Chicago Format
Wilcox, Bethany, and Steven Pollock. "Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics." Phys. Rev. ST Phys. Educ. Res. 10, no. 2, (October 9, 2014): 020124, https://doi.org/10.1103/PhysRevSTPER.10.020124 (accessed 4 October 2024).
MLA Format
Wilcox, Bethany, and Steven Pollock. "Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics." Phys. Rev. ST Phys. Educ. Res. 10.2 (2014): 020124. 4 Oct. 2024 <https://doi.org/10.1103/PhysRevSTPER.10.020124>.
BibTeX Export Format
@article{
Author = "Bethany Wilcox and Steven Pollock",
Title = {Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics},
Journal = {Phys. Rev. ST Phys. Educ. Res.},
Volume = {10},
Number = {2},
Pages = {020124},
Month = {October},
Year = {2014}
}
Refer Export Format
%A Bethany Wilcox %A Steven Pollock %T Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics %J Phys. Rev. ST Phys. Educ. Res. %V 10 %N 2 %D October 9, 2014 %P 020124 %U https://doi.org/10.1103/PhysRevSTPER.10.020124 %O application/pdf
EndNote Export Format
%0 Journal Article %A Wilcox, Bethany %A Pollock, Steven %D October 9, 2014 %T Coupled multiple-response versus free-response conceptual assessment: An example from upper-division physics %J Phys. Rev. ST Phys. Educ. Res. %V 10 %N 2 %P 020124 %8 October 9, 2014 %U https://doi.org/10.1103/PhysRevSTPER.10.020124 Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.
Citation Source Information
The AIP Style presented is based on information from the AIP Style Manual. The APA Style presented is based on information from APA Style.org: Electronic References. The Chicago Style presented is based on information from Examples of Chicago-Style Documentation. The MLA Style presented is based on information from the MLA FAQ. |