![]() Empirical approach to interpreting card-sorting data
written by
Steven F. Wolf, Daniel P. Dougherty, and Gerd Kortemeyer
Since it was first published 30 years ago, the seminal paper of Chi et al. on expert and novice categorization of introductory problems led to a plethora of follow-up studies within and outside of the area of physics. These studies frequently encompass "card-sorting" exercises whereby the participants group problems. While this technique certainly allows insights into problem solving approaches, simple descriptive statistics more often than not fail to find significant differences between experts and novices. In moving beyond descriptive statistics, we describe a novel microscopic approach that takes into account the individual identity of the cards and uses graph theory and models to visualize, analyze, and interpret problem categorization experiments. We apply these methods to an introductory physics (mechanics) problem categorization experiment, and find that most of the variation in sorting outcome is not due to the sorter being an expert versus a novice, but rather due to an independent characteristic that we named "stacker" versus "spreader." The fact that the expert-novice distinction only accounts for a smaller amount of the variation may explain the frequent null results when conducting these experiments.
Physical Review Special Topics - Physics Education Research: Volume 8, Issue 1, Pages 010124
ComPADRE is beta testing Citation Styles!
![]() <a href="https://www.compadre.org/portal/items/detail.cfm?ID=12011">Wolf, S, D. Dougherty, and G. Kortemeyer. "Empirical approach to interpreting card-sorting data." Phys. Rev. ST Phys. Educ. Res. 8, no. 1, (May 18, 2012): 010124.</a>
![]() S. Wolf, D. Dougherty, and G. Kortemeyer, , Phys. Rev. ST Phys. Educ. Res. 8 (1), 010124 (2012), WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841).
![]() S. Wolf, D. Dougherty, and G. Kortemeyer, Empirical approach to interpreting card-sorting data, Phys. Rev. ST Phys. Educ. Res. 8 (1), 010124 (2012), <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841>.
![]() Wolf, S., Dougherty, D., & Kortemeyer, G. (2012, May 18). Empirical approach to interpreting card-sorting data. Phys. Rev. ST Phys. Educ. Res., 8(1), 010124. Retrieved May 3, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841
![]() Wolf, S, D. Dougherty, and G. Kortemeyer. "Empirical approach to interpreting card-sorting data." Phys. Rev. ST Phys. Educ. Res. 8, no. 1, (May 18, 2012): 010124, https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841 (accessed 3 May 2025).
![]() Wolf, Steven, Daniel Dougherty, and Gerd Kortemeyer. "Empirical approach to interpreting card-sorting data." Phys. Rev. ST Phys. Educ. Res. 8.1 (2012): 010124. 3 May 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841>.
![]() @article{
Author = "Steven Wolf and Daniel Dougherty and Gerd Kortemeyer",
Title = {Empirical approach to interpreting card-sorting data},
Journal = {Phys. Rev. ST Phys. Educ. Res.},
Volume = {8},
Number = {1},
Pages = {010124},
Month = {May},
Year = {2012}
}
![]() %A Steven Wolf %A Daniel Dougherty %A Gerd Kortemeyer %T Empirical approach to interpreting card-sorting data %J Phys. Rev. ST Phys. Educ. Res. %V 8 %N 1 %D May 18, 2012 %P 010124 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841 %O application/pdf ![]() %0 Journal Article %A Wolf, Steven %A Dougherty, Daniel %A Kortemeyer, Gerd %D May 18, 2012 %T Empirical approach to interpreting card-sorting data %J Phys. Rev. ST Phys. Educ. Res. %V 8 %N 1 %P 010124 %8 May 18, 2012 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841 Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.
Citation Source Information
The AIP Style presented is based on information from the AIP Style Manual. The APA Style presented is based on information from APA Style.org: Electronic References. The Chicago Style presented is based on information from Examples of Chicago-Style Documentation. The MLA Style presented is based on information from the MLA FAQ. |