Detail Page

Physical Review Special Topics - Physics Education Research
Empirical approach to interpreting card-sorting data
written by Steven F. Wolf, Daniel P. Dougherty, and Gerd Kortemeyer
Since it was first published 30 years ago, the seminal paper of Chi et al. on expert and novice categorization of introductory problems led to a plethora of follow-up studies within and outside of the area of physics. These studies frequently encompass "card-sorting" exercises whereby the participants group problems. While this technique certainly allows insights into problem solving approaches, simple descriptive statistics more often than not fail to find significant differences between experts and novices. In moving beyond descriptive statistics, we describe a novel microscopic approach that takes into account the individual identity of the cards and uses graph theory and models to visualize, analyze, and interpret problem categorization experiments. We apply these methods to an introductory physics (mechanics) problem categorization experiment, and find that most of the variation in sorting outcome is not due to the sorter being an expert versus a novice, but rather due to an independent characteristic that we named "stacker" versus "spreader." The fact that the expert-novice distinction only accounts for a smaller amount of the variation may explain the frequent null results when conducting these experiments.
Subjects Levels Resource Types
Education Foundations
- Problem Solving
= Expert-Novice Comparisons
- Research Design & Methodology
= Data
= Evaluation
= Statistics
- Lower Undergraduate
- Graduate/Professional
- Upper Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Mirror:
https://doi.org/10.1103/PhysRevST…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 3.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevSTPER.8.010124
PACSs:
01.40.Fk
01.40.Ha
01.55.+b
01.90.+g
Keywords:
Card Sorting Exercises, Expert-Novice, Problem Solving
Record Creator:
Metadata instance created May 20, 2012 by Lyle Barbato
Record Updated:
May 21, 2012 by Vince Kuo
Last Update
when Cataloged:
May 18, 2012
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
S. Wolf, D. Dougherty, and G. Kortemeyer, , Phys. Rev. ST Phys. Educ. Res. 8 (1), 010124 (2012), WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841).
AJP/PRST-PER
S. Wolf, D. Dougherty, and G. Kortemeyer, Empirical approach to interpreting card-sorting data, Phys. Rev. ST Phys. Educ. Res. 8 (1), 010124 (2012), <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841>.
APA Format
Wolf, S., Dougherty, D., & Kortemeyer, G. (2012, May 18). Empirical approach to interpreting card-sorting data. Phys. Rev. ST Phys. Educ. Res., 8(1), 010124. Retrieved May 3, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841
Chicago Format
Wolf, S, D. Dougherty, and G. Kortemeyer. "Empirical approach to interpreting card-sorting data." Phys. Rev. ST Phys. Educ. Res. 8, no. 1, (May 18, 2012): 010124, https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841 (accessed 3 May 2025).
MLA Format
Wolf, Steven, Daniel Dougherty, and Gerd Kortemeyer. "Empirical approach to interpreting card-sorting data." Phys. Rev. ST Phys. Educ. Res. 8.1 (2012): 010124. 3 May 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841>.
BibTeX Export Format
@article{ Author = "Steven Wolf and Daniel Dougherty and Gerd Kortemeyer", Title = {Empirical approach to interpreting card-sorting data}, Journal = {Phys. Rev. ST Phys. Educ. Res.}, Volume = {8}, Number = {1}, Pages = {010124}, Month = {May}, Year = {2012} }
Refer Export Format

%A Steven Wolf %A Daniel Dougherty %A Gerd Kortemeyer %T Empirical approach to interpreting card-sorting data %J Phys. Rev. ST Phys. Educ. Res. %V 8 %N 1 %D May 18, 2012 %P 010124 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841 %O application/pdf

EndNote Export Format

%0 Journal Article %A Wolf, Steven %A Dougherty, Daniel %A Kortemeyer, Gerd %D May 18, 2012 %T Empirical approach to interpreting card-sorting data %J Phys. Rev. ST Phys. Educ. Res. %V 8 %N 1 %P 010124 %8 May 18, 2012 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=12011&DocID=2841


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Save to my folders

Contribute

Similar Materials