Identifying Differences in Diagnostic Skills between Physics Students: Developing a Rubric Documents

Main Document

Identifying Differences In Diagnostic Skills Between Physics Students: Developing A Rubric 

written by Andrew J. Mason, Elisheva Cohen, Edit Yerushalmi, and Chandralekha Singh

Expert problem solvers are characterized by continuous evaluation of their progress towards a solution. One characteristic of expertise is self-diagnosis directed towards elaboration of the solvers' conceptual understanding, knowledge organization or strategic approach. "Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating how introductory physics students perform in such tasks. Developing a robust rubric is essential for objective evaluation of students' self-diagnosis skills. We discuss the development of a grading rubric that takes into account introductory physics students' content knowledge as well as analysis, planning and presentation skills. Using this rubric, we have found the inter-rater reliability to be better than 80%. The rubric can easily be adapted to other problems, as will be discussed in a companion paper.

Published October 20, 2008
Last Modified May 22, 2009

This file is included in the full-text index.
This file has previous versions.