Finding meaningful search features for automated analysis of short responses to conceptual questions
written by
Christopher M. Nakamura, Sytil K. Murphy, Michael Christel, Scott M. Stevens, and Dean A. Zollman
The Pathway Active Learning Environment synthetic tutoring system is capable of collecting large numbers of students' short responses to open-ended questions. The analysis of these responses may provide insight into the utility of the system, as well as information about student understanding of physics. The free-response nature of our data lends itself to qualitative analysis, however large data sets benefit from automated analysis. Natural language processing and data mining approaches, such as clustering, have been of interest across a variety of fields for automating the analysis of qualitative data. However, content-specific vocabulary, an abundance of search features, some of which are irrelevant, and inherent limitations on computers' abilities to match meaning are challenges that must be overcome. In this paper we discuss an analysis protocol for training computer models for automated data analysis. The preliminary analysis of two sample questions is presented, demonstrating a baseline of success.
Physics Education Research Conference 2011
Part of the PER Conference series Omaha, Nebraska: August 3-4, 2011 Volume 1413, Pages 283-286
ComPADRE is beta testing Citation Styles!
![]() <a href="https://www.compadre.org/portal/items/detail.cfm?ID=11868">Nakamura, C, S. Murphy, M. Christel, S. Stevens, and D. Zollman. "Finding meaningful search features for automated analysis of short responses to conceptual questions." Paper presented at the Physics Education Research Conference 2011, Omaha, Nebraska, August 3-4, 2011.</a>
![]() C. Nakamura, S. Murphy, M. Christel, S. Stevens, and D. Zollman, , presented at the Physics Education Research Conference 2011, Omaha, Nebraska, 2011, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=11868&DocID=2716).
![]() C. Nakamura, S. Murphy, M. Christel, S. Stevens, and D. Zollman, Finding meaningful search features for automated analysis of short responses to conceptual questions, presented at the Physics Education Research Conference 2011, Omaha, Nebraska, 2011, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=11868&DocID=2716>.
![]() Nakamura, C., Murphy, S., Christel, M., Stevens, S., & Zollman, D. (2011, August 3-4). Finding meaningful search features for automated analysis of short responses to conceptual questions. Paper presented at Physics Education Research Conference 2011, Omaha, Nebraska. Retrieved February 15, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=11868&DocID=2716
![]() Nakamura, C, S. Murphy, M. Christel, S. Stevens, and D. Zollman. "Finding meaningful search features for automated analysis of short responses to conceptual questions." Paper presented at the Physics Education Research Conference 2011, Omaha, Nebraska, August 3-4, 2011. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=11868&DocID=2716 (accessed 15 February 2025).
![]() Nakamura, Christopher, Sytil Murphy, Michael Christel, Scott Stevens, and Dean Zollman. "Finding meaningful search features for automated analysis of short responses to conceptual questions." Physics Education Research Conference 2011. Omaha, Nebraska: 2011. 283-286 Vol. 1413 of PER Conference. 15 Feb. 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=11868&DocID=2716>.
![]() @inproceedings{
Author = "Christopher Nakamura and Sytil Murphy and Michael Christel and Scott Stevens and Dean Zollman",
Title = {Finding meaningful search features for automated analysis of short responses to conceptual questions},
BookTitle = {Physics Education Research Conference 2011},
Pages = {283-286},
Address = {Omaha, Nebraska},
Series = {PER Conference},
Volume = {1413},
Month = {August 3-4},
Year = {2011}
}
![]() %A Christopher Nakamura %A Sytil Murphy %A Michael Christel %A Scott Stevens %A Dean Zollman %T Finding meaningful search features for automated analysis of short responses to conceptual questions %S PER Conference %V 1413 %D August 3-4 2011 %P 283-286 %C Omaha, Nebraska %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=11868&DocID=2716 %O Physics Education Research Conference 2011 %O August 3-4 %O application/pdf ![]() %0 Conference Proceedings %A Nakamura, Christopher %A Murphy, Sytil %A Christel, Michael %A Stevens, Scott %A Zollman, Dean %D August 3-4 2011 %T Finding meaningful search features for automated analysis of short responses to conceptual questions %B Physics Education Research Conference 2011 %C Omaha, Nebraska %V 1413 %P 283-286 %S PER Conference %8 August 3-4 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=11868&DocID=2716 Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.
Citation Source Information
The AIP Style presented is based on information from the AIP Style Manual. The APA Style presented is based on information from APA Style.org: Electronic References. The Chicago Style presented is based on information from Examples of Chicago-Style Documentation. The MLA Style presented is based on information from the MLA FAQ. Finding meaningful search features for automated analysis of short responses to conceptual questions:Know of another related resource? Login to relate this resource to it. |
ContributeRelated MaterialsSimilar Materials |