Detail Page

Design and Evaluation of a Natural Language Tutor for Force and Motion
written by Ryan Badeau and Andrew F. Heckler
We report on the design and pilot evaluation of a simple natural language computer tutor that targets student difficulties with the concepts of force and motion. The tutor prompts students to respond in free-response natural language to questions that address the relationships between the directions of net force, velocity, and acceleration. To examine the effectiveness of the natural language format, we compared student performance on a previously validated force and motion assessment after tutoring via natural language and multiple choice formats. Natural language training with feedback, multiple choice training with feedback, and natural language training without feedback formats resulted in effect sizes of d = 0.60 (p = 0.07), d = 0.46 (p = 0.13), and d = 0.09 (p = 0.97) respectively versus a no-training control. In addition, a median split on course grades showed no significant aptitude-treatment interaction across training conditions. However, accounting for time spent on training, the multiple choice training was significantly more efficient. For the natural language format, an analysis of performance (62% identification of an initial student response), false positives, and typical student answer patterns suggest room for improvement and subsequent study.
Physics Education Research Conference 2014
Part of the PER Conference series
Minneapolis, MN: July 30-31, 2014
Pages 27-30
Subjects Levels Resource Types
Education Foundations
- Assessment
= Instruments
Education Practices
- Instructional Material Design
= Tutorial
- Technology
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- application/pdf
  • Currently 0.0/5

Want to rate this material?
Login here!


Mirror:
https://doi.org/10.1119/perc.2014…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 3.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:
American Association of Physics Teachers
DOI:
10.1119/perc.2014.pr.003
PACSs:
01.40.Fk
01.50.H-
Keywords:
PERC 2014, computer tutor, computer-based instruction, force and motion, natural language
Record Creator:
Metadata instance created April 24, 2015 by Lyle Barbato
Record Updated:
June 1, 2015 by Lyle Barbato
Last Update
when Cataloged:
April 28, 2015
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
R. Badeau and A. Heckler, , presented at the Physics Education Research Conference 2014, Minneapolis, MN, 2014, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=13441&DocID=4040).
AJP/PRST-PER
R. Badeau and A. Heckler, Design and Evaluation of a Natural Language Tutor for Force and Motion, presented at the Physics Education Research Conference 2014, Minneapolis, MN, 2014, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=13441&DocID=4040>.
APA Format
Badeau, R., & Heckler, A. (2014, July 30-31). Design and Evaluation of a Natural Language Tutor for Force and Motion. Paper presented at Physics Education Research Conference 2014, Minneapolis, MN. Retrieved March 29, 2024, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=13441&DocID=4040
Chicago Format
Badeau, Ryan, and Andrew F. Heckler. "Design and Evaluation of a Natural Language Tutor for Force and Motion." Paper presented at the Physics Education Research Conference 2014, Minneapolis, MN, July 30-31, 2014. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=13441&DocID=4040 (accessed 29 March 2024).
MLA Format
Badeau, Ryan, and Andrew F. Heckler. "Design and Evaluation of a Natural Language Tutor for Force and Motion." Physics Education Research Conference 2014. Minneapolis, MN: 2014. 27-30 of PER Conference. 29 Mar. 2024 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=13441&DocID=4040>.
BibTeX Export Format
@inproceedings{ Author = "Ryan Badeau and Andrew F. Heckler", Title = {Design and Evaluation of a Natural Language Tutor for Force and Motion}, BookTitle = {Physics Education Research Conference 2014}, Pages = {27-30}, Address = {Minneapolis, MN}, Series = {PER Conference}, Month = {July 30-31}, Year = {2014} }
Refer Export Format

%A Ryan Badeau %A Andrew F. Heckler %T Design and Evaluation of a Natural Language Tutor for Force and Motion %S PER Conference %D July 30-31 2014 %P 27-30 %C Minneapolis, MN %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=13441&DocID=4040 %O Physics Education Research Conference 2014 %O July 30-31 %O application/pdf

EndNote Export Format

%0 Conference Proceedings %A Badeau, Ryan %A Heckler, Andrew F. %D July 30-31 2014 %T Design and Evaluation of a Natural Language Tutor for Force and Motion %B Physics Education Research Conference 2014 %C Minneapolis, MN %P 27-30 %S PER Conference %8 July 30-31 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=13441&DocID=4040


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Design and Evaluation of a Natural Language Tutor for Force and Motion:


Know of another related resource? Login to relate this resource to it.
Save to my folders

Contribute

Related Materials

Similar Materials