Detail Page

Balancing content of computerized adaptive testing for the Force Concept Inventory
written by Jun-ichiro Yasuda and Michael M. Hull
As a method to shorten the test time of the Force Concept Inventory (FCI), we previously suggested the use of Computerized Adaptive Testing (CAT). CAT is the process of administering a test on a computer, with items (i.e., questions) selected based upon the responses of the examinee to prior items. As a step to develop a CAT–based version of the FCI (FCI-CAT), we previously examined the optimal test length of the FCI-CAT such that accuracy and precision [which were measured in terms of root-mean-square error (RMSE)] of Cohen's d would be comparable to that of the full FCI for a given class size. The objective of this paper is to address an issue in our previous study to improve the FCI-CAT. We consider content balancing ensuring that the same set of concepts assessed in the original test is covered in the CAT administration for each respondent. To balance content in CAT, the percentage of items to be administered from each subgroup is defined in advance. Doing so ensures that items from each subgroup are administered. We conducted a Monte Carlo simulation to analyze how implementing an algorithm of content balancing affects the RMSE of Cohen's d. As a result, we found that, for a class size of 40, the increase of the RMSE due to content balancing is 6%-7% for test lengths of 2-5 items and less than 1% if the test length is larger than 13 items. This result indicates that for a sufficiently large test length (say, larger than 13 items), content balancing does not compromise the accuracy and precision of the FCI-CAT.  Hence, we recommend that the FCI-CAT incorporate content balancing, provided the test length is larger than 13 items.
Physics Education Research Conference 2021
Part of the PER Conference series
Virtual Conference: August 4-5, 2021
Pages 456-461
Subjects Levels Resource Types
Education Foundations
- Assessment
= Conceptual Assessment
= Instruments
= Methods
- Research Design & Methodology
= Evaluation
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- application/pdf
  • Currently 0.0/5

Want to rate this material?
Login here!


Mirror:
https://doi.org/10.1119/perc.2021…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:
American Association of Physics Teachers
JSPS KAKENHI Grant Number:
JP19K03135
DOI:
10.1119/perc.2021.pr.Yasuda
Keyword:
PERC 2021
Record Creator:
Metadata instance created October 4, 2021 by Lyle Barbato
Record Updated:
October 7, 2021 by Lyle Barbato
Last Update
when Cataloged:
October 10, 2021
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
J. Yasuda and M. Hull, , presented at the Physics Education Research Conference 2021, Virtual Conference, 2021, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=15797&DocID=5526).
AJP/PRST-PER
J. Yasuda and M. Hull, Balancing content of computerized adaptive testing for the Force Concept Inventory, presented at the Physics Education Research Conference 2021, Virtual Conference, 2021, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=15797&DocID=5526>.
APA Format
Yasuda, J., & Hull, M. (2021, August 4-5). Balancing content of computerized adaptive testing for the Force Concept Inventory. Paper presented at Physics Education Research Conference 2021, Virtual Conference. Retrieved May 21, 2024, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=15797&DocID=5526
Chicago Format
Yasuda, Jun-ichiro, and Michael Hull. "Balancing content of computerized adaptive testing for the Force Concept Inventory." Paper presented at the Physics Education Research Conference 2021, Virtual Conference, August 4-5, 2021. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=15797&DocID=5526 (accessed 21 May 2024).
MLA Format
Yasuda, Jun-ichiro, and Michael Hull. "Balancing content of computerized adaptive testing for the Force Concept Inventory." Physics Education Research Conference 2021. Virtual Conference: 2021. 456-461 of PER Conference. 21 May 2024 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=15797&DocID=5526>.
BibTeX Export Format
@inproceedings{ Author = "Jun-ichiro Yasuda and Michael Hull", Title = {Balancing content of computerized adaptive testing for the Force Concept Inventory}, BookTitle = {Physics Education Research Conference 2021}, Pages = {456-461}, Address = {Virtual Conference}, Series = {PER Conference}, Month = {August 4-5}, Year = {2021} }
Refer Export Format

%A Jun-ichiro Yasuda %A Michael Hull %T Balancing content of computerized adaptive testing for the Force Concept Inventory %S PER Conference %D August 4-5 2021 %P 456-461 %C Virtual Conference %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=15797&DocID=5526 %O Physics Education Research Conference 2021 %O August 4-5 %O application/pdf

EndNote Export Format

%0 Conference Proceedings %A Yasuda, Jun-ichiro %A Hull, Michael %D August 4-5 2021 %T Balancing content of computerized adaptive testing for the Force Concept Inventory %B Physics Education Research Conference 2021 %C Virtual Conference %P 456-461 %S PER Conference %8 August 4-5 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=15797&DocID=5526


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Balancing content of computerized adaptive testing for the Force Concept Inventory:


Know of another related resource? Login to relate this resource to it.
Save to my folders

Contribute

Related Materials

Similar Materials