Detail Page

Physical Review Physics Education Research
written by John Hansen and John Stewart
This work is the fourth of a series of papers applying multidimensional item response theory (MIRT) to widely used physics conceptual assessments. This study applies MIRT analysis using both exploratory and confirmatory methods to the Brief Electricity and Magnetism Assessment (BEMA) to explore the assessment's structure and to determine a well-fitting model of student knowledge measured by the assessment. These methods were used to investigate a large dataset (N = 9666) from a research university in the United States. Exploratory analysis showed that a five-factor model had the best fit statistics; the items with the highest loadings in four of the five factors were items in the same item block. Confirmatory MIRT analysis fit a theoretical model developed from expert solutions to the instrument and identified two models with superior model fit: a principle model and a topical model. The principle model consisted of 28 principles, fundamental reasoning steps needed to solve items in the instrument; this was more principles than any of the models in the previous confirmatory MIRT studies of the Force Concept Inventory, the Force and Motion Conceptual Evaluation, and the Conceptual Survey of Electricity and Magnetism. A second model, the topical model, consisted of five general subtopics of electromagnetism. Both the principle and the topical model had excellent fit statistics; however, unlike the other conceptual instruments studied, the topical model had better fit statistics. The five topical divisions were explored as possible subscales; however, none of these subscales had a Cronbach's α of 0.7, the minimum value for required low-stakes testing, representing borderline internal consistency.
Physical Review Physics Education Research: Volume 17, Issue 2, Pages 020139
Subjects Levels Resource Types
Education Foundations
- Assessment
= Conceptual Assessment
= Instruments
- Research Design & Methodology
= Data
= Validity
Electricity & Magnetism
- General
General Physics
- Physics Education Research
- Upper Undergraduate
- Graduate/Professional
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- Administrators
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevPhysEducRes.17.020139
Keywords:
BEMA assessment, MIRT response theory, electricity-magnetism assessment
Record Creator:
Metadata instance created December 28, 2021 by Lyle Barbato
Record Updated:
October 24, 2022 by Lyle Barbato
Last Update
when Cataloged:
November 30, 2021
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
J. Hansen and J. Stewart, , Phys. Rev. Phys. Educ. Res. 17 (2), 020139 (2021), WWW Document, (https://doi.org/10.1103/PhysRevPhysEducRes.17.020139).
AJP/PRST-PER
J. Hansen and J. Stewart, Multidimensional item response theory and the Brief Electricity and Magnetism Assessment, Phys. Rev. Phys. Educ. Res. 17 (2), 020139 (2021), <https://doi.org/10.1103/PhysRevPhysEducRes.17.020139>.
APA Format
Hansen, J., & Stewart, J. (2021, November 30). Multidimensional item response theory and the Brief Electricity and Magnetism Assessment. Phys. Rev. Phys. Educ. Res., 17(2), 020139. Retrieved May 13, 2024, from https://doi.org/10.1103/PhysRevPhysEducRes.17.020139
Chicago Format
Hansen, John, and John Stewart. "Multidimensional item response theory and the Brief Electricity and Magnetism Assessment." Phys. Rev. Phys. Educ. Res. 17, no. 2, (November 30, 2021): 020139, https://doi.org/10.1103/PhysRevPhysEducRes.17.020139 (accessed 13 May 2024).
MLA Format
Hansen, John, and John Stewart. "Multidimensional item response theory and the Brief Electricity and Magnetism Assessment." Phys. Rev. Phys. Educ. Res. 17.2 (2021): 020139. 13 May 2024 <https://doi.org/10.1103/PhysRevPhysEducRes.17.020139>.
BibTeX Export Format
@article{ Author = "John Hansen and John Stewart", Title = {Multidimensional item response theory and the Brief Electricity and Magnetism Assessment}, Journal = {Phys. Rev. Phys. Educ. Res.}, Volume = {17}, Number = {2}, Pages = {020139}, Month = {November}, Year = {2021} }
Refer Export Format

%A John Hansen %A John Stewart %T Multidimensional item response theory and the Brief Electricity and Magnetism Assessment %J Phys. Rev. Phys. Educ. Res. %V 17 %N 2 %D November 30, 2021 %P 020139 %U https://doi.org/10.1103/PhysRevPhysEducRes.17.020139 %O application/pdf

EndNote Export Format

%0 Journal Article %A Hansen, John %A Stewart, John %D November 30, 2021 %T Multidimensional item response theory and the Brief Electricity and Magnetism Assessment %J Phys. Rev. Phys. Educ. Res. %V 17 %N 2 %P 020139 %8 November 30, 2021 %U https://doi.org/10.1103/PhysRevPhysEducRes.17.020139


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Multidimensional item response theory and the Brief Electricity and Magnetism Assessment:

Is Associated With Multidimensional item response theory and the Force Concept Inventory

Link to a study supervised at WVU by the same lead authors using Multidimensional Item Response Theory to analyze the Force Concept Inventory (FCI) assessment.

relation by Caroline Hall

Know of another related resource? Login to relate this resource to it.
Save to my folders

Contribute

Related Materials

Similar Materials