Detail Page

Physical Review Physics Education Research
written by Jayson M. Nissen, Robin Donatello, and Ben Van Dusen
[This paper is part of the Focused Collection on Quantitative Methods in PER: A Critical Examination.] Physics education researchers (PER) commonly use complete-case analysis to address missing data. For complete-case analysis, researchers discard all data from any student who is missing any data. Despite its frequent use, no PER article we reviewed that used complete-case analysis provided evidence that the data met the assumption of missing completely at random necessary to ensure accurate results. Not meeting this assumption raises the possibility that prior studies have reported biased results with inflated gains that may obscure differences across courses. To test this possibility, we compared the accuracy of complete-case analysis and multiple imputation (MI) using simulated data. We simulated the data based on prior studies such that students who earned higher grades participated at higher rates, which made the data missing at random. PER studies seldom use MI, but MI uses all available data, has less stringent assumptions, and is more accurate and more statistically powerful than complete-case analysis. Results indicated that complete-case analysis introduced more bias than MI and this bias was large enough to obscure differences between student populations or between courses. We recommend that the PER community adopt the use of MI for handling missing data to improve the accuracy in research studies.
Physical Review Physics Education Research: Volume 15, Issue 2, Pages 020106
Subjects Levels Resource Types
Education Foundations
- Assessment
= Methods
- Research Design & Methodology
= Data
= Validity
General Physics
- Physics Education Research
- Graduate/Professional
- Reference Material
= Article
Intended Users Formats Ratings
- Researchers
- Professional/Practitioners
- Administrators
- application/pdf
- text/html
  • Currently 0.0/5

Want to rate this material?
Login here!


Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 3.0 license.
Rights Holder:
American Physical Society
DOI:
10.1103/PhysRevPhysEducRes.15.020106
NSF Number:
DUE-1525338
Keywords:
Missing-Completely-At-Random, bias, bias in research, casewise deletion, incomplete data, research bias
Record Creator:
Metadata instance created August 23, 2019 by Sam McKagan
Record Updated:
March 11, 2023 by Caroline Hall
Last Update
when Cataloged:
July 3, 2019
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
J. Nissen, R. Donatello, and B. Van Dusen, , Phys. Rev. Phys. Educ. Res. 15 (2), 020106 (2019), WWW Document, (https://doi.org/10.1103/PhysRevPhysEducRes.15.020106).
AJP/PRST-PER
J. Nissen, R. Donatello, and B. Van Dusen, Missing data and bias in physics education research: A case for using multiple imputation, Phys. Rev. Phys. Educ. Res. 15 (2), 020106 (2019), <https://doi.org/10.1103/PhysRevPhysEducRes.15.020106>.
APA Format
Nissen, J., Donatello, R., & Van Dusen, B. (2019, July 3). Missing data and bias in physics education research: A case for using multiple imputation. Phys. Rev. Phys. Educ. Res., 15(2), 020106. Retrieved April 29, 2024, from https://doi.org/10.1103/PhysRevPhysEducRes.15.020106
Chicago Format
Nissen, J, R. Donatello, and B. Van Dusen. "Missing data and bias in physics education research: A case for using multiple imputation." Phys. Rev. Phys. Educ. Res. 15, no. 2, (July 3, 2019): 020106, https://doi.org/10.1103/PhysRevPhysEducRes.15.020106 (accessed 29 April 2024).
MLA Format
Nissen, Jayson, Robin Donatello, and Ben Van Dusen. "Missing data and bias in physics education research: A case for using multiple imputation." Phys. Rev. Phys. Educ. Res. 15.2 (2019): 020106. 29 Apr. 2024 <https://doi.org/10.1103/PhysRevPhysEducRes.15.020106>.
BibTeX Export Format
@article{ Author = "Jayson Nissen and Robin Donatello and Ben Van Dusen", Title = {Missing data and bias in physics education research: A case for using multiple imputation}, Journal = {Phys. Rev. Phys. Educ. Res.}, Volume = {15}, Number = {2}, Pages = {020106}, Month = {July}, Year = {2019} }
Refer Export Format

%A Jayson Nissen %A Robin Donatello %A Ben Van Dusen %T Missing data and bias in physics education research: A case for using multiple imputation %J Phys. Rev. Phys. Educ. Res. %V 15 %N 2 %D July 3, 2019 %P 020106 %U https://doi.org/10.1103/PhysRevPhysEducRes.15.020106 %O application/pdf

EndNote Export Format

%0 Journal Article %A Nissen, Jayson %A Donatello, Robin %A Van Dusen, Ben %D July 3, 2019 %T Missing data and bias in physics education research: A case for using multiple imputation %J Phys. Rev. Phys. Educ. Res. %V 15 %N 2 %P 020106 %8 July 3, 2019 %U https://doi.org/10.1103/PhysRevPhysEducRes.15.020106


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Missing data and bias in physics education research: A case for using multiple imputation:

Is Part Of Focused Collection of Physical Review PER: Quantitative Methods in PER: A Critical Examination

A link to the full APS special collection on quantitative methods in PER, published in 2019.

relation by Caroline Hall

Know of another related resource? Login to relate this resource to it.
Save to my folders

Contribute

Related Materials

Similar Materials