Document Detail


Multiple choice questions can be designed or revised to challenge learners' critical thinking.
MedLine Citation:
PMID:  23288470     Owner:  NLM     Status:  Publisher    
Abstract/OtherAbstract:
Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to be challenging-perhaps especially when content experts must think like novices. Expertise in the domain (content) may actually impede the creation of higher-complexity items. Three cognitive psychology experts independently rated cognitive complexity for 252 multiple-choice physiology items using a six-level cognitive complexity matrix that was synthesized from the literature. Rasch modeling estimated item difficulties. The complexity ratings and difficulty estimates were then analyzed together to determine the relative contributions (and independence) of complexity and difficulty to the likelihood of correct answers on each item. Cognitive complexity was found to be statistically independent of difficulty estimates for 88 % of items. Using the complexity matrix, modifications were identified to increase some item complexities by one level, without affecting the item's difficulty. Cognitive complexity can effectively be rated by non-content experts. The six-level complexity matrix, if applied by faculty peer groups trained in cognitive complexity and without domain-specific expertise, could lead to improvements in the complexity targeted with item writing and revision. Targeting higher order thinking with MC questions can be achieved without changing item difficulties or other test characteristics, but this may be less likely if the content expert is left to assess items within their domain of expertise.
Authors:
Rochelle E Tractenberg; Matthew M Gushta; Susan E Mulroney; Peggy A Weissinger
Publication Detail:
Type:  JOURNAL ARTICLE     Date:  2013-1-4
Journal Detail:
Title:  Advances in health sciences education : theory and practice     Volume:  -     ISSN:  1573-1677     ISO Abbreviation:  Adv Health Sci Educ Theory Pract     Publication Date:  2013 Jan 
Date Detail:
Created Date:  2013-1-4     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  9612021     Medline TA:  Adv Health Sci Educ Theory Pract     Country:  -    
Other Details:
Languages:  ENG     Pagination:  -     Citation Subset:  -    
Affiliation:
Collaborative for Research on Outcomes and -Metrics and Departments of Neurology, Biostatistics, Bioinformatics & Biomathematics, and Psychiatry, Georgetown University Medical Center, Building D, Suite 207, 4000 Reservoir Rd. NW, Washington, DC, 20057, USA, rochelle.tractenberg@gmail.com.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  The effects of active metabolites on parameter estimation in linear mixed effect models of concentra...
Next Document:  From history to myth: productive engagement with the Flexnerian metanarrative in medical education.