| The second time around: accounting for retest effects on oral examinations. | |
| | |
MedLine Citation:
|
PMID: 20801978 Owner: NLM Status: In-Process |
Abstract/OtherAbstract:
|
Years of research with high-stakes written tests indicates that although repeat examinees typically experience score gains between their first and subsequent attempts, their pass rates remain considerably lower than pass rates for first-time examinees. This outcome is consistent with expectations. Comparable studies of the performance of repeat examinees on oral examinations are lacking. The current research evaluated pass rates for more than 50,000 examinees on written and oral exams administered by six medical specialty boards for several recent years. Pass rates for first-time examinees were similar for both written and oral exams, averaging about 84% across all boards. Pass rates for repeat examinees on written exams were expectedly lower, ranging from 22% to 51%, with an average of 36%. However, pass rates for repeat examinees on oral exams were markedly higher than for written exams, ranging from 53% to 77%, with an average of 65%. Four explanations for the elevated repeat pass rates on oral exams are proposed, including an increase in examinee proficiency, construct-irrelevant variance, measurement error (score unreliability), and memorization of test content. Simulated data are used to demonstrate that roughly one third of the score increase can be explained by measurement error alone. The authors suggest that a substantial portion of the score increase can also likely be attributed to construct-irrelevant variance. Results are discussed in terms of their implications for making pass-fail decisions when retesting is allowed. The article concludes by identifying areas for future research. |
| | |
Authors:
|
Mark R Raymond; Ulana A Luciw-Dubas |
Related Documents
:
|
22346438 - Pharmacokinetic properties of clarithromycin: a comparison with erythromycin and azithr... 16196228 - Latino oral health: a research agenda toward eliminating oral health disparities. 22483508 - The use of executed nazi victims in anatomy: findings from the institute of anatomy at ... 21108618 - Retraction: evaluation of carcinogenic effects of electromagnetic fields (emf). 22268898 - Evidence-based practice: slts under siege or opportunity for growth? the use and nature... 17576018 - Symbiotic microorganisms: untapped resources for insect pest control. |
Publication Detail:
|
Type: Journal Article |
Journal Detail:
|
Title: Evaluation & the health professions Volume: 33 ISSN: 1552-3918 ISO Abbreviation: Eval Health Prof Publication Date: 2010 Sep |
Date Detail:
|
Created Date: 2010-08-30 Completed Date: - Revised Date: - |
Medline Journal Info:
|
Nlm Unique ID: 7805992 Medline TA: Eval Health Prof Country: United States |
Other Details:
|
Languages: eng Pagination: 386-403 Citation Subset: H; T |
Affiliation:
|
National Board of Medical Examiners, Philadelphia, PA, USA. mraymond@nbme.org |
Export Citation:
|
APA/MLA Format Download EndNote Download BibTex |
| MeSH Terms | |
Descriptor/Qualifier:
|
|
From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine
Previous Document: Assessing implicit gender bias in Medical Student Performance Evaluations.
Next Document: Pregnant asylum seekers.