Document Detail


Reliability and learning from the objective structured clinical examination.
MedLine Citation:
PMID:  2355864     Owner:  NLM     Status:  MEDLINE    
Abstract/OtherAbstract:
The difficulties in measurement of the clinical performance of students in the health professions are well known by educators. One innovative measure incorporated in several of the educational programmes, including the BSc in Nursing programme, in the Faculty of Health Sciences, at McMaster University, Hamilton, Ontario, Canada is the objective structured clinical examination (OSCE). The purpose of this study was to determine the reliability of this evaluation method, both within and between stations. One problem that has been noted by users of the OSCE method is that performance on individual OSCE stations is poorly correlated across stations, apparently regardless of the particular content of the station. A number of hypotheses have been advanced to attempt to explain this phenomenon: performance of any skill is sufficiently variable that the correlation is poor; different skills have little common basis, so that there is no generalizability from one to another, or reliability of assessment in any one station is low. To test these hypotheses, a study was designed for test-retest and interrater reliability. Students undergoing a 10-station OSCE also repeated their starting OSCE station at the end of the examination circuit. In addition, several stations were rated by more than one observer (interrater). This study of 71 first-year BScN students showed that the interrater reliability was high (ICC = 0.80 to 0.99), and test-retest reliability on the same station was good (ICC = 0.66 to 0.86); however, correlation across stations was low (alpha = 0.198). Thus it is apparent that there is high consistency of repeated performance of a skill but little consistency of performance on different skills.
Authors:
J Roberts; G Norman
Related Documents :
7568604 - Convergent validity of the depression-happiness scale with measures of happiness and sa...
1265554 - Misconceptions and miscarriages in multiple choice questions.
19062464 - Essay, multiple-choice (mcq) and combined (essay with mcq) type examinations: the pharm...
16205824 - Critiques on the objective structured clinical examination.
3529464 - Actuarial status of the hi and smi trust funds.
16681134 - Developing systems interventions in a school setting: an application of community-based...
Publication Detail:
Type:  Journal Article    
Journal Detail:
Title:  Medical education     Volume:  24     ISSN:  0308-0110     ISO Abbreviation:  Med Educ     Publication Date:  1990 May 
Date Detail:
Created Date:  1990-07-20     Completed Date:  1990-07-20     Revised Date:  2004-11-17    
Medline Journal Info:
Nlm Unique ID:  7605655     Medline TA:  Med Educ     Country:  ENGLAND    
Other Details:
Languages:  eng     Pagination:  219-23     Citation Subset:  IM    
Affiliation:
Department of Clinical Epidemiology and Biostatistics, Faculty of Health Sciences, School of Nursing, McMaster University, Hamilton, Ontario, Canada.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:
Clinical Competence / standards*
Education, Nursing*
Humans
Learning
Methods
Ontario
Reproducibility of Results
Students, Nursing

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Academic performance of students admitted after repeating entrance examinations to medical school.
Next Document:  Undergraduate medical education in obstetrics and gynaecology in the USA and Canada, 1985.