Document Detail

The inter-rater and intra-rater reliability of a new Canadian oral examination format in anesthesia is fair to good.
MedLine Citation:
PMID:  11861339     Owner:  NLM     Status:  MEDLINE    
PURPOSE: In response to the Royal College's request to improve the validity and reliability of oral examinations, the Examination Board in anesthesia proposed a structured oral examination format. Prior to its introduction, we studied this format in two residency programs to determine reliability of the examiners. METHODS: Twenty faculty and 26 residents from two Canadian residency programs participated (Sites A and B). Pairs of examiners scored five or six residents examined consecutively on two standardized questions using global rating scales with anchored performance criteria. Residents' performances were scored independently during the examination (Time 1) and later from a videotaped recording (Time 2). Correlations between scores of the pairs of examiners and between scores of each examiner were determined. RESULTS: Correlations demonstrating inter-rater agreement between examiners at Site A ranged from -.324 to.915 (mean.506) at Time 1. At Time 2, correlations ranged from.64 to.887 (mean.791). At Site B correlations ranged from.279 to.989 (mean.707) at Time 1 and at Time 2 correlations ranged from -.271 to.924 (mean.477). Correlations demonstrating intra-rater agreement of examiners at Site A ranged from.054 to.983 (mean.723) and at Site B correlations ranged from -.055 to.974 (mean.662). Correlations >0.4 were seen in 80% of the scores and >0.7 in 50% indicating fair to good intra-rater and inter-rater reliability using this format. CONCLUSIONS: Despite the limitations of our study our results compare favourably with those previously reported in anesthesia. We recommend the adoption of this format to the Royal College of Physicians and Surgeons of Canada Examination Board.
Ramona A Kearney; Stephen A Puchalski; Homer Y H Yang; Ernest N Skakun
Related Documents :
24531439 - Dynamic compression enhances pressure-to-pain threshold in elite athlete recovery: expl...
24908049 - Adherence to and effectiveness of an individually tailored home-based exercise program ...
24219189 - Motor learning versus standard walking exercise in older adults with subclinical gait d...
24790499 - Comparative kinematic analysis of the snatch lifts in elite male adolescent weightlifters.
10710859 - Preliminary testing of the episode-specific interpretations of exercise inventory.
23284879 - A meta-analysis of core stability exercise versus general exercise for chronic low back...
8161959 - Quantitative evaluation of aerosol deposition pattern in the lung in patients with chro...
6505989 - A standardised method of estimating kco on exercise.
25489 - Comparison of cardiovascular responses and left ventricular work during exercise before...
Publication Detail:
Type:  Journal Article    
Journal Detail:
Title:  Canadian journal of anaesthesia = Journal canadien d'anesthésie     Volume:  49     ISSN:  0832-610X     ISO Abbreviation:  Can J Anaesth     Publication Date:  2002 Mar 
Date Detail:
Created Date:  2002-02-25     Completed Date:  2002-06-12     Revised Date:  2004-11-17    
Medline Journal Info:
Nlm Unique ID:  8701709     Medline TA:  Can J Anaesth     Country:  Canada    
Other Details:
Languages:  eng     Pagination:  232-6     Citation Subset:  IM    
Department of Anesthesia and Pain Medicine, University of Alberta, Edmonton, Alberta, Canada.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Diagnosis, Oral*

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Previous Document:  Involvement of caspases and calpains in cerebrocortical neuronal cell death is stimulus-dependent.
Next Document:  Apfel's simplified score may favourably predict the risk of postoperative nausea and vomiting.