Document Detail

The inter-rater reliability and internal consistency of a clinical evaluation exercise.
MedLine Citation:
PMID:  1487766     Owner:  NLM     Status:  MEDLINE    
OBJECTIVE: To assess the internal consistency and inter-rater reliability of a clinical evaluation exercise (CEX) format that was designed to be easily utilized, but sufficiently detailed, to achieve uniform recording of the observed examination.
DESIGN: A comparison of 128 CEXs conducted for 32 internal medicine interns by full-time faculty. This paper reports alpha coefficients as measures of internal consistency and several measures of inter-rater reliability.
SETTING: A university internal medicine program. Observations were conducted at the end of the internship year.
PARTICIPANTS: Participants were 32 interns and observers were 12 full-time faculty in the department of medicine. The entire intern group was chosen in order to optimize the spectrum of abilities represented. Patients used for the study were recruited by the chief resident from the inpatient medical service based on their ability and willingness to participate.
INTERVENTION: Each intern was observed twice and there were two examiners during each CEX. The examiners were given a standardized preparation and used a format developed over five years of previous pilot studies.
MEASUREMENTS AND MAIN RESULTS: The format appeared to have excellent internal consistency; alpha coefficients ranged from 0.79 to 0.99. However, multiple methods of determining inter-rater reliability yielded similar results; intraclass correlations ranged from 0.23 to 0.50 and generalizability coefficients from a low of 0.00 for the overall rating of the CEX to a high of 0.61 for the physical examination section. Transforming scores to eliminate rater effects and dichotomizing results into pass-fail did not appear to enhance the reliability results.
CONCLUSIONS: Although the CEX is a valuable didactic tool, its psychometric properties preclude reliable assessment of clinical skills as a one-time observation.
F J Kroboth; B H Hanusa; S Parker; J L Coulehan; W N Kapoor; F H Brown; M Karpf; G S Levey
Related Documents :
24623066 - Can a combination of handgrip exercise and prolonged forearm occlusion elicit a maximal...
15486546 - Music preference and relaxation in taiwanese elderly people.
17009266 - Revised british isles lupus assessment group 2004 index: a reliable tool for assessment...
6594516 - Comparison of the multiphasic dysfunction profile with lateral transcranial radiographs.
18330406 - Osteoprotective knowledge in a multiethnic epilepsy population.
3663426 - Failure of propranolol to improve exercise tolerance in patients with mitral stenosis i...
Publication Detail:
Type:  Journal Article; Research Support, Non-U.S. Gov't    
Journal Detail:
Title:  Journal of general internal medicine     Volume:  7     ISSN:  0884-8734     ISO Abbreviation:  J Gen Intern Med     Publication Date:    1992 Mar-Apr
Date Detail:
Created Date:  1993-02-23     Completed Date:  1993-02-23     Revised Date:  2014-07-29    
Medline Journal Info:
Nlm Unique ID:  8605834     Medline TA:  J Gen Intern Med     Country:  UNITED STATES    
Other Details:
Languages:  eng     Pagination:  174-9     Citation Subset:  IM    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Clinical Competence*
Internship and Residency*
Medical History Taking
Observer Variation
Physical Examination
Reproducibility of Results

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Previous Document:  The relationship of presenting physical complaints to depressive symptoms in primary care patients.
Next Document:  Community hospital experience with recombinant tissue plasminogen activator in acute myocardial infa...