Document Detail


Effects of item and rater characteristics on checklist recording: what should we look for?
MedLine Citation:
PMID:  16048628     Owner:  NLM     Status:  MEDLINE    
Abstract/OtherAbstract:
OBJECTIVE: Examinations based on using standardised patients (SPs) commonly use checklist recordings to evaluate students' clinical performance. This paper examines whether and to what extent item and rater characteristics affect the reliability of history checklist recording in an SP-based assessment. METHODS: Checklist items were reviewed for the presence or absence of 5 item characteristics and a 2-point versus 3-point scoring scale. Agreement between checklist recordings obtained from SPs and clinician-examiners (CEs) were compared by item characteristics, scoring scale and CEs' level of involvement in the assessment. RESULTS: Based on 3179 pairs of recordings, the overall percentage of agreement between SPs and CEs was 83% (kappa = 0.64). Agreement was significantly higher for items scored on a 2-point than on a 3-point scale, and when the CE was also the author and the trainer of the station. After controlling for other factors, item characteristics were only marginally associated with level of interrater agreement. CONCLUSIONS: This study suggests that attention should be paid to specific aspects of checklist development and checklist recording training when an SP or CE is used as recorder.
Authors:
Philippe Huber; Anne Baroffio; Eric Chamot; François Herrmann; Mathieu R Nendaz; Nu V Vu
Related Documents :
23095978 - Longitudinal infusion of a complex of insulin-like growth factor-i and igf-binding prot...
19493118 - Can parents accurately screen children at risk of developmental delay?
23886478 - Abm clinical protocol #18: guidelines for breastfeeding infants with cleft lip, cleft p...
10608908 - Participants' perceptions of dimensions of the therapeutic alliance over the course of ...
7781248 - Recent advances in parenteral nutrition.
10519348 - Early discharge of preterm infants needing limited special care, followed by domiciliar...
Publication Detail:
Type:  Journal Article    
Journal Detail:
Title:  Medical education     Volume:  39     ISSN:  0308-0110     ISO Abbreviation:  Med Educ     Publication Date:  2005 Aug 
Date Detail:
Created Date:  2005-07-28     Completed Date:  2005-09-22     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  7605655     Medline TA:  Med Educ     Country:  England    
Other Details:
Languages:  eng     Pagination:  852-8     Citation Subset:  IM    
Affiliation:
Unit of Development and Research in Medical Education, Faculty of Medicine, University of Geneva, Geneva, Switzerland. philippe.huber@medecine.unige.ch
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:
Clinical Competence / standards*
Education, Medical, Undergraduate*
Educational Measurement / methods*
Humans
Medical History Taking / standards
Physical Examination / standards
Students, Medical*
Teaching / methods

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Developing an education and assessment framework for the Foundation Programme.
Next Document:  Informal learning in postgraduate medical education: from cognitivism to 'culturism'.