Document Detail


Objective structured assessment of technical skills and checklist scales reliability compared for high stakes assessments.
MedLine Citation:
PMID:  22943748     Owner:  NLM     Status:  Publisher    
Abstract/OtherAbstract:
BACKGROUND: The establishment of assessment reliability at the level of the individual trainee is an important attribute of assessment methodologies, particularly for doctors who have been failed. This issue is of particular importance for the process of competence assessment in the USA, UK, Australia and New Zealand. METHODS: We use data from 19 applicants for higher surgical training in 2008 at the Royal College of Surgeons in Ireland to compare: (i) the objective structured assessment of technical skills (OSATS) method; and (ii) a procedure-specific checklist to assess surgical technical skills in the excision of a sebaceous cyst task by two experienced senior surgeons. RESULTS: The overall interrater reliability (IRR) of the OSATS assessment as determined by a correlation coefficient was 0.507 (P < 0.03) and 0.67 with coefficient alpha, considerably below the accepted 0.8 level of IRR. The checklist's overall IRR was 0.89. Individually, only five (26%) of the OSATS assessments reached the 0.8 level of IRR in contrast to 18 (95%) of the checklist assessments. DISCUSSION: We propose binary procedure-based assessment checklists as more reliable assessment instruments with more robust reproducibility.
Authors:
Anthony G Gallagher; Gerald C O'Sullivan; Gerald Leonard; Brendan P Bunting; Kieran J McGlade
Related Documents :
21207938 - Modeling cellular pharmacokinetics of 14- and 15-membered macrolides with physicochemic...
24782678 - A pruning-based disk scheduling algorithm for heterogeneous i/o workloads.
21191628 - Growth-induced buckling of an epithelial layer.
25186778 - Which is the best predictor for oral cleanliness after brushing? results from an observ...
20105328 - Comparison of evolutionary algorithms in gene regulatory network model inference.
23868318 - Logical modelling of drosophila signalling pathways.
Publication Detail:
Type:  JOURNAL ARTICLE     Date:  2012-9-3
Journal Detail:
Title:  ANZ journal of surgery     Volume:  -     ISSN:  1445-2197     ISO Abbreviation:  ANZ J Surg     Publication Date:  2012 Sep 
Date Detail:
Created Date:  2012-9-4     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  101086634     Medline TA:  ANZ J Surg     Country:  -    
Other Details:
Languages:  ENG     Pagination:  -     Citation Subset:  -    
Copyright Information:
© 2012 The Authors. ANZ Journal of Surgery © 2012 Royal Australasian College of Surgeons.
Affiliation:
School of Medicine, University College Cork, Cork, Ireland; National Surgical Training Centre, Royal College of Surgeons in Ireland, Dublin, Ireland.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Molecular evolutionary and population genomic analysis of the nine-spined stickleback using a modifi...
Next Document:  [An epidemiological study of functional bowel disorders in Zhejiang college students and its relatio...