Document Detail

Objective structured assessment of technical skills and checklist scales reliability compared for high stakes assessments.
MedLine Citation:
PMID:  22943748     Owner:  NLM     Status:  Publisher    
BACKGROUND: The establishment of assessment reliability at the level of the individual trainee is an important attribute of assessment methodologies, particularly for doctors who have been failed. This issue is of particular importance for the process of competence assessment in the USA, UK, Australia and New Zealand. METHODS: We use data from 19 applicants for higher surgical training in 2008 at the Royal College of Surgeons in Ireland to compare: (i) the objective structured assessment of technical skills (OSATS) method; and (ii) a procedure-specific checklist to assess surgical technical skills in the excision of a sebaceous cyst task by two experienced senior surgeons. RESULTS: The overall interrater reliability (IRR) of the OSATS assessment as determined by a correlation coefficient was 0.507 (P < 0.03) and 0.67 with coefficient alpha, considerably below the accepted 0.8 level of IRR. The checklist's overall IRR was 0.89. Individually, only five (26%) of the OSATS assessments reached the 0.8 level of IRR in contrast to 18 (95%) of the checklist assessments. DISCUSSION: We propose binary procedure-based assessment checklists as more reliable assessment instruments with more robust reproducibility.
Anthony G Gallagher; Gerald C O'Sullivan; Gerald Leonard; Brendan P Bunting; Kieran J McGlade
Related Documents :
16795558 - A durable recording and feedback system.
17240398 - Control of streptococcus pyogenes virulence: modeling of the covr/s signal transduction...
23786768 - Quikr: a method for rapid reconstruction of bacterial communities via compressive sensing.
18025728 - Stochastic approach for performance evaluation regarding water distribution systems.
12396518 - Behavioural models of population growth rates: implications for conservation and predic...
25353008 - Current limitations of murine models in oncology for ascorbate research.
Publication Detail:
Type:  JOURNAL ARTICLE     Date:  2012-9-3
Journal Detail:
Title:  ANZ journal of surgery     Volume:  -     ISSN:  1445-2197     ISO Abbreviation:  ANZ J Surg     Publication Date:  2012 Sep 
Date Detail:
Created Date:  2012-9-4     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  101086634     Medline TA:  ANZ J Surg     Country:  -    
Other Details:
Languages:  ENG     Pagination:  -     Citation Subset:  -    
Copyright Information:
© 2012 The Authors. ANZ Journal of Surgery © 2012 Royal Australasian College of Surgeons.
School of Medicine, University College Cork, Cork, Ireland; National Surgical Training Centre, Royal College of Surgeons in Ireland, Dublin, Ireland.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Previous Document:  Molecular evolutionary and population genomic analysis of the nine-spined stickleback using a modifi...
Next Document:  [An epidemiological study of functional bowel disorders in Zhejiang college students and its relatio...