Document Detail

Is Competency Assessment at the Specialist Level Achievable? A Study for the National Training Programme in Laparoscopic Colorectal Surgery in England.
MedLine Citation:
PMID:  23386240     Owner:  NLM     Status:  Publisher    
OBJECTIVES:: To develop, validate, and implement a competency assessment tool (CAT) for technical surgical performance in the context of a summative assessment process for the National Training Programme in Laparoscopic Colorectal Surgery (NTP). BACKGROUND:: The NTP is an educational initiative by the National Cancer Action Team in England to safely increase the uptake of laparoscopic colorectal surgery. It is the first competency-based national educational initiative for specialist surgeons (consultants), and performance assessment is an integral part of the program. METHODS:: Content validity was sought using expert opinion by semistructured interviews and the Delphi method. For validity and reliability studies, NTP apprentices and experts were asked to submit video-recorded cases. Construct validity was established between delegates who passed the assessment and those who failed. Concurrent validity was tested by comparing scores with error counts as identified by observational clinical human reliability analysis. A fully crossed design, using generalizability theory methods and D-studies, was used for reliability. FINDINGS:: Interviews and the Delphi method revealed a list of characteristics for assessment. A hybrid structure combining task-specific and generic items was used to include important characteristics into the assessment format. Fifty-four cases were submitted. Overall reliability reached G(ACI) = 0.803 when using 2 cases and 2 assessors. Experts scored significantly better than apprentices (3.19 vs 2.60; P = 0.004), and apprentices who passed had better scores than those who failed (2.95 vs 2.28; P < 0.001). There was an inverse correlation between CAT scores and observational clinical human reliability analysis error counts (ρ = -0.520, P < 0.001). The combination of both methods reached overall sensitivity of 100%, specificity of 83.3%, a positive predictive value of 93.8%, and a negative predictive value of 100%. CONCLUSIONS:: The CAT can reliably assess technical performance in laparoscopic colorectal surgery. The use of CATs to judge specialist technical performance before embarking on independent practice of new procedures is achievable on a national scale and can be adapted by other specialties.
Danilo Miskovic; Melody Ni; Susannah M Wyles; Robin H Kennedy; Nader K Francis; Amjad Parvaiz; Chris Cunningham; Timothy A Rockall; Andrew M Gudgeon; Mark G Coleman; George B Hanna
Publication Detail:
Journal Detail:
Title:  Annals of surgery     Volume:  257     ISSN:  1528-1140     ISO Abbreviation:  Ann. Surg.     Publication Date:  2013 Mar 
Date Detail:
Created Date:  2013-2-6     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  0372354     Medline TA:  Ann Surg     Country:  -    
Other Details:
Languages:  ENG     Pagination:  476-482     Citation Subset:  -    
*Department of Surgery and Cancer, St Mary's Hospital, Imperial College London, London †St Mark's Hospital, Harrow ‡Department of Surgery, Yeovil District Hospital Foundation Trust Higher Kensington, Yeovil §Department of Colorectal Surgery, Queen Alexandra Hospital, Portsmouth Hospitals NHS, Portsmouth ¶Department of Colorectal Surgery, Oxford Radcliffe Hospitals, Oxford ‖Minimal Access Therapy Training Unit (MATTU), Post-Graduate Medical School, University of Surrey, Guildford **Department of Surgery, Frimley Park Hospital NHS Trust, Frimley ††National Coordination Office, Derriford Hospital, Plymouth, United Kingdom.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Previous Document:  Randomized prospective study to compare laparoscopic appendectomy versus umbilical single-incision a...
Next Document:  Predictors of nursing home admission, severe functional impairment, or death one year after surgery ...