Document Detail


Quantitative validation of a general competency composite assessment evaluation.
MedLine Citation:
PMID:  15289197     Owner:  NLM     Status:  MEDLINE    
Abstract/OtherAbstract:
OBJECTIVES: The authors sought to modify and validate a composite assessment evaluation process that assesses resident acquisition of the Accreditation Council for Graduate Medical Education (ACGME) general competencies (GCs). METHODS:This study critically analyzed the evaluation process used in a multicenter study (150 emergency medicine resident evaluations) to determine whether the procedure was psychometrically valid. For each GC, principal component analysis (PCA) was used to determine whether certain evaluation items could be eliminated, as well as to determine the magnitude of variability explained by up to three linear combinations or "principal components." The factor proportions (factor loadings) of various eigenvectors were measured to determine the degree of variability (determined by the square of the factor proportion) within a data or item set. The factor proportions essentially measure the length of the eigenvector as determined from a correlation matrix. RESULTS: The first three principal components are reported as factor proportion sum (% of total variability) as follows: patient care 0.91 (83%), medical knowledge 0.87 (76%), practice-based learning and improvement 0.90 (81%), interpersonal and communication skills 0.84 (71%), professionalism 0.74 (55%), and systems-based practice 0.80 (64%). PCA showed that evaluating certain traditional categories such as medical knowledge seemed to capture a single element, whereas professionalism appeared to measure a more complex, multidimensional phenomenon. CONCLUSIONS: By using a structured development process, the authors were able to create valid evaluation items for determining resident acquisition of the ACGME GCs.
Authors:
Earl J Reisdorff; Dale J Carlson; Mat Reeves; Gregory Walker; Oliver W Hayes; Brian Reynolds
Related Documents :
3301107 - Androgenic alopecia.
18446477 - Development of lapachol topical formulation: anti-inflammatory study of a selected form...
3603267 - Selection of medical students--are interview evaluations consistent?
16514577 - Radiology of shoulder prostheses.
16797267 - Public knowledge and attitudes on organ donation do not differ in germany and spain.
3375167 - Comparison of commercial diluents for holding turkey semen 24 hours at 5 c.
Publication Detail:
Type:  Evaluation Studies; Journal Article; Multicenter Study; Validation Studies    
Journal Detail:
Title:  Academic emergency medicine : official journal of the Society for Academic Emergency Medicine     Volume:  11     ISSN:  1069-6563     ISO Abbreviation:  Acad Emerg Med     Publication Date:  2004 Aug 
Date Detail:
Created Date:  2004-08-03     Completed Date:  2004-11-04     Revised Date:  2004-11-17    
Medline Journal Info:
Nlm Unique ID:  9418450     Medline TA:  Acad Emerg Med     Country:  United States    
Other Details:
Languages:  eng     Pagination:  881-4     Citation Subset:  IM    
Affiliation:
Michigan State University Emergency Medicine Residency Lansing, Lansing, MI 48910, USA. reisdoe@irmcmail.irmc.org
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:
Clinical Competence*
Cross-Sectional Studies
Education, Medical, Graduate / methods*
Educational Measurement / methods*
Emergency Medicine / education*
Humans
Internship and Residency / methods*
Principal Component Analysis
Program Evaluation / standards*
Psychometrics
United States

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Basic cardiac life support providers checking the carotid pulse: performance, degree of conviction, ...
Next Document:  The saliva strip test is an accurate method to determine blood alcohol concentration in trauma patie...