Document Detail

Implementation of a journal peer reviewer stratification system based on quality and reliability.
MedLine Citation:
PMID:  20947204     Owner:  NLM     Status:  In-Data-Review    
STUDY OBJECTIVE: Before starting this study, Annals of Emergency Medicine had a large and unwieldy reviewer pool that demonstrated substantial variability in quality and reliability. We hypothesize that a tiered reviewer stratification system might enable our journal editors to target the bulk of their review invitations to our better reviewers and thus improve our efficiency.
METHODS: In 2003, we instituted a 3-tiered hierarchic classification for our reviewers and stratified them within these categories according to predefined criteria for reviewer quality and reliability. Our approximately 50 editors then targeted the bulk of their review invitations to the top performance tier.
RESULTS: Comparing 2009 data with 2002 (the year before the system), we found fewer late reviews (13% versus 32%) and fewer reviewers not used in a given year (28% versus 59%). More top-tier reviewer invitations led to an on-time review (48% versus 37%) in 2009 compared with 2002. Editors have found the system to be simple and easy to use. No serious problems have been identified.
CONCLUSION: Implementation of a tiered system stratifying journal peer reviewers by quality and reliability was readily accomplished by Annals and has appeared to improve the efficiency of our peer review.
Steven M Green; Michael L Callaham
Related Documents :
19182124 - Variation in scatterplot displays.
4081934 - Evaluation of medical students--repeatability of marking. agreement between two markers...
9676664 - Reliability of editors' subjective quality ratings of peer reviews of manuscripts.
7280034 - Sonority and syllabicity: acoustic correlates of perception.
22216384 - Soft tissue chondroma: a case report and literature review.
15884634 - Cutaneous intravascular papillary endothelial hyperplasia of the hand: a case report an...
Publication Detail:
Type:  Journal Article     Date:  2010-10-13
Journal Detail:
Title:  Annals of emergency medicine     Volume:  57     ISSN:  1097-6760     ISO Abbreviation:  Ann Emerg Med     Publication Date:  2011 Feb 
Date Detail:
Created Date:  2011-01-21     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  8002646     Medline TA:  Ann Emerg Med     Country:  United States    
Other Details:
Languages:  eng     Pagination:  149-152.e4     Citation Subset:  AIM; IM    
Copyright Information:
Copyright © 2010 American College of Emergency Physicians. Published by Mosby, Inc. All rights reserved.
Annals of Emergency Medicine, Dallas, TX; Department of Emergency Medicine, Loma Linda University, Loma Linda, CA.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Previous Document:  Iron deficiency in female pattern hair loss, chronic telogen effluvium, and control groups.
Next Document:  The clinical diagnosis of arrhythmias in patients presenting with palpitations.