Document Detail


Is expert peer review obsolete? A model suggests that post-publication reader review may exceed the accuracy of traditional peer review.
MedLine Citation:
PMID:  22350231     Owner:  NLM     Status:  Publisher    
Abstract/OtherAbstract:
BACKGROUND: The peer review process is the gold standard by which academic manuscripts are vetted for publication. However, some investigators have raised concerns regarding its unopposed supremacy, including lack of expediency, susceptibility to editorial bias and statistical limitation due to the small number of reviewers used. Post-publication review-in which the article is assessed by the general readership of the journal instead of a small group of appointed reviewers-could potentially supplement or replace the peer-review process. In this study, we created a computer model to compare the traditional peer-review process to that of post-publication reader review. METHODS: We created a mathematical model of the manuscript review process. A hypothetical manuscript was randomly assigned a "true value" representing its intrinsic quality. We modeled a group of three expert peer reviewers and compared it to modeled groups of 10, 20, 50, or 100 reader-reviewers. Reader-reviewers were assumed to be less skillful at reviewing and were thus modeled to be only ¼ as accurate as expert reviewers. Percentage of correct assessments was calculated for each group. RESULTS: 400,000 hypothetical manuscripts were modeled. The accuracy of the reader-reviewer group was inferior to the expert reviewer group in the 10-reviewer trial (93.24% correct vs. 97.67%, p < 0.0001) and the 20-reviewer trial (95.50% correct, p < 0.0001). However, the reader-reviewer group surpassed the expert reviewer group in accuracy when 50 or 100 reader-reviewers were used (97.92 and 99.20% respectively, p < 0.0001). CONCLUSIONS: In a mathematical model of the peer review process, the accuracy of public reader-reviewers can surpass that of a small group of expert reviewers if the group of public reviewers is of sufficient size. Further study will be required to determine whether the mathematical assumptions of this model are valid in actual use.
Authors:
Daniel M Herron
Publication Detail:
Type:  JOURNAL ARTICLE     Date:  2012-2-21
Journal Detail:
Title:  Surgical endoscopy     Volume:  -     ISSN:  1432-2218     ISO Abbreviation:  -     Publication Date:  2012 Feb 
Date Detail:
Created Date:  2012-2-21     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  8806653     Medline TA:  Surg Endosc     Country:  -    
Other Details:
Languages:  ENG     Pagination:  -     Citation Subset:  -    
Affiliation:
Mount Sinai School of Medicine, 1 Gustave L. Levy Place, #1259, New York, NY, 10029, USA, daniel.herron@mountsinai.org.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Nanoscale iodized oil emulsion: a useful tracer for pretreatment sentinel node detection using CT ly...
Next Document:  Open versus laparoscopic pyloromyotomy for hypertrophic pyloric stenosis: a systematic review and me...