Document Detail

Empirical assessment of methods for risk identification in healthcare data: results from the experiments of the Observational Medical Outcomes Partnership.
MedLine Citation:
PMID:  23015364     Owner:  NLM     Status:  Publisher    
Background: Expanded availability of observational healthcare data (both administrative claims and electronic health records) has prompted the development of statistical methods for identifying adverse events associated with medical products, but the operating characteristics of these methods when applied to the real-world data are unknown. Methods: We studied the performance of eight analytic methods for estimating of the strength of association-relative risk (RR) and associated standard error of 53 drug-adverse event outcome pairs, both positive and negative controls. The methods were applied to a network of ten observational healthcare databases, comprising over 130 million lives. Performance measures included sensitivity, specificity, and positive predictive value of methods at RR thresholds achieving statistical significance of p < 0.05 or p < 0.001 and with absolute threshold RR > 1.5, as well as threshold-free measures such as area under receiver operating characteristic curve (AUC). Results: Although no specific method demonstrated superior performance, the aggregate results provide a benchmark and baseline expectation for risk identification method performance. At traditional levels of statistical significance (RR > 1, p < 0.05), all methods have a false positive rate >18%, with positive predictive value <38%. The best predictive model, high-dimensional propensity score, achieved an AUC  =  0.77. At 50% sensitivity, false positive rate ranged from 16% to 30%. At 10% false positive rate, sensitivity of the methods ranged from 9% to 33%. Conclusions: Systematic processes for risk identification can provide useful information to supplement an overall safety assessment, but assessment of methods performance suggests a substantial chance of identifying false positive associations. Copyright © 2012 John Wiley & Sons, Ltd.
Patrick B Ryan; David Madigan; Paul E Stang; J Marc Overhage; Judith A Racoosin; Abraham G Hartzema
Related Documents :
24962314 - Effects of recent environmental change on accuracy of inferences of extinction status.
3952144 - A model for the kinetics of potassium in healthy humans.
7830134 - A modeling method to improve quantitation of fluorodeoxyglucose uptake in heterogeneous...
23727534 - Phycaa+: an optimized, adaptive procedure for measuring and controlling physiological n...
15044244 - Supervised cluster analysis for microarray data based on multivariate gaussian mixture.
23026724 - Phenotypic models of evolution and development: geometry as destiny.
Publication Detail:
Type:  JOURNAL ARTICLE     Date:  2012-9-27
Journal Detail:
Title:  Statistics in medicine     Volume:  -     ISSN:  1097-0258     ISO Abbreviation:  Stat Med     Publication Date:  2012 Sep 
Date Detail:
Created Date:  2012-9-27     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  8215016     Medline TA:  Stat Med     Country:  -    
Other Details:
Languages:  ENG     Pagination:  -     Citation Subset:  -    
Copyright Information:
Copyright © 2012 John Wiley & Sons, Ltd.
Johnson & Johnson Pharmaceutical Research and Development LLC, Titusville, NJ, U.S.A.; Observational Medical Outcomes Partnership, Foundation for the National Institutes of Health, Bethesda, MD, U.S.A.; UNC Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill, NC, U.S.A.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Previous Document:  Use of joint commission international standards to evaluate and improve pediatric oncology nursing c...
Next Document:  NAVA enhances tidal volume and diaphragmatic electro-myographic activity matching: a Range90 analysi...