| How easily can omission of patients, or selection amongst poorly-reproducible measurements, create artificial correlations? Methods for detection and implications for observational research design in cardiology. | |
| | |
MedLine Citation:
|
PMID: 22285446 Owner: NLM Status: Publisher |
Abstract/OtherAbstract:
|
BACKGROUND: When reported correlation coefficients seem too high to be true, does investigative verification of source data provide suitable reassurance? This study tests how easily omission of patients or selection amongst irreproducible measurements generate fictitious strong correlations, without data fabrication. METHOD AND RESULTS: Two forms of manipulation are applied to a pair of normally-distributed, uncorrelated variables: first, exclusion of patients least favourable to a hypothesised association and, second, making multiple poorly-reproducible measurements per patient and choosing the most supportive. Excluding patients raises correlations powerfully, from 0.0±0.11 (no patients omitted) to 0.40±0.11 (one-fifth omitted), 0.59±0.08 (one-third omitted) and 0.78±0.05 (half omitted). Study size offers no protection: omitting just one-fifth of 75 patients (i.e. publishing 60) makes 92% of correlations statistically significant. Worse, simply selecting the most favourable amongst several measurements raises correlations from 0.0±0.12 (single measurement of each variable) to 0.73±0.06 (best of 2), and 0.90±0.03 (best of 4). 100% of correlation coefficients become statistically significant. Scatterplots may reveal a telltale "shave sign" or "bite sign". Simple statistical tests are presented for these suspicious signatures in single or multiple studies. CONCLUSION: Correlations are vulnerable to data manipulation. Cardiology is especially vulnerable to patient deletion (because cardiologists ourselves might completely control enrolment and measurement), and selection of "best" measurements (because alternative heartbeats are numerous, and some modalities poorly reproducible). Source data verification cannot detect these but tests might highlight suspicious data and - aggregating across studies - unreliable laboratories or research fields. Cardiological correlation research needs adequately-informed planning and guarantees of integrity, with teeth. |
| | |
Authors:
|
Darrel P Francis |
Related Documents
:
|
14509156 - Detection of hepatocyte growth factor/scatter factor receptor (c-met) and muc1 from the... 22888376 - Comparison of radiographic and surface topography measurements in adolescents with idio... 725626 - Diagnosis of lymphangitic carcinomatosis by transbronchial lung biopsy. 21762046 - Middle ear ventilation function in patients with myringoplasty alone and myringoplasty ... 15472596 - Patients with abdominal aortic aneurysm: are we missing the opportunity for cardiovascu... 7586606 - Vitamin d status in primary hyperparathyroidism in india. |
Publication Detail:
|
Type: JOURNAL ARTICLE Date: 2012-1-26 |
Journal Detail:
|
Title: International journal of cardiology Volume: - ISSN: 1874-1754 ISO Abbreviation: - Publication Date: 2012 Jan |
Date Detail:
|
Created Date: 2012-1-30 Completed Date: - Revised Date: - |
Medline Journal Info:
|
Nlm Unique ID: 8200291 Medline TA: Int J Cardiol Country: - |
Other Details:
|
Languages: ENG Pagination: - Citation Subset: - |
Copyright Information:
|
Copyright © 2011 Elsevier Ireland Ltd. All rights reserved. |
Export Citation:
|
APA/MLA Format Download EndNote Download BibTex |
| MeSH Terms | |
Descriptor/Qualifier:
|
|
From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine
Previous Document: Honey bees (Apis mellifera) reared in brood combs containing high levels of pesticide residues exhib...
Next Document: Cardioprotective effect of dipeptidyl peptidase-4 inhibitor during ischemia-reperfusion injury.