Document Detail


On the plurality of (methodological) worlds: estimating the analytic flexibility of FMRI experiments.
MedLine Citation:
PMID:  23087605     Owner:  NLM     Status:  PubMed-not-MEDLINE    
Abstract/OtherAbstract:
How likely are published findings in the functional neuroimaging literature to be false? According to a recent mathematical model, the potential for false positives increases with the flexibility of analysis methods. Functional MRI (fMRI) experiments can be analyzed using a large number of commonly used tools, with little consensus on how, when, or whether to apply each one. This situation may lead to substantial variability in analysis outcomes. Thus, the present study sought to estimate the flexibility of neuroimaging analysis by submitting a single event-related fMRI experiment to a large number of unique analysis procedures. Ten analysis steps for which multiple strategies appear in the literature were identified, and two to four strategies were enumerated for each step. Considering all possible combinations of these strategies yielded 6,912 unique analysis pipelines. Activation maps from each pipeline were corrected for multiple comparisons using five thresholding approaches, yielding 34,560 significance maps. While some outcomes were relatively consistent across pipelines, others showed substantial methods-related variability in activation strength, location, and extent. Some analysis decisions contributed to this variability more than others, and different decisions were associated with distinct patterns of variability across the brain. Qualitative outcomes also varied with analysis parameters: many contrasts yielded significant activation under some pipelines but not others. Altogether, these results reveal considerable flexibility in the analysis of fMRI experiments. This observation, when combined with mathematical simulations linking analytic flexibility with elevated false positive rates, suggests that false positive results may be more prevalent than expected in the literature. This risk of inflated false positive rates may be mitigated by constraining the flexibility of analytic choices or by abstaining from selective analysis reporting.
Authors:
Joshua Carp
Related Documents :
15718695 - Predictive biosimulation and virtual patients in pharmaceutical r and d.
21385375 - 43 genes support the lungfish-coelacanth grouping related to the closest living relativ...
11397465 - Batch cultures of supplemented whey permeate using lactobacillus helveticus: unstructur...
24365695 - Calibration and validation of the actigraph gt3x+ in 2-3 year olds.
9228875 - Systematic and random error in repeated measurements of temporal and distance parameter...
11262975 - A new implementation and detailed study of breakpoint analysis.
Publication Detail:
Type:  Journal Article     Date:  2012-10-11
Journal Detail:
Title:  Frontiers in neuroscience     Volume:  6     ISSN:  1662-453X     ISO Abbreviation:  Front Neurosci     Publication Date:  2012  
Date Detail:
Created Date:  2012-10-22     Completed Date:  2012-10-23     Revised Date:  2013-08-13    
Medline Journal Info:
Nlm Unique ID:  101478481     Medline TA:  Front Neurosci     Country:  Switzerland    
Other Details:
Languages:  eng     Pagination:  149     Citation Subset:  -    
Affiliation:
Department of Psychology, University of Michigan Ann Arbor, MI, USA.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:
Comments/Corrections

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Effects of direct social experience on trust decisions and neural reward circuitry.
Next Document:  Do not Bet on the Unknown Versus Try to Find Out More: Estimation Uncertainty and "Unexpected Uncert...