Document Detail


The challenge of external validity in policy-relevant systematic reviews: a case study from the field of substance misuse.
MedLine Citation:
PMID:  19804458     Owner:  NLM     Status:  MEDLINE    
Abstract/OtherAbstract:
AIM: To critically evaluate the methods utilized in the conduct of a systematic review in the field of substance misuse. DESIGN: Participant-observation in the review process, semi-structured interviews with review team members and management and structured observation of the process of guidance development. SETTING: An 'arm's-length' government body. PARTICIPANTS: Review team members, management and the committee responsible for producing evidence-based guidance for policy and practice. MEASUREMENTS: Data from interviews and (participant-)observation were reflected upon critically in order to increase understanding of the systematic review process. FINDINGS: The application of systematic review methods produced an evidence base that did not inform the development of guidance to the extent that it could have done: (i) an emphasis upon internal research validity produced an evidence base with an emphasis on short-term interventions at the level of the individual; (ii) criteria for appraising the external validity of studies were not developed sufficiently; and (iii) the systematic review of evidence and development of guidance are strongly reliant upon the judgement of reviewers and committee members. CONCLUSIONS: Prioritizing internal validity in a systematic review risks producing an evidence base that is not informed adequately by the wider determinants of health and which does not give sufficient consideration to external validity. The use of appropriate methods requires that commissioners of systematic reviews are clear at the outset how the review is proposed to be utilized. Review methods such as meta-ethnography and realist synthesis could contribute to making the frameworks within which judgements are made more explicit.
Authors:
Mark Pearson; Ross Coomber
Related Documents :
18215308 - Estimating the accuracy of geographical imputation.
12808358 - Systematic reviews of herbal medicines--an annotated bibliography.
20334468 - Acute management of acquired brain injury part iii: an evidence-based review of interve...
19417748 - Systematic reviews: the good, the bad, and the ugly.
22557288 - Chemistry of kupipakwa rasayanas - a review.
16365498 - Missed diagnosis of triceps tendon rupture: a case report and review of literature.
Publication Detail:
Type:  Journal Article; Research Support, Non-U.S. Gov't     Date:  2009-10-05
Journal Detail:
Title:  Addiction (Abingdon, England)     Volume:  105     ISSN:  1360-0443     ISO Abbreviation:  Addiction     Publication Date:  2010 Jan 
Date Detail:
Created Date:  2010-01-18     Completed Date:  2010-05-14     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  9304118     Medline TA:  Addiction     Country:  England    
Other Details:
Languages:  eng     Pagination:  136-45     Citation Subset:  IM    
Affiliation:
Peninsula Technology Assessment Group (PenTAG), Peninsula Medical School, University of Exeter, Noy Scott House, Exeter, UK. mark.pearson@pms.ac.uk
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:
Adolescent
African Americans
Child
Child, Preschool
Cross-Cultural Comparison
Evidence-Based Medicine
Great Britain
Humans
Patient Education as Topic
Policy Making*
Practice Guidelines as Topic*
Program Evaluation / methods
Randomized Controlled Trials as Topic
Research / methods,  standards*
Research Design
Review Literature as Topic*
Social Environment
Substance-Related Disorders / prevention & control*
United States

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Smoker sensitivity to retail tobacco displays and quitting: a cohort study.
Next Document:  Influence of smoking cues in movies on craving among smokers.