|Validity of meta-analysis in diabetes: meta-analysis is an indispensable tool in evidence synthesis.|
|Jump to Full Text|
|PMID: 24065845 Owner: NLM Status: MEDLINE|
|Sherita Hill Golden; Eric B Bass|
Related Documents :
|24259405 - Intensive palliative care for patients with hematological cancer dying in hospice: anal...
24836515 - Does stewardship make a difference in the quality of care? evidence from clinics and ph...
24128615 - The role of medical school culture in primary care career choice.
24673805 - Gastrointestinal motility problems in critical care: a clinical perspective.
24362655 - Stroke mortality in intensive care unit from tertiary care neurological center.
6623255 - Penetrating cardiac injuries.
|Type: Journal Article|
|Title: Diabetes care Volume: 36 ISSN: 1935-5548 ISO Abbreviation: Diabetes Care Publication Date: 2013 Oct|
|Created Date: 2013-09-25 Completed Date: 2014-04-23 Revised Date: 2014-10-09|
Medline Journal Info:
|Nlm Unique ID: 7805975 Medline TA: Diabetes Care Country: United States|
|Languages: eng Pagination: 3368-73 Citation Subset: IM|
|APA/MLA Format Download EndNote Download BibTex|
Meta-Analysis as Topic
Journal ID (nlm-ta): Diabetes Care
Journal ID (iso-abbrev): Diabetes Care
Journal ID (hwp): diacare
Journal ID (pmc): dcare
Journal ID (publisher-id): Diabetes Care
Publisher: American Diabetes Association
© 2013 by the American Diabetes Association.
Print publication date: Month: 10 Year: 2013
Electronic publication date: Day: 14 Month: 9 Year: 2013
Volume: 36 Issue: 10
First Page: 3368 Last Page: 3373
PubMed Id: 24065845
Publisher Id: 1196
|Validity of Meta-analysis in Diabetes: Meta-analysis Is an Indispensable Tool in Evidence Synthesis|
|Sherita Hill Golden, MD, MHS12|
|Eric B. Bass, MD, MPH1234|
1Department of Medicine, Division of Endocrinology, Diabetes, and Metabolism, and Division of General Internal Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland
2Department of Epidemiology, Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland
3Department of Health Policy and Management, Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland
4Johns Hopkins University Evidence-Based Practice Center, Baltimore, Maryland.
|Correspondence: Corresponding author: Sherita Hill Golden, firstname.lastname@example.org.
In an evidence-based approach to clinical care, the evidence from clinical research should be integrated with clinical expertise, pathophysiological knowledge, and an understanding of patient values (1). Some advocates of evidence-based medicine argue that the best evidence comes from systematic reviews of all relevant studies, and they place systematic reviews at the top of the evidence pyramid (Fig. 1). As outlined by Dr. Home in the point narrative (2), we acknowledge that there are limitations and biases associated with the systematic review and meta-analysis process. However, for the purpose of this discussion, we take the view that this process is an indispensable tool in evidence synthesis. In our counterpoint highlighting the critical role of systematic review and meta-analysis in diabetes research and clinical practice, we will 1) review how to ensure that a systematic review follows a scientifically rigorous process for minimizing errors or bias, 2) explain how a systematic review adds to what is known from randomized controlled trials (RCTs), and 3) give examples of how a rigorous systematic review and meta-analysis can and has guided clinical decision making in diabetes care.
According to the definitions used by The Cochrane Collaboration, a systematic review is the process of collecting, reviewing, and presenting all available evidence related to a clearly formulated question that uses systematic and explicit methods (3,4). Meta-analysis is the statistical technique for extracting and combining data to produce a summary result of the included studies (3,4). Depending on the presentation and heterogeneity of the data, a systematic review may or may not include a meta-analysis.
Guidelines have been developed to guide the performance of systematic reviews because of concerns about inconsistent methods and the potential for introducing bias and error in the review process as already discussed by Home. In 1996, an international group developed the QUOROM Statement (QUality Of Reporting Of Meta-analyses) for reporting of meta-analyses of RCTs (5). A similar set of guidelines for reporting meta-analyses of observational studies, MOOSE (Meta-analysis Of Observational Studies in Epidemiology) guidelines, was published in 2000 (6). In 2009, the QUORUM statement was revised, updated, and renamed the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) statement to address several conceptual and practical advances in the science of systematic reviews (3). The PRISMA statement emphasizes 1) the iterative process of conducting a systematic review, 2) that conduct and reporting of the research are distinct processes, 3) the importance of study level versus outcome level risk of bias assessment, and 4) the importance of reporting bias (3). The goal of the PRISMA statement is to help authors improve reporting of systematic reviews and meta-analyses (3). It includes a 27-item checklist and four-phase diagram (3) (Supplementary Table 1 and Supplementary Fig. 1) that can be applied to studies including RCTs as well as other types of research (3). Most recently, the Institute of Medicine published a report on standards for systematic reviews (7). The report presents specific standards for each of the following aspects of a systematic review: initiating a systematic review, finding and assessing studies, synthesizing evidence, and reporting results (Supplementary Table 2).
Table 1 summarizes the steps in the systematic review process along with recommendations to avoid bias and error in the review process as articulated by Home. We believe that it is critically important to conduct and report systematic reviews using rigorous, established guidelines (3,6) (see Supplementary Table 1).
A rigorous review conducted according to the established guidelines summarized above can address important clinical questions that cannot be fully answered by RCTs alone and can be a powerful tool in evidence synthesis. We highlight the types of critical gaps that systematic reviews and meta-analyses can fill, along with examples from diabetes literature, and highlight their value that cannot be replicated by other study designs.
Well-designed RCTs are considered the gold standard for answering clinical research questions because they have the lowest risk of bias. However, there are many circumstances in which RCTs alone fail to provide definitive conclusions. These include the following: 1) multiple RCTs yield conflicting results making definitive conclusions unclear; 2) certain clinical outcomes, such as cardiovascular end points, require longer term follow-up than the duration of the RCTs; 3) individual RCTs are underpowered to identify significant adverse events; and 4) randomization to certain exposures is unethical. In these circumstances, systematic review and meta-analysis of the existing literature in a specific area, using a rigorous, scientific approach, can be a powerful tool in evidence synthesis to guide future research, clinical guideline development, and health care policy.
Our scientific approach to medicine generally requires more than one RCT to make a definitive conclusion. This necessary replication can inevitably result in situations in which multiple trials yield conflicting results, making definitive conclusions unclear. In this circumstance, a well-done meta-analysis can provide a means of data synthesis and reconciliation to improve understanding of conflicting results. For example, an initial RCT of adult intensive care unit (ICU) patients (primarily surgical) demonstrated that tight glycemic control, achieved with intravenous insulin infusion to maintain a glucose target of 80–110 mg/dL, significantly reduced total mortality and mortality secondary to multiorgan failure from a septic focus (8). As a result, professional organizations recommended an ICU glycemic target of 80–110 mg/dL, a noncritical care target of 110 mg/dL preprandially, and a maximum glucose of 180 mg/dL (9). Subsequent trials in medical ICU patients and other settings, however, did not confirm these findings (10,11), and one large clinical trial found increased mortality in the intensive insulin therapy group (11). Similarly, an initial clinical trial of tighter compared with conventional peri- and postoperative glycemic control in myocardial infarction patients showed a significant reduction in mortality (12); however, this was not confirmed in a subsequent follow-up trial (13). Because of conflicting trial data, two meta-analyses were undertaken to synthesize the literature, including these RCTs as well as several others. While one meta-analysis showed a significant reduction in septicemia with tight glucose control compared with conventional control (14), the other, which was published after 2008 and included the Normoglycemia in Intensive Care Evaluation and Survival Using Glucose Algorithm Regulation (NICE-SUGAR) trial, showed no difference in clinical outcomes (15). Both meta-analyses demonstrated that tight glycemic control was not associated with a reduction in mortality and was associated with a significantly increased risk of hypoglycemia (14,15). Consequently, professional organizations took appropriate steps to alter inpatient glycemic targets to safer and achievable levels and currently recommend an ICU target of 140–180 mg/dL and a preprandial target of less than 140 mg/dL with a maximum glucose of 180 mg/dL in non-ICU settings (16). Thus, well-done meta-analyses have guided appropriate alteration of clinical practice guidelines as new but conflicting data became available.
The systematic review process can inform decisions regarding diagnostic strategies for diabetes. A systematic review of the characteristics of postpartum screening tests in women with a prior history of gestational diabetes mellitus showed that a single fasting blood glucose was not a sensitive screening test compared with the standard oral glucose tolerance test for detecting type 2 diabetes, suggesting that it should not replace currently recommended screening test (17). This review also pointed out important limitations of the existing literature in this area (17). Thus, a rigorous systematic review also brings attention to gaps in evidence and the need for more research to address important clinical questions.
Systematic reviews and meta-analysis can also inform treatment practices in the monitoring and clinical management of diabetes. In recent years, many advances have been made in technologies to deliver insulin (continuous subcutaneous insulin infusion [CSII]) and to monitor glucose (real-time continuous glucose monitoring [rt-CGM]); however, their comparative effectiveness as well as the populations most likely to benefit had not been clearly demonstrated (18). Because these technologies are expensive and may be heavily marketed, objective information about their comparative effectiveness with conventional approaches is important so that patients and health care providers can make informed decisions. A recent systematic review and meta-analysis of RCTs showed that multiple daily injections (MDIs) and analog-based CSII had similar effects on hemoglobin A1c (HbA1c) levels (18) and severe hypoglycemia in children and adults with type 1 diabetes and in adults with type 2 diabetes, indicating that glycemic goals can be achieved with either method of intensive insulin delivery and that CSII is not superior (18). In contrast, two recent meta-analyses demonstrated that compared with self-monitoring of blood glucose (SMBG), rt-CGM achieved lower HbA1c without differences in severe hypoglycemia in individuals with type 1 diabetes (18,19). In addition, sensor-augmented insulin pumps, which combine CSII with rt-CGM, significantly decreased HbA1c more than MDI with SMBG in patients with type 1 diabetes (18). These studies suggest that using rt-GCM may have a favorable impact on glycemic control regardless of the methods of insulin delivery; however, as pointed out as a limitation of the review, the current literature does not allow a comparison of rt-CGM versus SMBG in patients only using CSII or only using MDI because the modes of insulin delivery were mixed (18). Therefore, the systematic reviews and meta-analyses identified a need for additional clinical trials in the area of glucose monitoring.
Most RCTs have inadequate power to identify serious adverse events, but systematic reviews and meta-analyses of RCTs, supplemented with observational studies, can provide more power to detect such events, particularly when multiple, small studies have been conducted. Meta-analyses initially raised concern about the increased risk of myocardial infarction in individuals taking rosiglitazone compared with placebo, other agents, or pioglitazone (20,21). This ultimately led the Food and Drug Administration to issue a black box warning for rosiglitazone. In addition, meta-analyses have shown that thiazolidinediones are associated with increased risk for congestive heart failure and bone fracture compared with other agents (22,23). These signals may not have become apparent without well-conducted meta-analyses.
Well done meta-analyses provide reliable information about anticipated effect sizes for clinical treatment decisions. This is particularly valuable when the optimal choice of treatment is sensitive to a patient’s views about the seriousness of potential complications or outcomes. Information about expected treatment effect sizes can also be helpful to investigators when they are planning RCTs. For example, treatment effect sizes from a meta-analysis of observational studies can be used to estimate 1) anticipated treatment effect sizes in an RCT comparing two interventions and 2) the number of participants necessary to have adequate power to detect that effect. A recent meta-analysis of the comparative effectiveness of various two-drug combinations for treatment of type 2 diabetes found that the combinations similarly reduced HbA1c by 1 percentage point, although with different side effect profiles (23). Which drug combinations are most effective for various patients remains an important clinical question. Building on this meta-analysis, an RCT, the Glycemic Reduction Approaches in Diabetes: A Comparative Effectiveness Study (GRADE), is currently underway to compare various combination treatment approaches with metformin in patients with type 2 diabetes (24). This trial will confirm or refute the effect sizes for various outcomes suggested by the prior meta-analysis.
Though considered the gold standard, RCTs are unable to answer all questions because it is not feasible and/or ethical to randomize patients to certain exposures, necessitating observational study designs that can be incorporated into systematic reviews to identify novel risk factors for disease outcomes. For example, individuals cannot be randomly assigned to having a depressive disorder versus not, but observational studies can be used to define the experience and outcomes of individuals who do and do not have depressive disorders. Well-done meta-analyses published in Diabetes Care have identified depression as a risk factor for insulin resistance (25), metabolic syndrome (26), and type 2 diabetes (27). Identification of such novel risk factors for adverse metabolic outcomes set the stage for future preventive intervention trials to determine if treatment for depression improves insulin resistance and/or prevents metabolic syndrome and diabetes.
In some instances, it is unethical to randomize individuals to certain exposures. The Thiazolidinedione Intervention with Vitamin D Evaluation (TIDE) trial was designed as a postmarketing study to compare the cardiovascular safety of rosiglitazone and pioglitazone (28). However, as concerns accumulated about the adverse events of rosiglitazone, the TIDE trial was halted because it was deemed unethical to continue exposure to rosiglitazone (28). Hence, meta-analyses of prior RCTs and observational studies may provide the best way to examine the association of rosiglitazone with important long-term clinical outcomes. Finally, certain clinical outcomes, such as cardiovascular end points, require longer term follow-up than the duration of the RCTs and necessitate longitudinal, observational studies that can subsequently be included in systematic reviews and meta-analyses.
Many RCTs have very restrictive entry criteria, often resulting in homogenous populations or populations that are not truly reflective of the race/ethnic or sex distribution of the individuals with the disorder of interest, limiting their generalizability. A systematic review of observational studies that includes more diverse populations can address these concerns. For example, RCTs comparing bariatric surgery to medical therapy for weight loss in patients with type 2 diabetes (29,30) or for weight loss in the prevention of type 2 diabetes (31) have included primarily Caucasian populations. Two studies were conducted exclusively in European Caucasian populations (30,31), and the participants in one U.S. study were 74% Caucasian (29), but it is well established that ethnic minority populations have the highest prevalence and risk of type 2 diabetes (32). A recently published meta-analysis attempted to initially address the important issue of effectiveness of bariatric surgery in individuals of African and Caucasian descent and showed that the percent estimated weight loss was greater in Caucasians compared with African Americans (33). These data, which could not be derived from existing RCTs, point to the need for future bariatric surgery trials to reflect the race/ethnic composition of the population that has diabetes and to determine the reasons for these disparities.
Modern systematic reviews require assessment of the strength of evidence for the key research questions examined (3). Associations and comparisons for which the strength of evidence is low or insufficient can point to important areas for future research and where to allocate research resources. In the area of diabetes treatment, strength of evidence was moderate for race/ethnic differences in percentage estimated weight loss in patients with diabetes undergoing bariatric surgery; however, strength of evidence was poor for race/ethnic differences in remission of type 2 diabetes with bariatric surgery (34). In comparing various type 2 diabetes medications on long-term clinical outcomes, strength of evidence was low or insufficient for all-cause mortality, cardiovascular disease morbidity and mortality, and the microvascular outcomes of neuropathy and retinopathy (23). Finally, while strength of evidence was moderate for the comparative effectiveness of CSII versus MDI on HbA1c in patients with diabetes, it was low or insufficient for their effects on hyperglycemia, hypoglycemia, weight gain, quality of life, and long-term clinical outcomes (18). All of these data point to critical areas for additional research and the need for rigorous and appropriate study designs to assess the most relevant outcomes. For example, it may not be feasible to conduct a large, long-term study of the comparative effectiveness of CSII versus MDI on cardiovascular outcomes, and future studies will have to consider the appropriateness of using surrogate or intermediate outcomes as alternatives.
Finally, using rigorously conducted systematic reviews and meta-analyses to inform guideline development permits them to be compiled in an objective and conflict-free manner (34). The preference is to use systematic reviews of RCTs when available, but in the absence of RCTs, systematic reviews of observational data can provide another, albeit slightly lower, level of evidence. A study recently examined whether guidelines on oral medications for treatment of type 2 diabetes were consistent with systematic review of the current evidence (35). Eleven guidelines were identified through their systematic review process from several different professional organizations and institutions. They found that 7 out of 11 guidelines agreed that metformin is favored as first-line therapy, 10 out of 11 agreed that thiazolidinediones were associated with higher rates of edema and congestive heart failure compared with other agents, and only 5 of 11 guidelines agreed with all 7 conclusions from the prior systematic review (35). The guidelines with recommendations that were consistent with current evidence were the highest quality. A recent study found that low-quality systematic reviews were cited in 24 endocrinology clinical practice guidelines and used as the main evidence for five recommendations, with only one recommendation acknowledging the systematic review quality (36). Thus, the quality of the current guideline development process that informs clinical practice is quite variable, and high-quality systematic reviews and meta-analyses, using the approaches we have outlined, can contribute to evidence-based recommendations.
Systematic reviews and meta-analyses are indispensable tools in evidence synthesis when they are performed in a rigorous manner following established guidelines for minimizing bias and error. They are indispensable in the context of conflicting RCT data, detecting adverse events, informing disease monitoring and treatment, addressing clinical questions not amenable to RCTs, enhancing the generalizability/applicability of RCTs, and identifying areas of low and/or insufficient strength of evidence for future research. Systematic reviews and meta-analyses will continue to play a critical role in developing unbiased guidelines that take into consideration an assessment of the risk of bias of individual studies as well as the overall strength of available evidence.
No potential conflicts of interest relevant to this article were reported.
|1.||Tonelli MR. The philosophical limits of evidence-based medicine. Acad MedYear: 1998;73:1234–12409883197|
|2.||Home PD. Validity of meta-analysis in diabetes: we need to be aware of its limitations. Diabetes CareYear: 2013;36:3361–3367|
|3.||Moher D,Liberati A,Tetzlaff J,Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med Year: 2009;151:264–269, W64|
|4.||Higgin JPT,Green S. Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration, Year: 2011|
|5.||Moher D,Cook DJ,Eastwood S,Olkin I,Rennie D,Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement.LancetYear: 1999;354:1896–190010584742|
|6.||Stroup DF,Berlin JA,Morton SC,et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMAYear: 2000;283:2008–201210789670|
|7.||Institute of MedicineFinding What Works in Health Care: Standards for Systematic Reviews. Eden J,Levit L,Berg A,Morton S, Eds. Washington, DC, The National Academies Press, Year: 2011|
|8.||van den Berghe G,Wouters P,Weekers F,et al. Intensive insulin therapy in critically ill patients. N Engl J MedYear: 2001;345:1359–136711794168|
|9.||Clement S,Braithwaite SS,Magee MF,et al. American Diabetes Association Diabetes in Hospitals Writing CommitteeManagement of diabetes and hyperglycemia in hospitals. Diabetes CareYear: 2004;27:553–59114747243|
|10.||Van den Berghe G,Wilmer A,Hermans G,et al. Intensive insulin therapy in the medical ICU. N Engl J MedYear: 2006;354:449–46116452557|
|11.||Finfer S,Chittock DR,Su SY,et al. NICE-SUGAR Study InvestigatorsIntensive versus conventional glucose control in critically ill patients. N Engl J MedYear: 2009;360:1283–129719318384|
|12.||Malmberg K. Prospective randomised study of intensive insulin treatment on long term survival after acute myocardial infarction in patients with diabetes mellitus. DIGAMI (Diabetes Mellitus, Insulin Glucose Infusion in Acute Myocardial Infarction) Study Group. BMJYear: 1997;314:1512–15159169397|
|13.||Malmberg K,Rydén L,Wedel H,et al. DIGAMI 2 InvestigatorsIntense metabolic control by means of insulin in patients with diabetes mellitus and acute myocardial infarction (DIGAMI 2): effects on mortality and morbidity. Eur Heart JYear: 2005;26:650–66115728645|
|14.||Wiener RS,Wiener DC,Larson RJ. Benefits and risks of tight glucose control in critically ill adults: a meta-analysis. JAMAYear: 2008;300:933–94418728267|
|15.||Kansagara D,Fu R,Freeman M,Wolf F,Helfand M. Intensive insulin therapy in hospitalized patients: a systematic review. Ann Intern MedYear: 2011;154:268–28221320942|
|16.||Moghissi ES,Korytkowski MT,DiNardo M,et al. American Association of Clinical EndocrinologistsAmerican Diabetes AssociationAmerican Association of Clinical Endocrinologists and American Diabetes Association consensus statement on inpatient glycemic control. Diabetes CareYear: 2009;32:1119–113119429873|
|17.||Bennett WL,Bolen S,Wilson LM,Bass EB,Nicholson WK. Performance characteristics of postpartum screening tests for type 2 diabetes mellitus in women with a history of gestational diabetes mellitus: a systematic review. J Womens Health (Larchmt)Year: 2009;18:979–98719575688|
|18.||Yeh HC,Brown TT,Maruthur N,et al. Comparative effectiveness and safety of methods of insulin delivery and glucose monitoring for diabetes mellitus: a systematic review and meta-analysis. Ann Intern MedYear: 2012;157:336–34722777524|
|19.||Pickup JC,Freeman SC,Sutton AJ. Glycaemic control in type 1 diabetes during real time continuous glucose monitoring compared with self monitoring of blood glucose: meta-analysis of randomised controlled trials using individual patient data. BMJYear: 2011;343:d380521737469|
|20.||Singh S,Loke YK,Furberg CD. Long-term risk of cardiovascular events with rosiglitazone: a meta-analysis. JAMAYear: 2007;298:1189–119517848653|
|21.||Nissen SE,Wolski K. Rosiglitazone revisited: an updated meta-analysis of risk for myocardial infarction and cardiovascular mortality. Arch Intern MedYear: 2010;170:1191–120120656674|
|22.||Loke YK,Singh S,Furberg CD. Long-term use of thiazolidinediones and fractures in type 2 diabetes: a meta-analysis. CMAJYear: 2009;180:32–3919073651|
|23.||Bennett WL,Maruthur NM,Singh S,et al. Comparative effectiveness and safety of medications for type 2 diabetes: an update including new drugs and 2-drug combinations. Ann Intern MedYear: 2011;154:602–61321403054|
|24.||Nathan DM,Buse JB,Kahn SE,et al. the GRADE Study Research GroupRationale and design of the Glycemia Reduction Approaches in diabetes: A Comparative Effectiveness Study (GRADE). Diabetes CareYear: 2013;36:2254–2261|
|25.||Kan C,Silva N,Golden SH,et al. A systematic review and meta-analysis of the association between depression and insulin resistance. Diabetes CareYear: 2013;36:480–48923349152|
|26.||Pan A,Keum N,Okereke OI,et al. Bidirectional association between depression and metabolic syndrome: a systematic review and meta-analysis of epidemiological studies. Diabetes CareYear: 2012;35:1171–118022517938|
|27.||Mezuk B,Eaton WW,Albrecht S,Golden SH. Depression and type 2 diabetes over the lifespan: a meta-analysis. Diabetes CareYear: 2008;31:2383–239019033418|
|28.||Mello MM,Goodman SN,Faden RR. Ethical considerations in studying drug safety—the Institute of Medicine report. N Engl J MedYear: 2012;367:959–96422913661|
|29.||Schauer PR,Kashyap SR,Wolski K,et al. Bariatric surgery versus intensive medical therapy in obese patients with diabetes. N Engl J MedYear: 2012;366:1567–157622449319|
|30.||Mingrone G,Panunzi S,De Gaetano A,et al. Bariatric surgery versus conventional medical therapy for type 2 diabetes. N Engl J MedYear: 2012;366:1577–158522449317|
|31.||Carlsson LM,Peltonen M,Ahlin S,et al. Bariatric surgery and prevention of type 2 diabetes in Swedish obese subjects. N Engl J MedYear: 2012;367:695–70422913680|
|32.||Golden SH,Brown A,Cauley JA,et al. Health disparities in endocrine disorders: biological, clinical, and nonclinical factors—an Endocrine Society scientific statement. J Clin Endocrinol MetabYear: 2012;97:E1579–E163922730516|
|33.||Admiraal WM,Celik F,Gerdes VE,Dallal RM,Hoekstra JB,Holleman F. Ethnic differences in weight loss and diabetes remission after bariatric surgery: a meta-analysis. Diabetes CareYear: 2012;35:1951–195822923683|
|34.||Institute of MedicineClinical Practice Guidelines We Can Trust. Graham R, Mancher M, and Wolman DM, et al., Eds. Washington, DC, National Academies Press, 2011|
|35.||Bennett WL,Odelola OA,Wilson LM,et al. Evaluation of guideline recommendations on oral medications for type 2 diabetes mellitus: a systematic review. Ann Intern MedYear: 2012;156:27–3622213492|
|36.||Brito JP,Tsapas A,Griebeler ML,et al. Systematic reviews supporting practice guideline recommendations lack protection against bias. J Clin EpidemiolYear: 2013;66:633–63823510557|
|37.||Buscemi N,Hartling L,Vandermeer B,Tjosvold L,Klassen TP. Single data extraction generated more errors than double data extraction in systematic reviews. J Clin EpidemiolYear: 2006;59:697–70316765272|
|38.||Oremus M,Wolfson C,Perrault A,Demers L,Momoli F,Moride Y. Interrater reliability of the modified Jadad quality scale for systematic reviews of Alzheimer’s disease drug trials. Dement Geriatr Cogn DisordYear: 2001;12:232–23611244218|
|39.||Downs SH,Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community HealthYear: 1998;52:377–3849764259|
|40.||GRADE Working Group. GRADE guidelines—best practices using the GRADE framework, Year: 2013 Available from http://www.gradeworkinggroup.org/publications/JCE_series.htm|
|41.||Atkins D,Best D,Briss PA,et al. GRADE Working GroupGrading quality of evidence and strength of recommendations. BMJYear: 2004;328:149015205295|
Previous Document: Sleep-disordered breathing and gestational diabetes mellitus: a meta-analysis of 9,795 participants ...
Next Document: A PERSPECTIVE ON THE PREDICTION OF DRUG PHARMACOKINETICS AND DISPOSITION IN DRUG RESEARCH AND DEVELO...