|Financial disclosures of authors involved in spine research: an underestimated source of bias.|
|Jump to Full Text|
|PMID: 22113533 Owner: NLM Status: Publisher|
|BACKGROUND: Reporting financial disclosures has become standard practice in both journal publications and during oral forum at scientific meetings. Despite this, the effect of reporting a financial disclosure of any member of an authorgroup, on the tone of the conclusion of an article has gained little attention. This study was performed to determine what effect reporting a financial disclosure has on the conclusion of an article. METHODS: A literature search for all articles on interspinous devices and cervical disc prostheses, published from January 1st, 2008 until December 1st, 2010 was performed. Financial disclosures were reported, as were funding by commercially active parties. The tone of the conclusions was graded as positive, neutral or negative. RESULTS: The odds ratio (OR) for a positive conclusion in cases where a financial disclosure was reported was 16.5 (95% CI: 4.7-58.1). Effect modification occurs with the presence of funding by a commercially active party. In cases where a financial disclosure was reported and funding was available for the study, the OR was 1.0 (95% CI: 0.08-12.6), whilst the OR was 33.3 (95%CI: 4.2-262.3) if funding was not provided. This discrepancy is mainly due to the large number of articles with a neutral/negative conclusion if the authors failed to report any financial disclosure and were not funded by a commercially active party. CONCLUSIONS: Reporting a financial disclosure is a potential source of bias. Authors with disclosed financial relationships less often publish articles with a neutral/negative conclusion. This source of bias should certainly be taken into account during the critical appraisal of articles, particularly when the quality of the literature is being assessed.|
|Ronald H M A Bartels; Hans Delye; Jeroen Boogaarts|
Related Documents :
|11677913 - Colonic lipomas at the university hospital of the west indies.
423073 - Retroperitoneal lipoma in children.
18778983 - Anterior and posterior urethral valves with subcoronal hypospadias: a rare association.
|Type: JOURNAL ARTICLE Date: 2011-11-24|
|Title: European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society Volume: - ISSN: 1432-0932 ISO Abbreviation: - Publication Date: 2011 Nov|
|Created Date: 2011-11-24 Completed Date: - Revised Date: -|
Medline Journal Info:
|Nlm Unique ID: 9301980 Medline TA: Eur Spine J Country: -|
|Languages: ENG Pagination: - Citation Subset: -|
|Department of Neurosurgery, Radboud University Nijmegen Medical Centre, R. Postlaan 4, 6500, HB, Nijmegen, The Netherlands, email@example.com.|
|APA/MLA Format Download EndNote Download BibTex|
Journal ID (nlm-ta): Eur Spine J
Journal ID (iso-abbrev): Eur Spine J
Publisher: Springer-Verlag, Berlin/Heidelberg
© The Author(s) 2011
Received Day: 10 Month: 7 Year: 2011
Revision Received Day: 23 Month: 10 Year: 2011
Accepted Day: 12 Month: 11 Year: 2011
Electronic publication date: Day: 24 Month: 11 Year: 2011
pmc-release publication date: Day: 24 Month: 11 Year: 2011
Print publication date: Month: 7 Year: 2012
Volume: 21 Issue: 7
First Page: 1229 Last Page: 1233
PubMed Id: 22113533
Publisher Id: 2086
|Financial disclosures of authors involved in spine research: an underestimated source of bias|
|Ronald H. M. A. BartelsAff1||
Address: +31-24-6775414 +31-24-3651587 firstname.lastname@example.org
|Department of Neurosurgery, Radboud University Nijmegen Medical Centre, R. Postlaan 4, 6500 HB Nijmegen, The Netherlands
Evidence based medicine is generally accepted. Unbiased, high quality research is needed to answer questions regarding clinical effectiveness, cost -utility or cost -effectiveness of new treatments. Collaboration with the industry is essential to initiate time and financially consuming trials. Major sources of biases have been well established, and most of which have been quantitatively been investigated. Others have been recognized and discussed, yet research on them has rarely been performed. The former has been the case for the bias due to financial dependence of the investigator on a company that has developed or sold the product, under investigation [1–4]. We hypothesize that a financial disclosure was related to the conclusion of a study investigating the product for which the disclosure was made. Therefore, this study was performed to investigate whether financial disclosure is related to reporting a favorable result of the product under investigation.
Because of the background of the first author is mainly in spinal surgery, a literature search in Pubmed was performed on spinal implants. The implants chosen were interspinous distraction devices (ISD) and cervical disc prostheses. The search was restricted from January, 1st 2008 until December 1st, 2010. The search string for ISD was ((interspinous) AND (device OR implant OR spacer)) AND lumbar. The search string for cervical arthroplasty (CAP) included cervical AND (disc OR disk) AND (prosthesis OR prostheses OR arthroplasty).
For both searches, the language was restricted to English, German, French or Dutch. The titles and abstracts were studied. All articles were included except, letters to the editor, editorials and articles not pertaining to ISD or cervical arthroplasty. The remaining articles were completely studied to search for disclosures or funding by commercially active parties related to the Product or Technique under Investigation (PTI).
Since the conclusion is, for most readers, an invitation to read the whole article and many times also the main message readers remember, the abstract was the primary subject of study. The conclusions within the abstracts were examined for remarks on the PTI. The conclusion was then qualified as positive, neutral or negative. A conclusion was graded positive if a statement was included that the PTI exhibited a better or even slightly better performance. It was also deemed positive if the study did not show any superiority but an assumption was made that the use of the PTI would contribute to a better clinical or biomechanical outcome. These statements were characterized by adjectives including promising, encouraging, favorable, and the like. A conclusion was qualified as neutral, if the results of the study did not demonstrate any difference and without any assumptions being made about the possibility of a better outcome. A negative conclusion included a clear statement that the PTI did not carry any benefit above another product or technique, performed more poorly or emphasized mainly complications or adverse events of the POT.
The qualification of the conclusion was subsequently correlated with the presence of any financial disclosures of the authors. If a member of the author group had a disclosure in another article and the article of interest did not explicitly mention disclosures, the article was then included in a separate group as having a financial relationship, without explicit disclosure. For the purpose of analysis, this group was combined with the group that clearly stated disclosures. Moreover, whether the funding to support the work by a commercial party related directly or indirectly to the PTI was noted. The type of financial disclosure or funding was not separately investigated.
Two of the authors (RB, HD) independently investigated the retrieved articles. In cases of discrepancy between the two authors, they deliberated about the findings. If an agreement could not be reached, the opinion of a third investigator (JB) was obtained. The inter- observer agreement for qualifying the conclusion and the relation to funding or disclosures was determined as kappa (κ).
Statistical analysis was performed using a commercially available program (SPSS 17.0). Logistic regression was used to calculate odds ratios (OR). 95% confidence intervals (95%CI) were defined. Statistical significance was assumed when the p value was <0.05.
The search on ISD resulted in the titles and abstracts of 66 articles. Fourteen articles were excluded because they did not relate to the subject of investigation, or did not present the results of a study. Editorials and letters to editors were likewise excluded, as were studies with inadequate abstracts. Therefore, 51 complete articles on ISD were included in this study. 215 articles were retrieved after a search was performed for CAP. 109 complete articles that dealt with the subject of interest were included. In total, 160 articles were studied. The results are depicted in Appendix. A summary of the results is shown in Table 1.
In 21 articles from the first set of articles, the preliminary qualification of the tone of these articles differed between the two investigators. After discussion and deliberation, the qualification was adapted without the need for asking the opinion of the third researcher. Kappa was 0.87.
In 40 articles, no financial disclosure was reported. Therefore, based on 120 articles, it could be estimated that the OR of reporting a positive conclusion while having a financial disclosure was 16.5 (95% CI: 4.7–58.1). If for the author groups of all 40 articles for which the disclosure was not stated explicitly, a financial disclosure was assumed (worst case scenario), the OR of reporting a positive conclusion while having a financial relationship was 3.0 (95% CI: 1.5–5.8), and if it was assumed that they indeed did have not have a financial relationship (best case scenario) the OR was 16.4 (95% CI: 4.8–55.7). The OR for a positive conclusion with a stated financial disclosure was 16.0 (95% CI: 1.8–142.4), and 16.7 (95% CI: 3.6–78.1), for studies on ISD and CAP, respectively.
The effect of funding of a study was also investigated. The OR for a positive conclusion with both a stated financial disclosure and funding by a commercially active party was 1.0 (95% CI: 0.08–12.6), whilst the OR was 33.3 (95%CI: 4.2–262.3) if funding was not provided. Therefore, the presence of funding contributed to effect modification. The addition of an interaction term was statistically significant (p = 0.035). The number of articles with a negative conclusion, where both funding was not present and a financial disclosure was not reported was quite remarkable. The OR for reporting an article with a neutral/negative conclusion in cases in which both financial disclosure and funding existed was 0.03 (95% CI: 0.0–0.2).
The effect of financial relationships on the results of trials has been subject of many articles. It has been demonstrated that published funded trials report positive findings more frequently . This effect has been established as “funding-driven bias” . This bias has been classically restricted to articles reporting research related to pharmaceutical therapies.
Financial disclosures or conflict of interest of an author or members of an author groups have also been extensively discussed in the literature. In most instances, the articles dealt with legal or ethical aspects of financial relationships. The epidemiology of financial disclosures has likewise been described . However, the effect of financial disclosures on study outcomes has gained little attention.
This study clearly established the quantitative relationship between financial disclosure and study outcome. The method employed for qualifying the conclusions has not been previously described. However, it is simple and affords high inter-observer agreement, with a kappa of 0.86 being achieved. Although the implants under investigation were only for use in spinal surgery, the conclusions here should not be restricted to this specialty. The ORs for studies on two different implants were essentially the same (i.e. OR 16.0 and 16.7).
To our knowledge, this is the first reported analysis of the effect modification having a financial disclosure has on the nature of study conclusions, in the presence of funding. The demonstrated difference is mainly due to the significantly higher number of studies with a neutral/negative conclusion, in the absence of funding and stated financial disclosure. While this has been described previously, the prior focus has been on the relationship between positive findings and financial disclosure . Considering the nature of commercially active parties, reporting articles with negative conclusions regarding their products, is not in their best interest. Their primary objective lies in promoting their products. Therefore, it can be assumed that it is more likely that they preferentially and actively support any investigation which will result in a positive conclusion.
Publication bias could also contribute to the difference in articles with positive and neutral/negative conclusions. However, a clear distinction exists between the number of articles with a negative conclusion that are funded, and those that are not.
Therefore, the effect financial disclosure has on the outcome of an article certainly exists and should be taken into in account when interpreting the results and conclusions of a study. Financial disclosure bias, as well as, funding-driven bias should be considered when assessing the quality of publications, particularly when performing a meta-analysis. Furthermore, it should be added to the long list of possible biases.
Studying the effect of a financial disclosure in articles relating to interspinous devices, cervical disc prostheses, or any other specific implant, medical device, or drug, within a certain time period has a major advantage: the product of interest is clearly defined and the interest of industry within this time period is apparent. If this study would have included any article within a certain time period, certainly a dilution of the results would have occurred and more bias would have been incorporated. For example, studies on subjects that lack a commercial market, will be less frequently funded and the authors will less often report a financial disclosure. Therefore, it is assumed that the results of this study can be extrapolated to other research related to commercially available medical products. This is substantiated by the nearly equal OR for the two different spinal implants that are otherwise unrelated. Conversely, including all articles on several subjects could contribute to generalization of the findings of this study.
A flaw of this study is that the financial disclosure itself is not specified. Intuitively, stockholders may be more prone to report positive results compared with those authors who received minimal financial support. On the other hand, it is common knowledge that even small gifts will positively influence the opinion of a person towards the gift-related product . Furthermore, it has been established that the description of financial disclosures widely differs and has even been called vague [10, 11]. In 40 articles, the disclosure was not stated. As was demonstrated in calculating the best and worst case scenario, knowledge of the presence of any financial disclosure would not affect the conclusion of this study. Only the magnitude of the results would have differed, although the OR of the forecasted best scenario was probably underestimated. Based on the results of this study, we believe that author groups with a financial disclosure report fewer articles with a neutral/negative conclusion. In our calculation, they were equally divided between the groups with and without known financial disclosure. If this would be corrected, the OR increased dramatically in a best case scenario where none of the authors had a financial disclosure.
Another criticism lies in the lack of qualification of the methodology used in the evaluation of articles. Whether the conclusion was correct based on the validity of the results of each article, has not been verified in this study; we examined only the summarized conclusion of the results and their interpretation as given in the abstract of each article. Therefore, the effect of a financial disclosure on the tone of the conclusion, alone was evaluated.
An ambivalent attitude towards financial relationships and research is currently warranted. Given that the development of new drugs or implants is, in most instances, dependent upon the financial support of the industry, funding of research should be encouraged. On the other hand and for purposes of independent critical appraisal of the results, any financial relationships between industry and researchers should be avoided and rejected. The attempts to influence scientific publications by industry should be minimized. An example is the nation-wide independent research programme on drugs launched by the Italian Medicines Agency (AIFA) in 2005. The challenges, feasibility and future perspectives are well described .
Financial disclosures are an underestimated source of bias. In fact, authors having a financial disclosure tend to less often report a study with a neutral or negative conclusion. This should be taken into careful consideration when assessing the quality of a study.
The authors want to express their gratitude to Ben Guiot, M.D., neurosurgeon in Denver, CO, USA, Andrea Chamczuk, MD, neurosurgeon in Buffalo, NY, USA editing the English grammar and style of the manuscript.
The authors declare that they do not have any competing interests.
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
|1..||Irwin RS. The role of conflict of interest in reporting of scientific informationChestYear: 200913625325910.1378/chest.09-089019584207|
|2..||Morin K,Rakatansky H,Riddick FA Jr,et al. Managing conflicts of interest in the conduct of clinical trialsJAMAYear: 2002287788410.1001/jama.287.1.7811754712|
|3..||Bekelman JE,Li Y,Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic reviewJAMAYear: 200328945446510.1001/jama.289.4.45412533125|
|4..||Lexchin J,Bero LA,Djulbegovic B,et al. Pharmaceutical industry sponsorship and research outcome and quality: systematic reviewBMJYear: 20033261167117010.1136/bmj.326.7400.116712775614|
|5..||Shah RV,Albert TJ,Bruegel-Sanchez V,et al. Industry support and correlation to study outcome for papers published in SpineSpineYear: 2005301099110410.1097/01.brs.0000161004.15308.b415864166|
|6..||Rampton S,Stauber J. Research funding, conflicts of interest, and the meta-methodology of public relationsPublic Health RepYear: 200211733133912477914|
|7..||Riechelmann RP,Wang L,O’Carroll A,et al. Disclosure of conflicts of interest by authors of clinical trials and editorials in oncologyJ Clin OncolYear: 2007254642464710.1200/JCO.2007.11.248217925561|
|8..||Friedman LS,Richter ED. Relationship between conflicts of interest and research resultsJ Gen Intern MedYear: 200419515610.1111/j.1525-1497.2004.30617.x14748860|
|9..||Kofke WA. Disclosure of industry relationships by anesthesiologists: is the conflict of interest resolved?Curr Opin AnaesthesiolYear: 20102317718310.1097/ACO.0b013e328336ea2c20084000|
|10..||Ju BL,Miller CP,Whang PG,et al. Quantifying the variability of financial disclosure information reported by authors presenting at annual spine conferencesSpine JYear: 2011111810.1016/j.spinee.2010.08.02220932807|
|11..||Keune JD,Vig S,Hall BL,et al. Taking disclosure seriously: disclosing financial conflicts of interest at the American college of surgeonsJ Am Coll SurgYear: 201121221522410.1016/j.jamcollsurg.2010.08.01221036075|
|12..||Italian Medicines Agency (AIFA) Research, Development Working GroupFeasibility and challenges of independent research on drugs: the Italian medicines agency (AIFA) experienceEur J Clin InvestYear: 201040698610.1111/j.1365-2362.2009.02226.x20055898|
See Table 2
Number of articles on interspinous devices and cervical arthroplasty from January 1st, 2008 till December 1st, 2010 related to financial disclosure, funding and the conclusion
|Financial disclosure reported||No financial disclosure reported||No need to report disclosures||Disclosures known but no need to mention them||Total|
|Funding||No funding||Funding||No funding||Funding||No funding||Funding||No funding|
Financial disclosure reported: clear statement of having a financial disclosure is made in the publication, No financial disclosure reported: a clear statement of not having a financial disclosure is made in the publication; No need to report disclosures: the journal did not ask to publish disclosures relating to the article and they are not clearly stated; Disclosures known but no need to mention them: form other publications it was known that a financial disclosure was present but the journal in which the article of interest was published did not publish any financial relationships
Tables with number of articles for interspinous devices and cervical arthroplasty separately from January 1st, 2008 till December 1st, 2010 related to financial disclosure, funding and the conclusion. References are included
|Financial disclosure reported||No financial disclosure reported||Disclosures not explicitly stated||Disclosures known but no need to mention them||Total|
|Funding||No funding||Funding||No funding||Funding||No funding||Funding||No funding|
|Positive conclusion||7[1–7]||6[8–13]||3[14, 15]||8[16–24]||–||5[25–29]||1||2[31, 32]||32|
Keywords: Keywords Disclosure, Bias, Spinal implants.
Previous Document: Complications and outcomes of posterior fusion in children with atlantoaxial instability.
Next Document: Long-term effects of nutraceuticals (berberine, red yeast rice, policosanol) in elderly hypercholest...