Document Detail

Framework of policy recommendations for implementation of evidence-based practice: a systematic scoping review.
Jump to Full Text
MedLine Citation:
PMID:  23355664     Owner:  NLM     Status:  PubMed-not-MEDLINE    
OBJECTIVES: Evidence-based practice (EBP) may help improve healthcare quality. However, not all healthcare professionals and managers use EBP in their daily practice. We systematically reviewed the literature to summarise self-reported appreciation of EBP and organisational infrastructure solutions proposed to promote EBP.
DESIGN: Systematic review. Two investigators independently performed the systematic reviewing process.
INFORMATION SOURCES: MEDLINE, EMBASE and Cochrane Library were searched for publications between 2000 and 2011. ELIGIBILITY CRITERIA FOR INCLUDED STUDIES: Reviews and surveys of EBP attitude, knowledge, awareness, skills, barriers and facilitators among managers, doctors and nurses in clinical settings.
RESULTS: We found 31 surveys of fairly good quality. General attitude towards EBP was welcoming. Respondents perceived several barriers, but also many facilitators for EBP implementation. Solutions were proposed at various organisational levels, including (inter)national associations and hospital management promoting EBP, pregraduate and postgraduate education, as well as individual support by EBP mentors on the wards to move EBP from the classroom to the bedside.
CONCLUSIONS: More than 20 years after its introduction, the EBP paradigm has been embraced by healthcare professionals as an important means to improve quality of patient care, but its implementation is still deficient. Policy exerted at microlevel , middlelevel and macrolevel, and supported by professional, educational and managerial role models, may further facilitate EBP.
Dirk T Ubbink; Gordon H Guyatt; Hester Vermeulen
Related Documents :
24651254 - Change management and clinical engagement: critical elements for a successful clinical ...
5304804 - Studies in the epidemiology and control of seasonal conjunctivitis and trachoma in sout...
11547974 - Modern management instruments--control of a water resources management association by m...
17365634 - Foot preferences during resting in wildfowl and waders.
12397904 - Ethics in child and adolescent forensic psychiatry.
10476244 - Professional competence in medicine.
Publication Detail:
Type:  Journal Article     Date:  2013-01-24
Journal Detail:
Title:  BMJ open     Volume:  3     ISSN:  2044-6055     ISO Abbreviation:  BMJ Open     Publication Date:  2013  
Date Detail:
Created Date:  2013-01-28     Completed Date:  2013-01-29     Revised Date:  2013-11-25    
Medline Journal Info:
Nlm Unique ID:  101552874     Medline TA:  BMJ Open     Country:  England    
Other Details:
Languages:  eng     Pagination:  -     Citation Subset:  -    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Full Text
Journal Information
Journal ID (nlm-ta): BMJ Open
Journal ID (iso-abbrev): BMJ Open
Journal ID (hwp): bmjopen
Journal ID (publisher-id): bmjopen
ISSN: 2044-6055
Publisher: BMJ Publishing Group, BMA House, Tavistock Square, London, WC1H 9JR
Article Information
Download PDF
Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to
Received Day: 26 Month: 7 Year: 2012
Accepted Day: 21 Month: 12 Year: 2012
collection publication date: Year: 2013
Electronic publication date: Day: 25 Month: 1 Year: 2013
Volume: 3 Issue: 1
E-location ID: e001881
PubMed Id: 23355664
ID: 3563143
Publisher Id: bmjopen-2012-001881
DOI: 10.1136/bmjopen-2012-001881

Framework of policy recommendations for implementation of evidence-based practice: a systematic scoping review Alternate Title:Implementation framework for evidence-based practice
Dirk T Ubbink12
Gordon H Guyatt3
Hester Vermeulen14
1Department of Quality Assurance & Process Innovation, Academic Medical Center, Amsterdam, The Netherlands
2Department of Surgery, Academic Medical Center, Amsterdam, The Netherlands
3Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, Canada
4Amsterdam School of Health Professions, University of Amsterdam, Amsterdam, The Netherlands
Correspondence to Dr Dirk T Ubbink;

Article summary
Article focus
  • Systematic review of the literature to summarise self-reported appreciation of evidence-based practice (EBP) and organisational infrastructure solutions proposed to promote EBP.
Key messages
  • More than 20 years after its introduction, the EBP paradigm has been embraced by healthcare professionals as an important means to improve quality of patient care, but its implementation is still deficient.
  • Policy exerted at microlevel, middlelevel and macrolevel, and supported by professional, educational and managerial role models, may further facilitate EBP.
Strengths and limitations of this study
  • Worldwide overview of EBP appreciation and implementation strategies useful for all centres striving at a better EBP implementation.
  • Self-reporting may have led to an overestimation of the results.
  • The success of implementation strategies is still unclear.


Evidence-based practice (EBP) provides a structure for the bedside use of research and consideration of patient values and preferences to optimise clinical decision-making and to improve patient care.1, 2 EBP could potentially be used to improve quality of healthcare.3, 4 In 2001, the Institute of Medicine's Quality Chasm series suggested EBP as one of the five core competencies for professional healthcare curricula.5 More recently, the growing societal demand for quality, safety, equality and accountability of healthcare and credentialing programmes as exerted by the Joint Commission International and Magnet hospitals have further promoted EBP.6, 7 To date, hospital executive boards, insurance companies and consumers recognise that EBP may help prevent unsafe or inefficient practices, as part of a strategy to achieve quality improvement in healthcare.8

Thus far, however, educational efforts have failed to achieve EBP at the bedside or in daily clinical problem-solving. While there is an ongoing debate on how to measure quality of care in general, attitude, awareness, knowledge or behaviour are relevant to understand application of EBP. Various questionnaires have been developed and used to appreciate these aspects (eg, McColl and Funk).9, 10 This information suggested the implementation of EBP by doctors is hampered by a perceived lack of time, knowledge or EBP resources,9, 11 whereas in the nursing realm EBP awareness, the body of knowledge and research utilisation, as well as managerial support are still developing.12, 13 Based on these findings, many different recommendations for improvement have been proposed. Hence, it is timely to synthesise these recommendations for more structural organisational initiatives that may help overcome barriers and facilitate the uptake of EBP.

Therefore, the purpose of this study was to collect surveys of healthcare professionals’ views on EBP in terms of self-reported attitude, knowledge, awareness, skills, barriers and behaviour regarding EBP among clinical doctors, nurses and managers, and to summarise proposed recommendations as derived from these views to improve the use of EBP. We subsequently used the findings of this review to propose a framework for implementation of EBP, tailor-made for different managerial levels and suitable to structurally facilitate and sustain evidence-based behaviour in clinical healthcare organisations.

Literature search and study selection

Two of the authors (DTU, HV) searched the MEDLINE (using PubMed), EMBASE (using Ovid) and Cochrane databases from 2000 through 2011 for surveys or reviews of EBP attitude, knowledge, awareness, barriers and facilitators among nurses, physicians and managers in any clinical setting, that is, hospitals or other healthcare institutions, rather than general practice settings, on which a review has recently been published.14 Reference lists of the included studies and reviews were checked for additional eligible papers.

In brief, our search strategy was (evidence-based[ti] practice OR evidence-based medicine OR EBM OR EBP) and (questionnaire* OR survey OR inventory) and ((barriers OR McColl) AND (knowledge OR attitude* OR aware* OR behavio*) and (hospital* OR clinic* OR medical cent*)). No language restrictions were applied. Papers in foreign languages, if any, would be translated if possible.

We excluded studies in an undergraduate educational setting, studies with a purely qualitative design, studies not including clinical doctors or nurses, and those focusing on a specific disorder, guideline, model or technique. We focused on surveys rather than the latter studies, because merely following (particularly expert-based) guidelines or focusing on a specific disorder or technique does not necessarily indicate the general application of the five steps of EBP. Studies before 2000 were also excluded because in these years the EBP paradigm was in an early phase with a limited dispersion among healthcare professionals. Study selection and quality assessment was performed by two investigators independently.

Quality assessment

Judgment of the quality of the surveys was based on the number of centres and respondents involved, response rates and robustness of the questionnaires used (through pilot testing, prior validation or internal consistency based on a Cronbach's α).

Data items and synthesis of results

By means of a structured form, two researchers independently extracted data on study characteristics (including country of origin, publication year, type and number of respondents and type of clinics included), questionnaires used and EBP characteristics studied, in particular EBP attitude, knowledge, skills and awareness, and perceived barriers and facilitating factors for EBP implementation. We extracted in a qualitative manner the reported recommendations, if any, on how to overcome these barriers or how to exploit facilitators. These were grouped into solutions to be executed at various organisational levels. After one investigator had entered the data in the database, these data were checked for accuracy by a second.

Meta-analysis was not planned because of the expected large range in geographical locations, caregivers investigated and questionnaires used. To summarise the results of the studies reporting on EBP attitudes and knowledge, we calculated the medians and report the ranges of the scores given for each item, for doctors and nurses separately. A possible association between response rate, year of publication and attitude towards EBP was calculated using Spearman's correlation coefficient. Statistical analysis was performed using PASW Statistics V.18.0 (IBM Inc, Armonk, New York, USA).

Study inclusion

Our search yielded 286 potentially relevant studies. We also found two recent reviews of studies on barriers towards EBP,15, 16 from which other relevant studies were derived. Some more recent studies not included in these reviews were also found by hand-searching the references of included studies. Four surveys among medical postgraduates were excluded because these publications were in Chinese. In total, 31 studies that included 10 798 respondents from 17 countries proved eligible (table 1). Studies represented nearly all continents, one-third (11/31) were European and a quarter (8/31) were from North America (figure 1). In four of the studies, EBP questions were administered in the context of an educational meeting. Seventeen studies focused specifically on doctors, 11 on nurses. Three of the 31 studies enrolled both doctors and nurses.24, 30, 43 Wherever possible, results from doctors and nurses are presented separately.

All studies applied postal or electronic questionnaires. To assess EBP attitude, knowledge, skills and awareness, most studies used the questionnaires developed by McColl, Upton or Estabrooks.9, 47, 48 To assess EBP barriers and facilitators, most investigators used the Funk questionnaire.10 Half of the studies investigated both EBP attitude and barriers.

Study characteristics

The studies enrolled from 1910 to 115624 respondents (median 273), consisting of doctors (residents, specialists) and nurses (ward and staff nurses, nurse managers and educators) from various clinical specialties. Seven of the 31 studies were conducted in a single centre. Response rates varied from 9% in nationwide surveys to 100% in questionnaires during trainings, with a median of 72%. Twenty-four of the 31 studies (77%) used robust questionnaires. So, overall quality of the included studies was good (table 2). Most studies addressed EBP attitude, skills and barriers (table 1).

EBP attitude

Fifteen of the 18 studies addressing EBP attitude used a (sometimes modified) McColl questionnaire. Based on these 15 studies, both doctors and nurses strongly felt that EBP improves patient care and is important for their profession (table 3). Their overall attitude towards EBP was welcoming and appreciated the use of research evidence in daily clinical practice. However, they considered only half of their clinical practice to be evidence-based, although what they meant by this was, in most cases, not specified and unclear. These findings were consistent among the various countries. We did not find significant correlations between either response rate (−0.112; p=0.703) or year of publication (−0.286; p=0.321) and attitude towards EBP.

EBP knowledge and skills

The majority (median 64%) of doctors and nurses reported they considered their EBP knowledge was insufficient. Similarly, a median of 70% of the respondents regarded their skills as insufficient, even in the most recent studies, and desired (more) EBP training. The percentage of doctors who had had EBP training ranged from 13% (Indian surgical trainees) to 80% (Iranian internal medicine doctors). The most appropriate way, respondents thought to move towards EBP, was through evidence-based guidelines (median 68%), evidence summaries (median 39%) or critical appraisal skills (median 36%).

PubMed accessibility was high (at least 88%, except for India, 58% and Jordan, 70%), either at home or at work. However, clinical decision-making was based on consulting textbooks and colleagues rather than by searching electronic databases.

Figure 2 depicts the knowledge of common EBP terms among doctors. Not all studies used the same EBP terms, but in general, half of the doctors had at least some knowledge about 83% (20/24) of the presented EBP terms. Three of the four terms they were unfamiliar with were meaningless dummy terms. Hence, the results of this part of the questionnaire seemed not biased by socially desired answering.

Only one study examined the nurses’ knowledge of EBP terms (figure 3).43 Half of the nurses had at least some knowledge of 4 (40%) of the 10 terms presented. The dummy terms appeared more familiar than terms like ‘bias’, ‘power calculation’ and ‘number needed to treat’, suggesting some socially desired answering.

Awareness of common sources of evidence

Eight studies addressed this issue (table 1). About a quarter of the responding doctors used the Cochrane Library (median 25%), whereas 39% of them were unaware of this database. The journal Evidence-Based Medicine was used by 14%, but unknown in 34% of the doctors. Guidelines from the National Guideline Clearinghouse were used by 8% and unknown in 48%, the ACP Journal Club used by 3% but unknown in 68% and the TRIP database was used by 15% and unknown in 71%. Two studies showed this awareness was even less among nurses.24, 43

EBP barriers and facilitators

Responses regarding the 29 barriers presented in Funk's questionnaire were usually dichotomised, that is, items scored as ‘barrier’ or ‘large barrier’ were counted as barriers. To give an overview of the barriers to EBP most frequently mentioned by doctors and nurses, we merged our data with the barriers found among nurses in the systematic review by Kajermo et al.15 These barriers are summarised in table 4. Worldwide, EBP barriers were strikingly convergent, except the language barrier for non-English speaking countries and the limited access to electronic databases in some countries.

The major facilitating initiatives as desired by doctors and nurses were mostly collected through open questions. These facilitators include continuing EBP-teaching efforts in pregraduate and postgraduate curricula, constant involvement by colleagues in daily practice, staff and management support to learn and apply EBP in daily clinical practice, structural promotion and facilitation of EBP activities by the management and experts, and clear and easily accessible sources of evidence, protocols and guidelines.

Recommendations reported to implement EBP

All studies gave recommendations to overcome or address the identified barriers (table 5). From macrolevel, middlelevel and microlevel perspectives, that is, at (inter)national, hospital and ward levels, various solutions were proposed, ranging from advocating EBP by national regulatory bodies to specific interventions at ward level, including availability of computers and internet.

A qualitative evaluation of the recommendations shows they mainly focused on education for both pregraduates and postgraduates. The following aspects were considered important: how and with whom to build EBP curricula, tiered education based on needs assessments, learning by interaction and transfer of the education from the classroom to the bedside.

Regarding preconditions to strategically implement EBP, authors put emphasis on the role of the management in terms of facilitating prerequisites as well as creating a positive culture towards EBP. They also suggested that solutions to the problems encountered when implementing EBP should start with an analysis of the organisation to identify problems at both local and organisational levels to tailor the interventions.


Our systematic review shows that, worldwide, many professionals in clinical healthcare welcome EBP, although the awareness of, education in and actual bedside application of EBP leaves room for improvement. Based on the reasons given for the limited uptake of EBP, a structural implementation of EBP in clinical healthcare organisations will require a culture change at various organisational levels, that is, patient care, education and management. The framework of policy recommendations, as presented here, encompasses the wide range of possible entries to implement in a multifocal manner and sustain EBP. Because recommendations were found for virtually all levels of management, a general policy seems indicated to address and govern these EBP implementation issues. Some recommendations might also be useful as indicators to monitor the usage of EBP in daily clinical practice. Furthermore, this review could stimulate the testing of some of our recommendations through appropriately designed studies.

Although the majority of healthcare professionals appear quite EBP-minded and the uptake of EBP is progressing,49 important barriers are still obstructing the full implementation of EBP in daily clinical practice. These findings occur consistently among the various medical specialists and nurses alike, and in many specific settings and specialties throughout the world. However, Brown et al found in a multiple regression analysis that perceived barriers to research use predicted only a fraction of practice, attitude and knowledge/skills associated with EBP.23 Apparently, the most frequently reported barriers are not necessarily the main reason for a poor implementation of EBP. Rather, a change in mind set seems indicated among the various healthcare professionals who perceive these barriers. Additional barriers to EBP implementation may lie at the organisational level.4 Hence, an integrative approach, involving all professionals and supported by initiatives from various organisational levels, may be a more fitting solution.

An integrative approach to overcome perceived barriers to EBP has also been suggested by other authors,50 who reasoned that the best implementation strategy should be a multifocal, comprehensive programme involving all professionals and should be tailored to their desires and perceived barriers. A systematic review of 235 studies on (multifaceted) guideline implementation strategies presented imperfect evidence to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances.51 Opinion leaders and role models appear to have a key function.52 A recent systematic review, comprising seven observational studies, described the relation between EBP implementation and leadership among nurses.53 The evidence suggested that initiatives on the level of leadership, organisation and culture are pivotal for the process of implementing EBP in nursing. However, available evidence for the effectiveness of organisational infrastructures in promoting evidence-based nursing is scarce.4 In the medical realm, such evidence is also limited.28, 54–56

Other frameworks or multidimensional programmes have been proposed to improve research utillisation,13 or to stimulate the use of EBP by nurses,57 or on specific wards.58 Others have promoted a dedicated research agenda,59 integrated EBP education56, 60 or the implementation of EBP in specific medical specialties.16, 61 Clinically integrated rather than stand-alone EBP teaching initiatives have been shown to improve EBP behaviour and may therefore help implement EBP in clinical practice.62 These initiatives per se seem defective because none of these aspects can be omitted to arrive at a truly evidence-based healthcare: if EBP education falls short, managers do not facilitate EBP activities, doctors do not apply EBP in their daily practice or nurses are lagging behind in EBP knowledge, optimum evidence-based healthcare eventually will not (fully) reach the patients who deserve it. This has been one of the reasons why a European teaching project has started to incorporate evidence-based medicine in clinical practice.63


Although not all studies found were performed in teaching hospitals, the majority may have been performed in centres that already had the aim, or were in the process of implementing EBP. Many other centres are likely to be lagging further behind. However, higher response rates were not associated with more positive attitudes towards EBP. Given the settings and types of respondents in the studies included here, the inferences of our review appear primarily valid for clinical doctors and nurses from various specialties in centres that aim at implementing EBM.

Second, the questionnaires used were self-reported and response rates varied considerably. For both reasons, our results may overestimate enthusiasm, knowledge and uptake of EBP. On the other hand, the framework of implementation recommendations we derived from these studies may be useful for all centres striving at a better EBP implementation.

Third, in our review, we searched for surveys of EBP attitude, knowledge, awareness, barriers and facilitators rather than studies specifically focusing on testing alternatives to improve implementation of EBP. Such studies, however, are rare.4, 28, 53 The implementation factors these studies mentioned also became clear from our review, while the success of these implementation strategies is still unclear. One of the reasons for this is the absence of a valid means of assessing actual EBP behaviour during daily practice.62, 64–66

Finally, we realise EBP is an essential but not the sole factor to improve quality of care. Even if clinicians are aware of available evidence, the right thing to do does not always happen. Continuous quality improvement strategies also involve active implementation of available evidence and existing guidelines. Nevertheless, a critical evidence-based attitude towards current practice remains the first step towards quality improvement.


Our review of all available surveys on the barriers for, and promotion of, EBP activities as perceived by clinical doctors and nurses suggests that EBP implementation needs a multilevel approach, involving interventions in the policy-making, managerial, educational and practical areas. We offer a summary of the suggested interventions at these different levels. These may be used not only to implement, but also to monitor the usage of EBP in daily clinical practice. This requires a joint effort and cultural change within the whole healthcare organisation, but is likely to result in a better quality of care.


Contributors: DTU and HV conceived the idea of the study and were responsible for its design. They also performed data acquisition and analysis. DU drafted the paper, HV revised it critically. GHG contributed substantially to the draft of the article, provided input to the data analysis and the interpretation of the results, and revised the manuscript critically. All authors gave approval for the final version.

Funding: This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Competing interests: None.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data sharing statement: There are no additional data available .

1. Sackett DL,Rosenberg WM,Gray JA,et al. Evidence based medicine: what it is and what it isn't. BMJYear: 1996;312:71–28555924
2. Evidence-Based Medicine Working GroupEvidence-based medicine. A new approach to teaching the practice of medicine. JAMAYear: 1992;268:2420e51404801
3. Claridge JA,Fabian TC. History and development of evidence-based medicine. World J SurgYear: 2005;29:547–5315827845
4. Flödgren G,Rojas-Reyes MX,Cole N,et al. Effectiveness of organisational infrastructures to promote evidence-based nursing practice. Cochrane Database Syst RevYear: 2012;2:CD00221222336783
5. Committee on Quality of Health Care in America, Institute of MedicineCrossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academies Press, Year: 2001
6. Nyweide DJ,Anthony DL,Chang CH,et al. Seniors’ perceptions of health care not closely associated with physician supply. Health Aff (Millwood)Year: 2011;30:219–2721289342
7. Balakas K,Potter P,Pratt E,et al. Evidence equals excellence: the application of an evidence-based practice model in an academic medical center. Nurs Clin North AmYear: 2009;44:1–10, ix. 19167544
8. Glasziou P,Ogrinc G,Goodman S. Can evidence-based medicine and clinical quality improvement learn from each other?BMJ Qual SafYear: 2011;20:i13–17
9. McColl A,Smith H,White P,et al. General practitioner's perceptions of the route to evidence based medicine: a questionnaire survey. BMJYear: 1998;316:361–59487174
10. Funk SG,Champagne MT,Wiese RA,et al. BARRIERS: the barriers to research utilization scale. Appl Nurs ResYear: 1991;4:39–451741634
11. McCaughey D,Bruning NS. Rationality versus reality: the challenges of evidence-based decision making for health policy makers. Implement SciYear: 2010;5:3920504357
12. Carlson CL,Plonczynski DJ. Has the BARRIERS Scale changed nursing practice? An integrative review. J Adv NursYear: 2008;63:322–3318727758
13. Tagney J,Haines C. Using evidence-based practice to address gaps in nursing knowledge. Br J NursYear: 2009;18:484–919377394
14. Zwolsman S,te Pas E,Hooft L,et al. Barriers to GPs’ use of evidence-based medicine: a systematic review. Br J Gen PractYear: 2012;62:e511–2122781999
15. Kajermo KN,Boström AM,Thompson DS,et al. The BARRIERS scale—the barriers to research utilization scale: a systematic review. Implem SciYear: 2010;5:32
16. Van Dijk N,Hooft L,Wieringa-de Waard M. What are the barriers to resident's practicing evidence-based medicine? A systematic review. Acad MedYear: 2010;85:1163–7020186032
17. Ahmadi-Abhari S,Soltani A,Hosseinpanah F. Knowledge and attitudes of trainee physicians regarding evidence-based medicine: a questionnaire survey in Tehran, Iran. J Eval Clin PractYear: 2008;14:775–919018910
18. Al-Almaie SM,Al-Baghli N. Barriers facing physicians practicing evidence-based medicine in Saudi Arabia. J Contin Educ Health ProfYear: 2004;24:163–7015490548
19. Al Omari M,Khader Y,Jadallah K,et al. Evidence-based medicine among hospital doctors in Jordan: awareness, attitude and practice. J Eval Clin PractYear: 2009;15:1137–4120367717
20. Al-Omari FK,Al-Asmary SM. Attitude, awareness and practice of evidence-based medicine among consultant physicians in western region of Saudi Arabia. Saudi Med JYear: 2006;27:1887–9317143370
21. Andersson N,Jylli L,Kajermo KN,et al. Nurses in paediatric care—self-reported professional self and perceived research utilization. Scand J Caring SciYear: 2007;21:426–3318036005
22. Brown CE,Wickline MA,Ecoff L,et al. Nursing practice, knowledge, attitudes and perceived barriers to evidence-based practice at an academic medical center. J Adv NursYear: 2009;65:371–8119040688
23. Montori VM,Guyatt GH. Progress in evidence-based medicine. JAMAYear: 2008;300:1814–1618854545
24. Chiu YW,Weng YH,Lo HL,et al. Comparison of evidence-based practice between physicians and nurses: a national survey of regional hospitals in Taiwan. J Contin Educ Health ProfYear: 2010;30:132–820564703
25. Gale B,Schaffer MA. Organizational readiness for evidence-based practice. J Nurs AdminYear: 2009;39:91–7
26. Gerrish K,Ashworth P,Lacey A,et al. Developing evidence-based practice: experiences of senior and junior clinical nurses. J Adv NursYear: 2008;62:62–7318352965
27. Hadley JA,Wall D,Khan KS. Learning needs analysis to guide teaching evidence-based medicine: knowledge and beliefs amongst trainees from various specialties. BMC Med EducYear: 2007;7:1117493274
28. Oude Rengerink K,Thangaratinam S,Barnfield G,et al. How can we teach EBM in clinical practice? An analysis of barriers to implementation of on-the-job EBM teaching and learning. Med TeachYear: 2011;33:e125–3021345051
29. Koehn ML,Lehman K. Nurses’ perceptions of evidence-based nursing practice. J Adv NursYear: 2008;62:209–1518394033
30. Lai NM,Teng CL,Lee ML. The place and barriers of evidence-based practice: knowledge and perceptions of medical, nursing and allied health practitioners in Malaysia. BMC Res NotesYear: 2010;3:27921050429
31. Melnyk BM,Fineout-Overholt E,Fishbeck Feinstein N,et al. Nurses’ perceived knowledge, beliefs, skills, and needs regarding evidence-based practice: implications for accelerating the paradigm shift. Worldviews Evid Based NursYear: 2004;1:185–9317163896
32. Mehrdad N,Salsali M,Kazemnejad A. The spectrum of barriers to and facilitators of research utilization in Iranian nursing. J Clin NursYear: 2008;17:2194–20218710376
33. Mittal R,Peraketh B. Evidence-based surgery: knowledge, attitudes, and perceived barriers among surgical trainees. J Surg EducYear: 2010;67:278–8221035766
34. Nwagwu W. Levels of consciousness and awareness about evidence-based medicine among consultants in tertiary health care institutions in Nigeria. Health Info Libr JYear: 2008;25:278–8719076674
35. Oliveri RS,Gluud C,Wille-Jørgenson PA. Hospital doctors’ self-rated skills in and use of evidence-base medicine—a questionnaire survey. J Eval Clin PractYear: 2004;10:219–2615189388
36. Oranta O,Routalaso P,Hupli M. Barriers to and facilitators of research utilization among Finnish registered nurses.J Clin NursYear: 2002;11:205–1311903720
37. Palfreyman S,Tod A,Doyle J. Comparing evidence-based practice of nurses and physiotherapists. Br J NursYear: 2003;12:246–5312671571
38. Parahoo K,McCaughan EM. Research utilization among medical and surgical nurses: a comparison of their self reports and perceptions of barriers and facilitators. J Nurs ManagYear: 2001;9:21–3011879441
39. Poolman RW,Sierevelt IN,Farrokhyar F,et al. Perceptions and competence in evidence-based medicine: are surgeons getting better? A questionnaire survey of members of the Dutch Orthopaedic Association. J Bone Joint Surg AmYear: 2007;89:206–1517200328
40. Roth K,Siemens DR. The status of evidence-based medicine education in urology residency. Can Urol AssocYear: 2010;4:114–20
41. Scales CD,Voils CI,Fesperman SF,et al. Barriers to the practice of evidence-based urology. J UrolYear: 2008;179:2345–5018423732
42. Sur RL,Scales CD,Preminger GM,et al. Evidence-based medicine: a survey of American Urological Association members. J UrolYear: 2006;176:1127–3416890708
43. Ubbink DT,Vermeulen H,Knops AM,et al. Implementation of evidence-based practice: outside the box, throughout the hospital. Neth J MedYear: 2011;69:87–9421411849
44. Ulvenes LV,Aasland O,Nylenna M,et al. Norwegian physicians’ knowledge of and opinions about evidence-based medicine: cross-sectional study. PLoS OneYear: 2009;4:e782819915708
45. Upton D,Upton P. Knowledge and use of evidence-based practice of GOPs and hospital doctors.J Eval Clin PractYear: 2005;12:376–8416722924
46. Veness M,Rikard-Bell G,Ward J. Views of Australian and New Zealand radiation oncologists and registrars about evidence-based medicine and their access to internet based sources of evidence. Australas RadiolYear: 2003;47:409–1514641194
47. Upton D,Upton P. Development of an evidence-based practice questionnaire for nurses. J Adv NursYear: 2006;53:454–816448488
48. Estabrooks CA. Mapping the research utilization field in nursing. Can J Nurs ResYear: 1999;31:53–7210455587
49. Amin M,Saunders JA,Fenton JE. Pilot study of the knowledge and attitude towards evidence-based medicine of otolaryngology higher surgical trainees. Clin OtolaryngolYear: 2007;32:120–3517403230
50. Brown CC,Ecoff L,Kim SC,et al. Multi-institutional study of barriers to research utilization and evidence-based practice among hospital nurses. J Clin NursYear: 2010;19:1944–5120920021
51. Grol R,Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. LancetYear: 2003;362:1225–3014568747
52. Grimshaw J,Eccles M,Thomas R,et al. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern MedYear: 2006;21 (Suppl 2):S14–2016637955
53. Flödgren G,Parmelli E,Doumit G,et al. Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst RevYear: 2011;8:CD00012521833939
54. Sandström B,Borglin G,Nilsson R,et al. Promoting the implementation of evidence-based practice: a literature review focusing on the role of nursing leadership. Worldviews Evid Based NursYear: 2011;8:212–2321401858
55. Pronovost PJ,Berenholtz SM,Dorman T,et al. Evidence-based medicine in anesthesiology. Anesth AnalgYear: 2001;92:787–9411226121
56. Swanson JA,Schmitz D,Chung KC. How to practice evidence-based medicine. Plast Reconstr SurgYear: 2010;126:286–9420224459
57. Kitto S,Petrovic A,Gruen RL,et al. Evidence-based medicine training and implementation in surgery: the role of surgical cultures. J Eval Clin PractYear: 2011;17:819–2620704631
58. Olade RA. Strategic collaborative model for evidence-based nursing practice. Worldviews Evid Based NursYear: 2004;1:60–817147759
59. Aitken LM,Hackwood B,Crouch S,et al. Creating an environment to implement and sustain evidence based practice: a developmental process. Aust Crit CareYear: 2011;24:244–5421295994
60. Neugebauer EA,Morino M,Habermalz B. Surgical research or comic opera? Let's give answers!Surg EndoscYear: 2008;22:1411–1218398640
61. Glasziou P,Burls A,Gilbert R. Evidence based medicine and the medical curriculum. BMJYear: 2008;337:a125318815165
62. Ubbink DT,Legemate DA. Evidence-based surgery. Br J SurgYear: 2004;91:1091–215449257
63. Coomarasamy A,Khan KS. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJYear: 2004;329:101715514348
64. Thangaratinam S,Barnfield G,Weinbrenner S,et al. Teaching trainers to incorporate evidence-based medicine (EBM) teaching in clinical practice: the EU-EBM project. BMC Med EducYear: 2009;9:5919744327
65. Shaneyfelt T,Baum KD,Bell D. et al. Instruments for evaluating education in evidence-based practice: a systematic review. JAMAYear: 2006;296:1116–2716954491
66. Oude Rengerink K,Zwolsman SE,Ubbink DT,et al. Tools to assess evidence-based practice behaviour among healthcare professionals—a systematic review. Evid Based MedYear: 2013; in press.


[Figure ID: BMJOPEN2012001881F1]
Figure 1 

Countries from which studies were included.

[Figure ID: BMJOPEN2012001881F2]
Figure 2 

Doctors’ knowledge of common evidence-based practice terms. The numbers between brackets indicate the number of studies that used this term. Terms with an asterisk are meaningless dummy terms.

[Figure ID: BMJOPEN2012001881F3]
Figure 3 

Nurses’ knowledge of common evidence-based practice terms. Terms with an asterisk are meaningless dummy terms.

[TableWrap ID: BMJOPEN2012001881TB1] Table 1 

Characteristics of included studies

Author Year Country Teaching hospital(s) Respondents EBP aspects studied*
Ahmadi17 2008 Iran Yes Internal medicine interns, residents and fellows 1,2,3
Al-Almaie18 2004 Saudi Arabia No Doctors from various specialties 5
Al-Omari19 2009 Jordan Both Specialists, fellows, residents from various specialties 1,2,4,5,6
Al-Omari20 2006 Saudi Arabia Both Consultant physicians from various specialties 1,2,3,5
Amin10 2007 Ireland Yes Otorhinolaryngology surgical trainees 1,4
Andersson21 2007 Sweden Yes Trainee and specialist paediatric nurses 5
Brown22 2009 USA Yes Nurses from various specialties 5,6
Brown23 2010 USA Both Nurses from various specialties 5
Chiu24 2010 Taiwan No Doctors and nurses from various specialties 1,2,5
Gale25 2009 USA No Staff nurses and nurse managers from 8 ICUs 1,5,6
Gerrish26 2008 UK Both Nurses from various specialties 5
Hadley27 2007 UK No Junior doctors 1,2
Kitto28 2007 Australia No Surgeons 5
Koehn29 2008 USA No Staff nurses, unit managers, clinical advisors 1,5
Lai30 2010 Malaysia No Doctors, nursing and allied health staff before attending EBM workshop 1,5
Melnyk31 2004 USA Unknown Nurses before attending EBP workshops 1,5
Mehrdad32 2008 Iran Yes Clinical nurses and nurse educators 5,6
Mittal33 2010 India No Surgical trainees attending continuing education meeting 1,2,3,4,5
Nwagwu34 2008 Nigeria Yes Consultants in tertiary healthcare institutions 2,3
Olivieri35 2004 Denmark Yes Doctors from various specialties 2,4
Oranta36 2002 Finland No Staff and ward nurses 5,6
Palfreyman37 2003 UK Yes Nurses and physiotherapists from various specialties 2,5
Parahoo38 2001 N-Ireland No Medical and surgical nurses 1,5,6
Poolman39 2007 Netherlands Unknown Orthopaedic surgeons 1,2,4
Roth40 2010 Canada Unknown English-speaking urology residents participating in national review course 2,3,4,5
Scales41 2008 USA Both American Urology Association members 1,5
Sur42 2006 USA Unknown American Urology Association members 1,3,4
Ubbink43 2011 Netherlands Yes Doctors and nurses from various specialties 1,2,3,4,5,6
Ulvenes44 2009 Norway Unknown Reference panel of Norwegian physicians 1,2
Upton45 2005 UK Unknown Doctors from various specialties 2,5,6
Veness46 2003 Australia & New Zealand Unknown Radiation oncologists and registrars 1,2,3,4,6

*1=Attitude; 2=skills; 3=awareness; 4=knowledge; 5=barriers; 6=facilitators.

EBM, evidence-based medicine; EBP,evidence-based practice; ICU, intensive care unit.

[TableWrap ID: BMJOPEN2012001881TB2] Table 2 

Quality characteristics of included studies

Author Centres (N) Respondents (N) Response rate (%) Questionnaire robustness*
Ahmadi17 1 104 80 +
Al-Almaie18 3 273 67
Al-Omari19 5 386 97 ++
Al-Omari20 9 178 86 ++
Amin10 Countrywide 19 95 ++
Andersson21 2 113 80 ++
Brown22 1 458 45 ++
Brown23 4 974 75 ++
Chiu24 61 1156 69 ++
Gale25 1 92 22 ++
Gerrish26 2 598 42 ++
Hadley27 Several 317 100 ++
Kitto28 Several 25 50 +
Koehn29 1 422 41 ++
Lai30 2 144 72 +
Melnyk31 Several 160 100 +
Mehrdad32 15 410 70 ++
Mittal33 22 93 85 ++
Nwagwu34 10 89 89
Olivieri35 1 225 60 ++
Oranta36 2 253 80 ++
Palfreyman37 1 106 24 ++
Parahoo38 10 479 53 ++
Poolman39 Countrywide 367 60 ++
Roth40 Several 29 100 ++
Scales41 Countrywide 365 72 ++
Sur42 Countrywide 714 9 ++
Ubbink43 1 701 72 ++
Ulvenes44 Countrywide 976 70
Upton45 Countrywide 381 76 ++
Veness46 Countrywide 191 79 ++
Total 24 (77%)
>1 Centre
25 (81%)
>100 Respondents
23 (74%)
≥60% Response
24 (77%)

*Robustness based on pilot testing, previous validation, or Cronbach's α.

[TableWrap ID: BMJOPEN2012001881TB3] Table 3 

Attitudes of doctors and nurses towards EBP

Median (range)
Median (range)
Your current attitude towards EBP
Least positive (0) to Extremely positive (100)
72.3 (49–97) 66.7 (55–85)
Attitude of your colleagues towards EBP
Least positive (0) to Extremely positive (100)
61.0 (41–89) 48.0 (48–48)
How useful are research findings in daily practice?
Useless (0) to Extremely useful (100)
80.0 (46–97) 62.0 (34–82)
What percentage of your clinical practice is evidence-based?
0% to 100%
52.6 (40–80) 44.9 (44–46)
Practicing EBP improves patient care
Completely disagree (0) to Fully agree (100)
80.1 (52–97) 80.7 (74–87)
EBP is of limited value in clinical practice, because a scientific basis is lacking
Completely disagree (0) to Fully agree (100)
36.3 (3–43) 48.3 (48–49)
Implementing EBP, however worthwhile as an ideal, places another demand on already overloaded surgeons/nurses
Completely disagree (0) to Fully agree (100)
51.4 (37–56) 55.2 (17–61)
The amount of evidence is overwhelming
Completely disagree (0) to Fully agree (100)
53.5 (50–57) No data
EBP fails in practice
Completely disagree (0) to Fully agree (100)
39.7 (15–84) 41.0 (39–63)
EBP is important for my profession
Completely disagree (0) to Fully agree (100)
68.3 (52–95) 61.6 (30–93)

Scores can range from 0 to 100.

EBP, evidence-based practice.

[TableWrap ID: BMJOPEN2012001881TB4] Table 4 

Barriers to apply EBP as mentioned by doctors and nurses

Doctors and nurses alike
▪ Lack of time to read evidence or implement new ideas ▪ Lack of facilities or resources ▪ Lack of staff experienced in EBP ▪ Lack of training in EBP ▪ EBP is insufficiently supported by staff and management ▪ Evidence is not easily available ▪ Unawareness of research ▪ Evidence is not generalisable to own setting
Doctors Nurses
▪ Lack of evidence ▪ Conflicting evidence ▪ Evidence is not incorporated in clinical practice ▪ EBP negatively impacts medical skills and freedom ▪ Evidence is written in foreign language ▪ Lack of authority to change practice ▪ Statistics or research is unintelligible ▪ Implications for practice are unclear

Stated are those ranked among the top ten in most studies.

EBP, evidence-based practice.

[TableWrap ID: BMJOPEN2012001881TB5] Table 5 

Structural incorporation of EBP at various levels as stated by the authors of the individual studies

Level Intervention by Effect Author
Worldwide International collaboration Expansion and acceleration of the production and maintenance of Cochrane Systematic Reviews Oliveri
Global and international associations Promotion of EBP
Making EBP courses available
Scientific journals Educational efforts
Publishing high quality research
Poolman, Veness
Scales, Sur
National Governmental enforcement EBP in all undergraduate and postgraduate healthcare educational institutions Melnyk, Ubbink
Installing and financing regulatory professional bodies Quality assurance
Practicing EBP
Use of guidelines
Installing and financing a national institute Development of evidence based guidelines Al-Almaie
Arranging and financing Free use of the Cochrane Library Oliveri
Policy makers, professional associations, health insurance companies and regulatory bodies Promotion of EBP Scales, Oliveri, Poolman, Melnyk
Board of hospital directors Incorporating EBP in strategic aims Goals tailored on systematic evaluations
Implementation of EBP and research utilisation
Brown 2009, Ubbink
Installing research councils High-quality research Brown 2009, Melnyk
Allocating budget High-quality research Mehrdad
Performing systematic evaluations during working visits, quarterly meetings with managers Increased hospital‘s level of EBP implementation and quality of care Ubbink
Incorporating performance of EBP activities by directors, managers and administrators in annual interviews Increased hospital‘s level of EBP implementation and quality of care Ubbink
Providing management, administrators and directors with tools and means Effective learning and practising EBP Al Ohmari 2006, Lai
Managers Integrating EBP and policy setting Evidence-based management Al Ohmari 2009
Recruitment, selection, employment of new personnel Identifying EBP role models among current personnel EBP-minded working force Ubbink, Brown 2010
Building an infrastructure and environment with an atmosphere that supports, promotes and embraces EBP (ie, incentives, prizes or rewards, positive attitude) Effective tools for implementing, learning and practising EBP
Knowledgeable (nurse) researchers, (nurse) specialists, master’ prepared professionals, faculty, research departments
Al-Almaie, Al Ohmari 2006, Brown 2009, Chui, Gale, Gerrish, Melnyk, Mehrdad, Mittal, Oranta, Parahoo, Ubbink
Collaborating with educators Organisational barriers and education addressed Brown 2009
Allocating budget (More) dedicated EBP personnel, education, activities, computers and facilities at each point of care. Attending continuous education, (inter)national conferences Brown 2009, Gale, Gerrish, Mehrdad, Melnyk, Lai
Provide non-patient hours to personnel Time for EBP activities and implementation, changing practice, and quality care development Brown 2009, Gale, Mehrad, Palfeyman
Regular evaluation (audit and feedback) of ward-level EBP activities, knowledge, skills, behaviour and research utilisation during annual interviews Annual evaluation of implementing EBP-activities Ahmandi, Al-Almaie, Al Ohmari 2009, Ubbink
Educators Incorporating and inflating time spent on EBP by refining and modifying curriculum and education style in postgraduate and undergraduate medical and nursing curricula Each non-academic degree professional produces a Cochrane Systematic review
Improved audit and feedback, systematic evaluation, and needs assessment
Tiered, feasible and realistic education
Ahmandi, Al-Almaie, Al-Ohmari 2006, Amin, Andersson, Brown 2009,
Gale, Gerrish, Hadley, Kitto, Koehn, Lai, Mehrdad, Melnyk, Mittal, Nwagwu, Oliveri, Parahoo, Poolman, Scales, Sur, Ubbink, Upton
Formulating the curriculum and educating in collaboration with healthcare professionals EBP integration Al-Almaie, Al Ohmari 2006, Brown 2009, Gale, Gerrish, Lai
Interactive, face-to-face education in clinical practice and at the bed side EBP integration Ahmandi, Al-Almaie, Amin, Al Ohmari 2006, Kitto, Melnyk, Poolman
Interactive education E-learning modules Kitto, Poolman, Ubbink
EBP internship programme
In-service training
Extended EBP education Brown 2009
Accessing, appraising and interpreting guidelines, research and protocols, basic statistical analysis, research training, IT-technology, quality development, change management, being a role model, English language Optimum content of education Al Ohmari 2006, Andersson, Gerrish, Lai, Mehrdad, Mittal, Nwagwu, Oranta, Parahoo
Educating all educators in EBP Well-equipped educators Oranta
Emphasising professionals’ own responsibility Professional skills and competencies maintained Oranta
Evaluating effectiveness of EBP teaching Optimum EBP education Ulvenes, Veness
Faculty and researchers Documenting, analysing and interpreting the effectiveness of actions undertaken EBP implementation Brown 2009
Support professionals in clinical setting by simple and clear (written) communication EBP implementation Mehrdad, Brown 2009
Using a variety of strategies Dissemination of research findings
Valorisation of results in practice
Brown 2009
Close collaboration with practicing professionals Shared language and understanding of concepts
Actual relevant clinical questions are addressed
Being a role model Real-life discussions about patients Poolman
Performing and promoting research Well-designed high quality research Scales, Sur
Services Medical library facilities Service for searching databases
Clinical letters, journals and guidelines
Al Ohmari 2006, Melnyk, Mittal, Parahoo, Ubbink, Al Ohmari 2006,
Computer and internet facilities at point of care, ward, or in EBP suites Liberal access to databases
Tailored to EBP level of professionals
Al Ohmari 2006, Gale, Lai, Mehrdad, Nwagwu, Chui, Melnyk, Ubbink
Content management system allowing access to guidelines, protocols, critically appraised topics and condensed recommendations User-friendly and reliable, readable and pre-appraised information
Provide work-based information
Al Ohmari 2009, Gerrish, Lai, Ubbink
Computer based decision support system with priority to systematic reviews  Computer-based guideline implementation
Alerts and reminders
Al-Almaie, Al Ohmari 2009
Accessible critical appraisal committee Easy assessment of relevant literature Mehrdad
Implementation guidance Overcomes obstacles to implement EBP or recommendation
Change in practice
Chui, Mehrdad
Local workplace Journal clubs, grand rounds, handovers, regular (research) meetings EBP implementation Oranta, Poolman, Ubbink
Dedicated time and personnel for EBP activities Individual support at the units Andersson, Ubbink
Easy access to EBP mentors, change mentors, innovators and educators, computers, databases and relevant EBP websites or links EBP implementation Al-Almaie, Chui, Gale, Lai, Mehrdad, Ubbink, Veness
Culture Emphasis on EBP in day-to-day practice Amin
Emphasis on patient benefit of EBP Gale, Melnyk
Sharing experience, knowledge and support Andersson
Activating autonomy and empower nurses to influence change Brown 2009, Gerrish
Shared governance structures Brown 2009
Engaging in research Gerrish
Willingness to facilitate the process of implementing Koehn
Innovative strategies including a culture of research implementation Mehrdad
Displaying interest and belief in value of research utilization Mittal
Enlightening professionals to use EBP in decision making Nwagwu
Supportive culture to research Parahoo

EBP, evidence-based practice.

Article Categories:
  • Evidence-Based Practice
    • Research
Article Categories:
  • 1506
  • 1694
  • 1710
  • 1709
  • 1722
  • 1694

Keywords: Medical Education & Training.

Previous Document:  Does implementation of the IMCI strategy have an impact on child mortality? A retrospective analysis...
Next Document:  Abdominal fat distribution and its relationship to brain changes: the differential effects of age on...