| Determination of the effectiveness of two methods for usability evaluation using a CPOE medication ordering system. | |
| | |
MedLine Citation:
|
PMID: 21435943 Owner: NLM Status: Publisher |
Abstract/OtherAbstract:
|
OBJECTIVES: To assess the effectiveness of two usability evaluation methods, cognitive walkthrough (CW) and think aloud (TA), for identifying usability problems and to compare the performance of CW and TA in identifying different types of usability problems. METHODS: A CW was performed by two usability evaluators and 10 physicians were recruited to perform a TA usability testing of a CPOE system (Medicator). The severity of identified usability problems was determined and the usability problems were categorized based on the User Action Framework (UAF). The potential of usability problems to cause medication errors was also determined. The thoroughness, validity and effectiveness of the two methods were compared. RESULTS: Fifty seven unique usability problems of different severity, spread over the four phases of interaction as defined by the UAF, were identified. The effectiveness of the TA method for identifying usability problems was 0.08 higher than that of the CW (0.70 vs. 0.62). The thoroughness (the extent to which a method can identify existing usability problems) of the TA was higher for the "Planning" and "Assessment" phases and lower for the "Translation" phase (as defined by UAF). The thoroughness of TA for identifying problems that may potentially result in medication errors was higher than that of CW (0.81 vs. 0.68). The number of usability problems identified by each of the methods was significantly less than the total number of detected real usability problems in Medicator (p<0.001). The observed differences between the number of real usability problems identified by CW and TA (38 vs. 41), the difference between the average severity of the detected problems by CW and TA (2.37 vs. 2.41), and the difference for identifying problems potentially resulting in medication errors (15 vs. 18) were not statistically significant (p>0.4). CONCLUSIONS: This study shows that although TA showed a slightly better effectiveness, there is no significant difference between the performance of the CW and the TA methods in terms of number of usability problems identified and the mean severity of these problems. Since no single evaluation method will uncover all of the usability problems a combination of methods is advised as the most appropriate approach, especially if usability problems can lead to potentially fatal outcomes. |
| | |
Authors:
|
R Khajouei; A Hasman; M W M Jaspers |
Related Documents
:
|
20676253 - Reasons for self-reported unmet healthcare needs in canada: a population-based provinci... 7595433 - Psychological problems and client engagement in methadone treatment. 21869103 - Solving problems in robotics with semantic networks. |
Publication Detail:
|
Type: JOURNAL ARTICLE Date: 2011-3-22 |
Journal Detail:
|
Title: International journal of medical informatics Volume: - ISSN: 1872-8243 ISO Abbreviation: - Publication Date: 2011 Mar |
Date Detail:
|
Created Date: 2011-3-25 Completed Date: - Revised Date: - |
Medline Journal Info:
|
Nlm Unique ID: 9711057 Medline TA: Int J Med Inform Country: - |
Other Details:
|
Languages: ENG Pagination: - Citation Subset: - |
Copyright Information:
|
Copyright © 2011 Elsevier Ireland Ltd. All rights reserved. |
Affiliation:
|
Department of Medical Informatics, Academic Medical Center, University of Amsterdam, The Netherlands; Kerman University of Medical Sciences, Kerman, Iran. |
Export Citation:
|
APA/MLA Format Download EndNote Download BibTex |
| MeSH Terms | |
Descriptor/Qualifier:
|
|
From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine
Previous Document: Study on the chemiluminescence behavior of bovine serum albumin with luminol and its analytical appl...
Next Document: Microneurographic evaluation of sympathetic activity in small fiber neuropathy.