Systematic assessment of culture review as a tool to assess errors in the clinical microbiology laboratory.
* Context.--Daily supervisory review is a common practice in
microbiology laboratories; however, there are no publications describing
errors corrected by this practice.
Objective.--To determine (1) the correction rates for routinely reviewed positive cultures, (2) the correction rates for negative cultures, and (3) the types of corrections that are found, including the number with potential clinical significance.
Design.--We prospectively assessed errors identified during culture report review for all positive (10-month period) and negative (1-month period) cultures at a single, university-based clinical microbiology laboratory in the United States. Errors were classified using predefined categories, and total and per category error rates were determined. A [chi square] test was used to assess significant differences between error rates.
Results.--A total of 112108 culture reports were examined; 914 reports required a total of 1043 corrections. Of 101 703 positive culture reports, 786 (0.8%) required 900 corrections, 302 (0.3%) of which were potentially clinically significant. Of 10 405 negative culture reports, 128 (1.2%) required 143 corrections, 5 (0.05%) of which were potentially clinically significant. The rate of potentially clinically significant errors was significantly higher among positive versus negative culture reports (P < .001). Errors from positive culture reports most commonly involved susceptibility (374 [42%]), reporting (275 [31%]), and identification workup (217 [24%]). Most potentially significant errors from positive culture reports involved susceptibility testing (n = 253) and specimens from wound or lower respiratory tract (P < .001).
Conclusions.--Review of culture reports from positive cultures from nonsterile sites with special attention to antimicrobial susceptibility testing and reporting would be most likely to detect potentially significant errors within the clinical microbiology laboratory.
Microbiological laboratories (Management)
Microbiological laboratories (Standards)
Clinical pathology (Standards)
Cultures (Biology) (Standards)
Ulness, Bruce K.
Prentice, Jennifer L.
Cookson, Brad T.
Limaye, Ajit P.
|Publication:||Name: Archives of Pathology & Laboratory Medicine Publisher: College of American Pathologists Audience: Academic; Professional Format: Magazine/Journal Subject: Health Copyright: COPYRIGHT 2008 College of American Pathologists ISSN: 1543-2165|
|Issue:||Date: Nov, 2008 Source Volume: 132 Source Issue: 11|
|Topic:||Event Code: 200 Management dynamics; 350 Product standards, safety, & recalls Computer Subject: Company business management|
|Product:||Product Code: 3841333 Culture-Based Tests NAICS Code: 339112 Surgical and Medical Instrument Manufacturing SIC Code: 2836 Biological products exc. diagnostic|
|Geographic:||Geographic Scope: United States Geographic Code: 1USA United States|
The detection of clinically significant errors is central to
hospital quality improvement efforts. Identification of errors, analysis
of their causes, and interventions to prevent recurrence are fundamental
principles of improving patient safety. The Joint Commission's
National Patient Safety Goals and Sentinel Event Policy are examples of
national efforts designed to improve the quality of patient care. (1)
Accurate and timely clinical laboratory test results are essential
factors in providing quality patient care.
The Joint Commission requires daily supervisory review of patient results (Laboratory Standard QC.1.90); however, review of every result is not required. (1) Laboratories may design their own algorithms to determine which results to review. Although supervisory review of all laboratory results is not required by the College of American Pathologists Laboratory Accreditation Program, it can be used to address the College of American Pathologists phase II question (Microbiology Checklist Question MIC.11100): "Is there a documented system in operation to detect and correct significant clerical and analytical errors, and unusual laboratory results, in a timely manner?" (2) Automated laboratory instruments may have computerized systems for result review; however, human review is required in many circumstances. In the microbiology laboratory, this frequently takes the form of daily review of reported and/or intermediate culture or other test results for completeness and accuracy. The reviewer is often a supervisor or experienced microbiologist.
In our laboratory, review of positive cultures and other microbiology testing has been carried out for more than 30 years. Workup and report sections of bacterial and fungal cultures, serology, parasitology, and molecular testing are reviewed daily within 24 hours of reporting. Negative culture reports (CRs), cultures, or direct examinations with no reported organisms or only normal resident organisms are not routinely reviewed. In recent years, review of CRs has been rotated between 5 clinical technologist leads, all of whom are experienced clinical microbiologists.
This study is a logical extension of our previous work in detecting errors in microbiology identified through corrected reports. (3) Another study looked at using laboratory incident reports as a means of identifying errors. (4) Despite the fact that review of CRs is a standard, longstanding practice in many microbiology laboratories, there are no published data analyzing the ability of this process to detect potentially clinically significant errors. We undertook this study to determine (1) the correction rate for routinely reviewed positive cultures, (2) the correction rate for negative cultures, and (3) the types of corrections that are found, including the number with potential clinical significance.
MATERIALS AND METHODS
Culture Report Corrections
In our laboratory, daily culture review is rotated among 5 clinical technologist leads, all of whom are certified as either Medical Technologists (American Society for Clinical Pathology) or Registered Microbiologists (National Registry of Microbiologists) and have at least 15 years of experience in clinical microbiology. Once finalized, CRs are reviewed for completeness of report and workup, adherence to laboratory protocols, correlation between reported organism identification and identification test results, review of antimicrobial susceptibility testing for unusual patterns, and agreement between reported organism identifications, antimicrobial susceptibility, workup tests, and direct Gram stain. Corrections identified by the leads during routine positive CR review in our laboratory were prospectively assessed for 10 months (October 2004 through July 2005). Negative CRs were reviewed for 1 month (October 2005) by one of the leads. Types of reports reviewed included bacterial culture, fungal culture, direct examinations including parasitology, environmental cultures, infectious disease serology, reference testing (isolates sent to the laboratory for identification from outside laboratories), and molecular testing for bacteria, including acid-fast bacilli and fungi. Data recorded included specimen type, collection and reporting dates, problem to be corrected, and action taken. Corrections were classified into 5 predefined technical categories (Table 1), by culture site and type, by day of the week on which they were reported, and on the basis of potential clinical significance. Potentially clinically significant corrections were those that, if left uncorrected, could have led to inappropriate treatment decisions. For example, in the category of identification workup, failure to rule out Salmonella on an H2S-positive nonfermenter in a stool culture was considered potentially clinically significant. Other potentially clinically significant errors include reporting predominant growth of an Enterococcus spp in a urine culture as "grampositive flora" (report category) and failure to perform D-zone testing on an erythromycin-resistant, clindamycin-susceptible Staphylococcus aureus from a wound culture (susceptibility category). Error rates were calculated for overall errors by technical category and potential clinical significance; significant differences between error rates were assessed using a [chi square] test. (5)
The University of Washington (Seattle) Human Subjects Division does not require approval for this type of study.
The number and percentage of corrections found are presented in Table 2 (all corrections) and Table 3 (potentially clinically significant corrections). For all cultures, 914 of 112108 CRs required a total of 1043 corrections
(0.9%). For positive cultures, 786 (0.8%) of 101 703 CRs
required a total of 900 corrections. For negative cultures,
128 (1.2%) of 10 405 CRs required a total of 143 corrections. The difference between the number of potentially clinically significant corrections made to positive and negative CRs is statistically significant (P < .001). Only 3.5% of the corrections from negative CRs are potentially significant, one tenth the rate for positive CRs (34%). Most corrections to negative CRs (138/143) were minor corrections not likely to impact patient care. Almost half (42%) of all corrections from the positive CRs and most (84%) of the potentially clinically significant corrections fell into the susceptibility category. The largest subcategory of susceptibility testing corrections was D-zone testing for inducible clindamycin resistance in S aureus isolates, (6) a total of 164 (44%) of 374 corrections. Furthermore, 40% of potentially clinically significant corrections involved D-zone testing. More specifically, the most frequent D-zone-related errors included incorrect or no D-zone comment reported (n = 98) and D-zone results not entered (n = 46). In the identification (ID) workup category, 205 (94%) of 217 corrections related to missing ID workup results; however, only 28 (9%) were potentially clinically significant. In the report category, 70 (25%) of 275 corrections related to reported p-strep comments (eg, "no beta-hemolytic streptococci isolated"), and 42 (15%) related to reported quantity. None of these corrections were potentially clinically significant.
For the negative CRs, the most common correction was the failure to add reporting comments, such as "ruled out by serology" (n = 56), which is used when a potential pathogen, such as group A Streptococcus, is ruled out by serologic rather than biochemical testing. The second most common correction was missing workup data, such as failure to record "no growth" on the final day of culture (n = 28). The potentially significant errors that were found by reviewing negative CRs were all in the ID workup category. In each case, a potential pathogen was not adequately ruled out per laboratory protocol. In the 5 cases we report, the organisms insufficiently identified were an S aureus from a left nostril, a potential Arcanobacterium spp from a throat culture, a potential Salmonella serotype from a stool culture, and 2 instances of non-group A [beta]-hemolytic Streptococcus spp from throat cultures.
When categorized by culture site, sterile sites (eg, blood cultures, pleural fluid) accounted for only 17% of all corrections and 14% of potentially clinically significant corrections (P < .001), although they represented 34% of all cultures (Figure). A total of 22% of urine cultures received in the laboratory required corrections--the highest percentage among all culture sites--followed by lower respiratory tract (LRT; 20%) and wound (19%) cultures. Corrections to wound cultures were most likely to be potentially clinically significant (32% of the wound culture corrections), followed by LRT cultures (22% of LRT cultures).
This study makes a number of significant contributions to the patient safety literature in microbiology. To our knowledge, it is the first published report demonstrating that the process of culture review can be used to detect clinically significant errors in the microbiology laboratory. This is the first published report quantifying that the actual error rate in a microbiology laboratory is less than 1%. In addition, the study data strongly suggest that laboratories with limited resources can focus their efforts to maximize the identification of clinical significant errors.
Review of positive CRs yielded an average of 79 corrections per month, 49 of which (62%) were unlikely to be significant. The remaining 30 were potentially clinically significant, an average of 1 per day. Of these 30, 25 (83%) were related to antimicrobial susceptibility testing. Over the course of 1 month, only 5 potentially significant errors were found in the negative CRs, an average of 1 every 6 days. Cultures from sterile sites had a lower rate of correction than urine, LRT, and wound cultures. Wound and LRT cultures together accounted for more than half (54%) of the potentially significant corrections. Other cultures with a low rate of correction include direct microscopic exams, "rule out" cultures where 1 specific organism is of concern (eg, Legionella, Nocardia), and reference isolates sent to the laboratory for identification and/or susceptibility testing.
By reviewing only positive CRs, 86% of all corrections and 98% of potentially clinically significant corrections would have been identified. Reviewing negative CRs, those with no organisms, or only normal resident organisms reported would require review of approximately 300 to 350 reports every day, essentially doubling the number of daily reviews. With an average yield of only approximately 1 potentially clinically significant error per week in a large, full-service, university microbiology laboratory, routine review of negative cultures may not be warranted, particularly if resources are limited.
Uncorrected errors relating to antimicrobial susceptibility testing have the potential for clinical impact through inappropriate antimicrobial selection or delay in treatment. Antimicrobial susceptibility is a complex and everevolving aspect of microbiology and could be a focus for review. In particular, the large number of D-zone-related corrections required suggests the need for additional training and/or changes to the process in our laboratory.
Sterile sites are more likely to yield pure cultures and, due to the likelihood of significance, there are fewer workup decisions; most isolates from sterile sites are identified fully and tested for susceptibility. Urine, LRT, or wound cultures may be pure or mixed; however, they are more likely to grow organisms with different degrees of identification or susceptibility requirements, depending on relative or absolute quantity, specimen type, or patient clinical history. These cultures are more complex to work up, and therefore they are more likely to have errors. If culture review were limited to only positive cultures from nonsterile sites (environmental, genital, upper and lower respiratory, stool, urine, and wound cultures), 246 (81%) of potentially clinically significant and 671 (75%) of all errors would have been identified.
Strengths of this study include the large number of CRs included, the prospective study design, and the use of standardized definitions. In particular, corrections were classified as potentially clinically significant with input from an infectious disease specialist. The culture review process used in this study cannot be used to identify some types of errors, such as delays in reporting, or errors due to preanalytical variables. Another limitation of this study is that interreviewer reliability was not assessed.
Neither The Joint Commission nor the College of American Pathologists requires daily supervisory review of every single patient result. Laboratories with limited resources may want to review only selected reports. In clinical microbiology, delta checks and critical results are less useful as criteria for review than they are in other areas of the clinical laboratory. We present an analysis of the errors identified through the process of culture review, which may help laboratories target the types of reports to review. Specific areas where potentially clinically significant errors are most likely include susceptibility testing, wound and LRT cultures, and changes in protocol. Conversely, areas with a very low likelihood for detecting potentially clinically significant errors include negative cultures, cultures to rule out specific organisms, and cultures likely to be pure.
The authors would like to thank Karen J. LaFe, Eric Stefansson, Susan R. Swanzy, and Susan Turner for their assistance in gathering these data. We also thank Michael L. Astion, MD, PhD, for his critical review of the manuscript.
Accepted for publication May 2, 2008.
(1.) The Joint Commission. Comprehensive Accreditation Manual for Laboratory and Point-of-Care Testing. Oakbrook Terrace, Ill: The Joint Commission; 2008: QC-18-QC-19.
(2.) College of American Pathologists. Microbiology Checklist. 2007. Available at: http://www.cap.org. Accessed March 18, 2008.
(3.) Yuan S, Astion ML, Schapiro J, Limaye AP. Clinical impact associated with corrected results in clinical microbiology testing. J Clin Microbiol. 2005;43:21 882193.
(4.) Astion ML, Shojania KG, Hamill TR, Kim S, Ng VL. Classifying laboratory incident reports to identify problems that jeopardize patient safety. Am J Clin Pathol. 2003;120:1 8-26.
(5.) Preacher KJ. Calculation for the chi-square test: an interactive calculation tool for chi-square tests of goodness of fit and independence [computer software online]. 2001. Available at: http://www.quantpsy.org. Accessed March 18, 2008.
6. Clinical and Laboratory Standards Institute. Performance standards for antimicrobial susceptibility testing: 17th informational supplement. CLSI document M100-17. Wayne, Pa: Clinical and Laboratory Standards Institute; 2007.
Nancy Goodyear, PhD; Bruce K. Ulness, BS, MT(ASCP); Jennifer L. Prentice, MS, MT(ASCP); Brad T. Cookson, MD, PhD; Ajit P. Limaye, MD
From the Departments of Laboratory Medicine (Dr Goodyear, Mr Ulness, Ms Prentice, and Drs Cookson and Limaye), Microbiology (Dr Cookson), and Medicine (Dr Limaye), University of Washington School of Medicine, Seattle. Dr Goodyear is now located at the University of Massachusetts, Lowell.
The authors have no relevant financial interest in the products or companies described in this article.
Presented in part in poster format at the 106th General Meeting of the American Society for Microbiology, Orlando, Fla, May 23, 2006, and the 107th General Meeting of the American Society for Microbiology, Toronto, Ontario, Canada, May 25, 2007.
Reprints: Nancy Goodyear, PhD, % Agit P. Limaye, MD, Department of Laboratory Medicine, University of Washington, Box 3571 10, Seattle, WA 98195 (e-mail: firstname.lastname@example.org).
Table 1. Technical Correction Categories With Examples Category Examples Setup Specimen was set up on incorrect plates. Direct exam Discrepancy between direct Gram stain and culture growth not addressed. Identification Identification tests performed were inadequate workup to support identification, or identification tests were performed, but results were not entered in workup. Report Workup correct but incorrect quantity, identification, or comment reported. Susceptibility Appropriate susceptibility testing not performed or results not entered correctly, including comments. Table 2. Classification of All Corrections * No. (%) of No. (%) of Positive CR Negative CR Corrections Corrections Significance Category (n = 900) (n = 143) (P) Setup 3 (0.003) 0 .49 Direct exam 31 (0.028) 0 .02 Identification 217 (0.194) 98 (0.087) <.001 workup Report 275 (0.245) 45 (0.040 .83 Susceptibility 374 (0.334) 0 <.001 Potentially clinically significant 302 (0.269) 5 (0.004) <.001 * A total of 112 108 culture reports (101 703 positive and 10 405 negative) were reviewed. CR indicates culture report. Table 3. Classification of Potentially Clinically Significant Corrections * No. (%) of No. (%) of Positive CR Negative CR Corrections Corrections Significance Category (n = 302) (n = 5) (P) Identification workup 28 (9) 5 (100) .03 Report 21 (7) 0 <.001 Susceptibility 253 (84) 0 <.001 Percent total CR 0.29 0.05 <.001 * CR indicates culture report.
|Gale Copyright:||Copyright 2008 Gale, Cengage Learning. All rights reserved.|