Do liquid-based preparations of urinary cytology perform differently than classically prepared cases? Observations from the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytology.
* Context.--The cytomorphology of liquid-based preparations in
urine cytology is different than classic slide preparations.
Objectives.--To compare the performance of liquid-based preparation specimens to classically prepared urine specimens with a malignant diagnosis in the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytology.
Design.--Participant responses between 2000 and 2007 for urine specimens with a reference diagnosis of high-grade urothelial carcinoma/carcinoma in situ/dysplasia (HGUCA), squamous cell carcinoma, or adenocarcinoma were evaluated. ThinPrep and SurePath challenges were compared with classic preparations (smears, cytospins) for discordant responses.
Results.--There were 18 288 pathologist, 11 957 cytotechnologist, and 8086 "laboratory" responses available. Classic preparations comprised 90% (n = 34 551) of urine challenges; 9% (n = 3295) were ThinPrep and 1% (n = 485) were SurePath. Concordance to the general category of "positive-malignant" was seen in 92% of classic preparations, 96.5% of ThinPrep, and 94.6% of SurePath challenges (P < .001). These results were statistically different for the exact reference interpretation of HGUCA (P < .001) but not for adenocarcinoma (P = .22). Cytotechnologists demonstrate statistically better performance for the general category of "positive-malignant" compared with pathologists for all urinary slide types and for the exact reference interpretation of HGUCA (94% versus 91.1%; P < .001) but not adenocarcinoma (96.3% versus 95.8%; P = .77) or squamous cell carcinoma (93.6% versus 87.7%; P = .07).
Conclusions.--Liquid-based preparations performed significantly better in urinary cytology challenges when evaluating malignant categories in the College of American Pathologists interlaboratory comparison program. The liquid-based preparation challenges also performed better for the exact reference interpretation of HGUCA, but no difference was observed for adenocarcinoma challenges. Cytotechnologists perform better than pathologists for all slide types, as well as those demonstrating HGUCA. These results suggest that liquid-based preparations facilitate a more accurate diagnosis than conventional preparations.
(Arch Pathol Lab Med. 2010;134:19-22)
Bladder cancer (Research)
Urine (Health aspects)
Bentz, Joel S.
Souers, Rhona J.
Wasserman, Patricia G.
Crothers, Barbara A.
Clayton, Amy C.
Henry, Michael R.
Chmara, Beth Anne
Clary, Karen M.
Fraig, Mostafa M.
Moriarty, Ann T.
|Publication:||Name: Archives of Pathology & Laboratory Medicine Publisher: College of American Pathologists Audience: Academic; Professional Format: Magazine/Journal Subject: Health Copyright: COPYRIGHT 2010 College of American Pathologists ISSN: 1543-2165|
|Issue:||Date: Jan, 2010 Source Volume: 134 Source Issue: 1|
|Topic:||Event Code: 310 Science & research|
|Geographic:||Geographic Scope: United States Geographic Code: 1USA United States|
Urine cytology specimens are commonly encountered in daily practice
and include voided/catheterized urines and washings from the bladder,
ureters, and renal pelvis. Cytologic examination of urine specimens is
often the initial step for bladder cancer screening and diagnosis.
However, there is a wide range in the sensitivity and specificity in the
diagnosis of low-grade versus high-grade urothelial carcinomas,
partially due to the bland nuclear features exhibited by the low-grade
lesions. (1-9) The sensitivity of urine cytology for detecting low-grade
lesions varies between 26% and 45%, with a specificity of 98%. (5,6) In
contrast, cytologic samples from high-grade urothelial
carcinoma/carcinoma in situ/dysplasia (HGUCA) exhibit a sensitivity of
70% to 80% with a specificity that approaches 100%. (1-9)
Instrumentation for preparation of liquid-based preparations (LBPs) in the cytology laboratory has been available for use with nongynecologic specimens since 1991. Because of potential to improve slide quality and the ensuing familiarity with LBPs from gynecologic cytology, many laboratories are switching to this technology for a variety of nongynecologic specimens including respiratory specimens, body cavity fluids, and urines. The College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology provides an educational program with urine cytology cases using glass slide material. As a result of this shift in the processing paradigm of nongynecologic samples, this program contains both classical slide material and LBPs.
We reviewed the responses of pathologists and cytotechnologists for urine cytology cases distributed from 2000 to 2007 in the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology program. Our primary goal was to determine if there was a significant difference in the participant's ability to diagnose a variety of neoplastic urothelial lesions comparing classically prepared specimens to LBPs in this educational interlaboratory comparison program.
MATERIALS AND METHODS
The members of the College of American Pathologists Cytopathology Resource Committee (CRC) submit cases used for the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology program. Cases are selected for the nongynecologic cytology program by consensus at CRC screening sessions. Each case is reviewed by 2 members of the CRC, who agree on general and specific interpretations. The 2 members also agree that the slide is a good representation of the entity and that it is technically adequate for assessment. Each slide distributed in the program has a specific reference diagnosis assigned to a body site as well as a general category of unsatisfactory, negative/benign, positive/malignant, or suspicious.
The College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology consists of 4 educational challenges per year, with each challenge composed of 5 slides mailed to participants. The slides are circulated to participants who voluntarily subscribe to the continuing education program. After review of the slides, participants are able to choose a general category (benign/negative, suspicious, positive/ positive, unsatisfactory) and a specific reference diagnosis, in which participants hone their responses to a more specific diagnosis. After circulation to many laboratories all slides have a unique performance profile that can be compared against others in the same reference category.
The quality and performance of the slides is continuously monitored. Every 6 months, each slide associated with a slide set is evaluated for stain quality and diagnostic ability, as assessed by a College of American Pathologists cytotechnologist. Any slide with a discordant rate of 70% or higher after circulation is reviewed by a CRC member to determine if it will continue circulation in the program. Any slide that has been identified by a participant on the result form as technically "unacceptable" is reviewed by the CRC twice per year. Slides may be retired most often due to breakage or fading stain. This quality control system ensures that the slide challenges remain equivalent over time, such that newer slides entering into the program perform similarly to older slides in circulation.
We reviewed the cumulative histories of all participant responses for urine cytology challenges with the reference diagnosis of HGUCA, squamous cell carcinoma, or adenocarcinoma obtained through the College of American Pathologists SCORES computer system, which circulated in the program from 2000 to 2007. Urines samples included voided/catheterized specimens and bladder washings. The preparation type was noted for each challenge. Classic preparations in the program included both conventional concentrated smears and cytospin slide preparations. Liquid-based preparation slides consisted of ThinPrep (Hologic, Inc, Bedford, Massachusetts) and SurePath (Becton, Dickenson Company, Franklin Lakes, New Jersey) preparations. Millipore (Millipore Corporation, Billerica, Massachusetts) filter preparations have not been circulated in the program. The total number of urinary cytology slide types circulated in the program presently includes 200 cytospin (19.6%), 596 smears (58.5%), 146 ThinPrep (14.3%), and 77 SurePath (7.6%).
Participant results were identified for misclassification for both the general categorization (eg, negative vs positive) and the exact reference diagnosis on a given slide (eg, HGUCA). A participant response was considered discordant (incorrect) if the participant general category response was unsatisfactory or negative and the reference interpretation was positive. A correct response was a response that was concordant to either the general category or the exact reference interpretation. We did not include any "suspicious" response categories in our analysis. General and exact diagnosis discordant rates between slide preparation type as well as participant type (pathologist vs cytotechnologist) were analyzed.
Statistical analysis was performed using Pearson x2 test and Fisher exact test to test the null hypothesis that there is no association between the participants' performance and 2 factors: slide preparation and reader type. All tests were run at the P < .05 significance level. All statistical analyses were performed using SAS v9.1 (SAS Inc, Cary, North Carolina).
A total of 38 331 participant responses for urine cytology challenges were reviewed which included 18288 pathologists, 11 957 cytotechnologists, and 8086 "laboratory" responses. Malignant/positive general category diagnoses included the specific reference diagnoses of HGUCA, squamous cell carcinoma, and adenocarcinoma
Overall, there was concordance to the general category of positive-malignant in 92% of classic slide preparations, 96.5% of ThinPrep, and 94.6% of SurePath (P < .001) challenges (Table 1). When the classic preparation results were broken down further into either cytospin or concentrated smear, the concordance rate remained the same at 92% for both. When the results were segregated into the 2 exact reference diagnostic categories of HGUCA and adenocarcinoma, LBPs performed statistically better with the HGUCA challenges (P < .001) but not for adenocarcinoma challenges (P = .22) (Table 2). There were an insufficient number of squamous cell carcinoma slides to make a statistical comparison between slide types and general category.
When general category responses by participant type were evaluated, cytotechnologists demonstrated a statistically overall better performance (94% vs 91.2%; P < .001) compared with pathologists on all slide types combined (Table 3). There was a statistically different rate of performance for cytotechnologists compared with pathologists for the exact reference diagnosis of HGUCA. Ninety-four percent of the cytotechnologists correctly diagnosed the HGUCA challenges compared with 91.1% of the pathologists (P < .001). This statistical difference was not identified in the adenocarcinoma (96.3% vs 95.8%; P = .88) or squamous cell carcinoma diagnostic categories (93.6% vs 87.7%; P = .07) (Table 4).
Urine cytology specimens are one of the most common samples in a busy cytopathology laboratory and are of primary importance for screening and diagnosis of bladder cancer. Traditionally, urine samples for cytology have been prepared using filters, concentrated smears, or cytocentrifugation. With the advent of LBP technology in the laboratory, this instrumentation is being used with increased frequency for processing of nongynecologic samples, including urine specimens. Advantages of this processing system over conventional methods include uniformity of the cytologic sample with respect to smear thickness ("monolayered" smear), increased cell concentration and cellularity, lack of obscuring background material, improved morphology, and decreased rate of unsatisfactory and suboptimal specimens. Placing the cellular material directly into the cytofixative in the LBP vial provides more immediate and better preservation, and the proprietary fixatives in LBP have been validated for ancillary testing of residual material in the vial using immunohistochemistry or fluorescence in situ hybridization. (10-12) The concentrated and larger cell deposit available for evaluation in the LBP slides compared with cytospin preparations may reduce the need to prepare multiple slides from the sample for cytologic evaluation.
The method of cytologic slide preparation, in our study, showed a significant increase in the diagnostic accuracy of participants on LBP challenges compared with the classic preparations. Malignancy was correctly diagnosed in 92% of the classic preparations, compared with 95.6% of the ThinPrep slides and 94.6% SurePath samples. This statistically higher rate of concordance for the LBPs was also noted in the HGUCA group but not for adenocarcinoma. Luthra et al (13) and Wright and Halford (14) also reported similar results in their evaluation of abnormal urothelial samples using LBPs versus conventional preparations. Wright and Halford noted a higher detection rate of atypical urothelial cells in their ThinPrep material compared with the cytospin preparations (5.3% versus 4.2%, respectively). They also stated that the cellular morphology of the ThinPrep samples showed enhanced nuclear detail with crisper chromatin and more prominent nucleoli. A similar finding was also seen with their Autocyte PREP (eg, SurePath) slides. Voss et al (15) reported slightly higher positive rates for ThinPrep versus filters (3.3% versus 2.8%), but the difference was not statistically significant. On the other hand, others have reported higher detection rates with cytospin material compared with LBPs. (16,17) In the study by Sng et al, (16) they reported higher rates of sensitivity and positive and negative predictive values for cytospin samples compared with ThinPrep specimens (94.7%, 94.7%, and 83.3% versus 84.2%, 94.1%, and 62.5%, respectively). Part of the reason for this discrepancy may be related to the cytologic appearance of the diagnostic cells. Nassar et al (17) noted that cytospin urine samples were superior to the ThinPrep material in cellular detail. In their study, the diagnostic cells in the ThinPrep slides were dispersed singly with loss of papillary fragments, making them difficult to find. A similar qualitative superiority with centrifuged samples was reported by Zardawi and Duncan (18) and Piaton et al. (19) They also noted greater cellular preservation when comparing cytospin preparations with the ThinPrep and SurePath LBP systems.
The lack of statistical significance between participants' (both pathologists and cytotechnologists) ability to correctly diagnose adenocarcinoma and squamous cell carcinoma in the urinary challenges may be a reflection of the infrequency of adenocarcinoma and squamous carcinoma compared with urothelial carcinomas in routine practice. Roughly 95% of bladder neoplasms are of urothelial (transitional) cell origin. In contrast, squamous cell carcinomas comprise 2% to 15% of bladder tumors, and adenocarcinomas represent less than 2%. (20) These cases are proportionately represented in the program, and the smaller number of cases could also influence the lack of statistical significance between slide types.
An interesting finding in our study was the performance of cytotechnologists in comparison to pathologists in the evaluation of the urinary challenges. Tables 3 and 4 demonstrate a statistically better overall general performance for cytotechnologists and specifically for the HGUCA cases. This difference may in part be due to the cytotechnologists' familiarity with LBP cytology screening of cervicovaginal smears, their superior locator skills, and their expertise as primary screeners of cytologic cases. Studies have shown that pathologists perform worse than cytotechnologists as primary screeners of cervicovaginal smears. (21) Finally, interobserver variability and lack of standarized nomenclature in urinary cytology also could have contributed to the discordant results between cytotechnologists and pathologists. These 2 variables have been highlighted as interpretive problems in several studies focused on urinary cytology. (22,23) This study was limited to assessing sensitivity for the detection of malignancy in urine cytology specimens. The participants' ability to accurately eliminate the various benign mimics of urine cytology neoplasia (specificity) was not specifically measured. Cytotechnologists may have superior detection skills because of their primary role in screening; however, pathologists demonstrate better specificity for identifying malignancy (perhaps at the cost of sensitivity), but this was not specifically measured in this study.
In summary, LBP challenges performed significantly better than classic preparations of malignant urinary cytology in an educational interlaboratory comparison program. The LBP challenges also performed better for the exact reference interpretation of HGUCA, but no difference was observed for adenocarcinoma challenges. Cytotechnologists appear to perform better than pathologists in interpretation of high-grade urothelial carcinoma in urologic specimens. Use of LBPs is becoming widespread for urologic specimens and the results confirm that LBPs perform better than classic preparations in an interlaboratory comparison program.
(1.) Brown FM. Urine cytology: is it still the gold standard for screening? Urol Clin North Am. 2000;27:25-37.
(2.) Hoda RS. Non-gynecologic cytology on liquid-based preparations: a morphologic review of facts and artifacts. Diagn Cytopathol. 2007;35:621-634.
(3.) Esposti PL, Moberger G, Zajicek J. The cytologic diagnosis of transitional cell tumors of the urinary bladder and its histologic basis. Acta Cytol. 1970;14: 145-155.
(4.) Kern WH. The cytology of transitional cell carcinoma of the urinary bladder. Acta Cytol. 1975;19:420-428.
(5.) Raab SS, Lenel JC, Cohen MB. Low grade transitional cell carcinoma of the bladder: cytologic diagnosis by key features as identified by logistic regression analysis. Cancer. 1994;74:1621-1626.
(6.) Bastacky S, Ibrahim S, Wilczynski SP, Murphy WM. The accuracy of urinary cytology in daily practice. Cancer. 1999;87:118-128.
(7.) Renshaw AA, Nappi D, Weinberg DS. Cytology of grade 1 papillary transitional cell carcinoma: a comparison of cytologic, architectural and morphometric criteria in cystoscopically obtained urine. Acta Cytol. 1996;40:676-682.
(8.) Sarnacki CT, McCormack LJ, Kiser WS, Hazard JB, McLaughlin TC, Belovich DM. Urinary cytology and the clinical diagnosis of urinary tract malignancy: a clinicopathologic study of 1,400 patients. J Urol. 1971;106:761-764.
(9.) Grabar C, Mascaux C, Wespes E. Is urinary tract cytology still useful for diagnosis of bladder carcinomas?: a large series of 592 bladder washings using a five-category classification of different cytological diagnoses. Cytopathology. 2007;18:79-83.
(10.) Papillo JL, Lapen D. Cell yield: ThinPrep vs. cytocentrifuge. Acta Cytol. 1994;38:33-36.
(11.) Hwang EC, Park SH, Jung SI, et al. Usefulness of liquid-based preparation in urine cytology. Int J Urol. 2007;14:626-629.
(12.) Skacel M, Pettay JD, Tsiftakis EK, et al. Validation of a multicolor interphase fluorescence in situ hybridization assay for detection of transitional cell carcinoma on fresh and archival thin-layer, liquid-based cytology slides. Anal Quant Cytol Histol. 2001;23:381-387.
(13.) Luthra UK, Dey P, George J, et al. Comparison of ThinPrep[R] and conventional preparations: urine cytology evaluation. Diagn Cytopathol. 1999;21:364-366.
(14.) Wright RG, Halford JA. Evaluation of thin-layer methods in cytology. Cytopathology. 2001;12:306-313.
(15.) Voss JS, Kipp BR, Krueger AK, et al. Changes in specimen preparation method may impact urine cytologic evaluation. Am J Clin Pathol. 2008;130:552-559.
(16.) Sng K-K, Nga ME, Tan S-Y, Walker T. Analysis of urine cytology tests in 120 paired cases. Acta Cytol. 2007;51:782-787.
(17.) Nassar H, Ali-Fehmi R, Madan S. Use of ThinPrep[R] monolayer technique and cytospin preparation in urine cytology: a comparison analysis. Diagn Cytopathol. 2003;28:115-118.
(18.) Zardawi IM, Duncan J. Evaluation of a centrifuge method and thin-layer preparation in urine cytology. Acta Cytol. 2003;47:1038-1042.
(19.) Piaton E, Faynel J, Hutin K, Ranchin M-C, Cottier M. Conventional liquid-based techniques versus Cytyc ThinPrep[R] processing of urinary samples: a qualitative approach. BMC Clin Pathol. 2005;5:9-15.
(20.) Murphy WM, Grignon DJ, Pearlman EJ. Tumors of the kidney, bladder, and related urinary structures. In: Silverberg SG, Sobin LH, eds. Washington, DC: Armed Forces Institute of Pathology; 2004:249. Atlas of Tumor Pathology; 4th series, fascicle 1.
(21.) Bentz JS, Hughes JH, Fatheree LA, Schwartz MR, Souers RJ, Wilbur DC. Summary of the 2006 College of American Pathologists gynecologic cytology proficiency testing program. Arch Pathol Lab Med. 2008;132:788-794.
(22.) Glatz K, Willi N, Glatz D, et al. An international telecytologic quiz on urinary cytology reveals educational deficits and absence of a commonly used classification system. Am J Clin Pathol. 2006;126:294-301.
(23.) Malik SN, Murphy WM. Monitoring patients for bladder neoplasms: what can be expected of urinary cytology consultations in clinical practice? Urology. 1999;54:62-66.
Rodolfo Laucirica, MD; Joel S. Bentz, MD; Rhona J. Souers, MS; Patricia G. Wasserman, MD; Barbara A. Crothers, DO; Amy C. Clayton, MD; Michael R. Henry, MD; Beth Anne Chmara, BS, CT(ASCP); Karen M. Clary, MD; Mostafa M. Fraig, MD; Ann T. Moriarty, MD
Accepted for publication April 15, 2009.
From the Department of Pathology, Baylor College of Medicine, Houston, Texas (Dr Laucirica); the Department of Pathology, University of Utah, Salt Lake City (Dr Bentz); the Biostatistics Department (Ms Souers), and the Surveys Department (Mrs Chmara), College of American Pathologists, Northfield, Illinois; the Department of Pathology, Long Island Jewish Medical Center, New Hyde Park, New York (Dr Wasserman); the Department of Pathology, Walter Reed Army Medical Center, Washington, DC (Dr Crothers); Anatomic Pathology, Mayo Clinic, Rochester, Minnesota (Drs Clayton and Henry); the Department of Pathology, Rochester General Hospital, Rochester, New York (Dr Clary); the Department of Pathology, Johns Hopkins Medical Institutions, Baltimore, Maryland (Dr Fraig); and AmeriPath Indiana, Indianapolis, Indiana (Dr Moriarty).
The authors have no relevant financial interest in the products or companies described in this article.
Reprints: Rodolfo Laucirica, MD, Baylor College of Medicine, Department of Pathology, One Baylor Plaza, Houston, TX 77030 (e-mail: firstname.lastname@example.org).
Table 1. Participant Concordance Rate for Urinary Challenges in the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology by Slide Preparation Type and the General Category of "Positive-Malignant" (P < .001) Classic, % SurePath, % ThinPrep, % Performance (N = 34 551) (a) (N = 485) (N = 3295) Concordance 92.0 94.6 96.5 Discordant 8.0 5.4 3.5 (a) Classic includes cytospin and concentrated direct smears. Table 2. Participant Concordance Rate for Urinary Challenges in the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology by Slide Preparation Type and an Exact Reference Diagnosis (a) Diagnosis Classic, % (b) SurePath, % HGUCA 91.9 (N = 33 1 79) 94.4 (N = 461) Adenocarcinoma 96.3 (N = 810) 100.0 (N = 24) Diagnosis ThinPrep, % P Value HGUCA 96.6 (N = 3227) <.001 Adenocarcinoma 91.8 (N = 49) .22 Abbreviation: HGUCA, high-grade urothelial carcinoma/carcinoma in situ/dysplasia. (a) N represents total participant responses for specific reference diagnosis. (b) Classic includes cytospin and concentrated direct smears. Table 3. Concordance Rate by Participant Type for 1 Urinary Challenges in the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology and General Category of "Positive-Malignant" (P < .001) Cytotechnologist, % Pathologist, % Performance (N = 11 957) (N = 18 288) Concordance 94.0 91.2 Discordant 6.0 8.8 Table 4. Concordance Rate by Participant Type for Urinary Challenges in the College of American Pathologists Interlaboratory Comparison Program in Nongynecologic Cytopathology and an Exact Reference Diagnosis (a) Diagnosis Cytotechnologist, % Pathologist, % HGUCA 94.0 (N = 11 482) 91.1 (N = 17 609) Adenocarcinoma 96.3 (N = 296) 95.8 (N = 409) Squamous cell carcinoma 93.6 (N = 140) 87.7 (N = 211) Diagnosis P Value HGUCA <.001 Adenocarcinoma .77 Squamous cell carcinoma .07 Abbreviation: HGUCA, high-grade urothelial carcinoma/carcinoma in situ/dysplasia. (a) N represents total population of responses for specific diagnosis.
|Gale Copyright:||Copyright 2010 Gale, Cengage Learning. All rights reserved.|