Cervical cytology quality assurance in Washington State.

The objectives of this study were to establish a profile of cervical cytology laboratories in Washington State, identify quality assurance problems amenable to correction through education or legislation, and describe differences between large and small cytology laboratories. All 43 Washington laboratories that perform cervical cytology were surveyed by mail during 1989. Completed surveys were returned by 37 (86%) of the laboratories. Nearly half (43%) of the respondents reported processing less than 10,000 Papanicolaou smears annually. Only one-third (35%) of the respondents reported participating in relevant proficiency programs. A proportion of smaller cytology laboratories were compensating their cytotechnologists on the basis of the number of slides read and allowing Papanicolaou smears to be read outside the confines of the laboratory. The results of this study suggest that cytotechnologists in some larger Washington laboratories have been exceeding work load limits recommended by professional associations. Recent legislation includes regulations that address cervical cytology quality assurance. However, continued efforts will need to be made to encourage voluntary adoption of quality control measures not addressed by this legislation.     

P‐15COMPARISON OF RESULTS FOR A NON‐GYNAECOLOGICAL CYTOLOGY EQA SCHEME

The problems encountered with a glass slide circulation are legion but timely circulation is a major problem and is an inherent deficiency of our Non‐gynaecological EQA scheme. This applies not only to consultants but also to specialist registrars (SpRs) and technical staff that are not formally included in the circulation list. In 2005 only 7 technical staff and 4 out of 47 SpRs took part on a formal basis, their participation being dependant on access to slides during their cytology attachment. The results for the 2005 circulation have been analysed and despite the small numbers of participating technical staff and SpRs their answers concur with the consultant body. To address the issues of timeliness and circulation problems a pilot teaching set has been developed by SlidePath into a virtual microscope web based circulation and sent to all SpRs in our region. They have recorded their answers and been given immediate access to the consensus consultant opinion with illustrations of follow up histology. A questionnaire was completed to evaluate the scheme. The facility of immediate feedback of consultant consensus is particularly pertinent to the educational element of the scheme and use of virtual microscopy addresses the issue of timely circulation. If further funding was made available technical staff could also be given the opportunity to try this web‐based circulation.     

P-16DEFAULT FROM CYTOLOGICAL SURVEILLANCE OF LOW-GRADE SMEARS: LEVELS OF DEFAULT AND CHARACTERISTICS OF DEFAULTERS IN THE TRIAL OF MANAGEMENT OF BORDERLINE AND OTHER LOW-GRADE ABNORMAL SMEARS (TOMBOLA)

The problems encountered with a glass slide circulation are legion but timely circulation is a major problem and is an inherent deficiency of our Non-gynaecological EQA scheme. This applies not only to consultants but also to specialist registrars (SpRs) and technical staff that are not formally included in the circulation list. In 2005 only 7 technical staff and 4 out of 47 SpRs took part on a formal basis, their participation being dependant on access to slides during their cytology attachment. The results for the 2005 circulation have been analysed and despite the small numbers of participating technical staff and SpRs their answers concur with the consultant body. To address the issues of timeliness and circulation problems a pilot teaching set has been developed by SlidePath into a virtual microscope web based circulation and sent to all SpRs in our region. They have recorded their answers and been given immediate access to the consensus consultant opinion with illustrations of follow up histology. A questionnaire was completed to evaluate the scheme. The facility of immediate feedback of consultant consensus is particularly pertinent to the educational element of the scheme and use of virtual microscopy addresses the issue of timely circulation. If further funding was made available technical staff could also be given the opportunity to try this web-based circulation.     

Proficiency testing in cytology laboratories in Ontario, Canada: a decade of experience. II. Results of initial surveys

The results of the initial surveys in the cytology proficiency testing of the medical laboratories in the Province of Ontario, Canada, showed a high correlation between the opinions of the testing committee and the participants in the categories of "no abnormal cells," "metaplasia" and forms of "benign atypia." The proportion of times that slides were tested in the categories of dysplasia and malignancy in the surveys increased from 38% by the end of survey 3 to 46% by the end of survey 5. A progressive improvement in the diagnostic accuracy was demonstrated in the categories of malignancy and severe dysplasia while results were more variable in the categories of moderate and mild dysplasia. Several educational activities were initiated following survey 3, including development and circulation of demonstration sets of marked glass slides for repeated circulation to participants as well as copies of a slide/tape presentation describing the program and specific case material.     

The Yorkshire slide exchange external quality assessment (EQA) scheme

A slide circulation scheme measuring cervical screening performance of individual cytologists in 15 laboratories in Yorkshire Regional Health Authority is described. The advantages and disadvantages are compared with the current National Proficiency Testing (NPT) scheme. The results indicate that a slide circulation scheme can be successfully used in cervical cytology external quality assessment (EQA). Levels of participation are better than those currently achieved by regional variations of the NPT scheme, and the use of laboratory consensus in the selection of scoring slides appears to be no less valid than the use of a pre‐selected slide pool assembled by an expert panel. The volume of data accumulated in one round is considerably greater than that achieved by proficiency testing and the educational value is regarded as high. However, the scheme is very time consuming for participants and consequently expensive for laboratories. The lack of external supervision increases the risk of unfair practices within individual laboratories. Because of these problems, Yorkshire has now switched to an NPT scheme.     

The big problem of the missing cytology slides

Cytology slides are often unique and irreplaceable. Unlike surgical pathology cases, where additional paraffin sections can be cut, cytology slides often cannot be duplicated because there are only a few direct smears or the diagnostic material is present on a single slide. Cytology slides are often "sent out" to other physicians, laboratories or hospitals, typically so that the pathologist at the institution where the patient will receive treatment can review the slides. Less often, a cytology lab sends out the slides for a second opinion or as part of the discovery process in a lawsuit, where they may or may not be defendants. Rarely, unique and irreplaceable cytology slides are lost. This article presents a hypothetical scenario that is based on reported state appellate court decisions. The article discusses some of the legal issues that will affect the defendant cytologist/cytology lab and the "expert cytologist," and suggests some steps a cytologist/cytology lab can take to minimize the risk of repercussions from a lost unique and irreplaceable cytology slide.     

Utility of 2-D and 3-D virtual microscopy in cervical cytology education and testing

OBJECTIVE: To evaluate the effectiveness of 3-D vs. 2-D virtual microscopy as adjuncts to education and assessment in cervical cytology. STUDY DESIGN: Five cervical cytology slides were acquired in 2-D; then the identical area of the slide was acquired in 3-D, resulting in 2 sets of virtual slides for comparison with the original glass slide. Seventy-nine paid volunteer cytologists and cytotechnology students participated. Approximately half were sent the 2-D set of slides via the Web, and the others a 3-D set of slides on a DVD. Evaluators examined the virtual slides and committed to an interpretation. After receipt of the original glass slides, a second interpretation was made, if different from the virtual slide interpretation. RESULTS: Diagnostic accuracy using virtual cytology slides was similar to that for glass slides (94% vs. 96%). There was no difference in diagnostic accuracy between 2-D and 3-D slides (p = 0.28); however, the ability to focus 3-D slides in the z-axis was strongly endorsed by the participants because of the uncertainty and frustration of having some cells out of focus on 2-D virtual slides. CONCLUSION: There was consensus that virtual cervical cytology slides would be a useful augmentation to education and testing.     

Interlaboratory quality control in gynecologic cytopathology using the novel CONQUISTADOR software. Interobserver reproducibility in the Latin American screening study

OBJECTIVE: The recently developed software (CONQUISTADOR), capable of computing all intralaboratory and interlaboratory quality control (QC) indicators, was used to evaluate the diagnostic agreement among 4 cytology laboratories participating in the LAMS Study. STUDY DESIGN: The study was an interlaboratory exchange of specially designed 5 slide sets, each comprising 20 (conventional cytology) slides. At the first step, 80 slides (with "clear-cut" cases) were divided into four sets (A, B, C, D) of 20 specimens, each including inadequate and negative cases as well as in different proportions of all diagnostic TBS 2001 categories. In the second round, a fifth set (E) of 20 slides ("difficult cases") was designed, with all diagnostic categories, ASC and AGC included. Common measures of reproducibility (kappa and weighted kappa), accuracy (SE, SP, PPV, NPV) and 3 indices of diagnostic variability were calculated for sets A-D and set E, separately. RESULTS: For the 5 slide sets together, the weighted kappa was 0.8 (95% CI 0.76-0.85), which is the lower limit of the "almost perfect" ranking of kappa statistics, indicating an excellent interlaboratory agreement. The interlaboratory reproducibility was lower only for the difficult set (E). Similarly, the sensitivity for set E (70.0%) was lower than that (92.1%) for sets A-D. The diagnostic variability indices were not substantially different between the difficult (set E) and clearcut (sets A-D) cases. CONCLUSION: High interlaboratory reproducibility was obtained for sets A-D ("clear-cut" cases), while more interlaboratory variation was evident in the difficult samples. The new CONQUISTADOR software is a valuable tool in calculating the indicators needed in this intralaboratory and interlaboratory.     

O-8Detection of human telomerase gene (TERC) amplification in cervical neoplasia: a retrospective study of 50 patients with normal smears or mild or moderate dyskaryosis

Circulation E of the North West non gynaecological cytology EQA scheme was split into two with one half receiving conventional glass slides and the other half receiving digital images supplied by the SlidePath company over the web. More of the participants eligible participated in the slide half (43/65) than the digital half (17/41).
Similar results were obtained for seven out of ten of the scoring cases and for both the educational cases. However for one case eight of the digital participants could not obtain the images over the web. In the remaining three scoring cases the digital participants were less good at obtaining the correct answer compared to the slide based participants. The use of this virtual microscopy has shortened the circulation length considerably. The digital participants complained about the speed the digital slides appeared on their computers and whilst most agreed that this is the way forward they are still uncomfortable with their performance being marked on their digital submissions. Delegates will have the opportunity of viewing still images taken for each case from this circulation.     

Accuracy and perceptions of virtual microscopy compared with glass slide microscopy in cervical cytology

A. Evered and N. Dudding Accuracy and perceptions of virtual microscopy compared with glass slide microscopy in cervical cytology Objective: To evaluate virtual microscopy in terms of diagnostic performance and acceptability among practising cytologists. Methods: Twenty‐four experienced cytologists were recruited to examine 20 SurePath® cervical cytology slides by virtual microscopy. Diagnostic accuracy was compared with glass slide microscopy using an unbiased crossover experimental design. Responses were allocated a score of one for a correct identification of normal or abnormal (borderline/atypical changes in squamous or glandular cells or worse) and a score of zero for an incorrect response (a normal slide reported as abnormal or vice versa). Perceptions of virtual microscopy were assessed by questionnaire analysis. Results: Participants yielded a total of 285 responses for the virtual slide set and 300 for the glass slide set. The approximate time to screen a virtual slide was 18 minutes, compared with 8 minutes or less for a glass slide. Overall there was no significant difference between virtual microscopy and glass slide microscopy in terms of diagnostic accuracy (P = 0.22). Virtual microscopy under‐performed when images were captured over a narrow focal range (P = 0.01). Diagnostic accuracy of virtual microscopy equalled that of glass slide microscopy when participants were able to focus through the full thickness of the slide images (P = 0.07). The most common difficulties experienced by participants with virtual microscopy were freezing of the computer screen during image download, slow response of the computer during slide movement and, in some instances, ‘fuzzy’ images. Cytologists have a strong preference for glass slides over virtual microscopy despite the overall equal diagnostic performance of the two viewing modalities. Conclusions: Diagnostic accuracy of virtual microscopy can equal that of glass slide microscopy. However, without good computer network connections, wide focal range and software that permits effortless navigation across virtual slides, cytologists are unlikely to be convinced of the utility of this technology for cytology screening and diagnosis.     

Correlation between the papanicolaou stain and the Wright-Giemsa stain in body fluids: a quality assurance study

OBJECTIVE: To compare the use of Papanicolaou and Wright-Giemsa stains for the evaluation of body fluids in cytology and hematology laboratories and determine whether other factors account for discrepancies in diagnosis. STUDY DESIGN: We retrospectively reviewed cytopathology reports of peritoneal, pleural, and cerebrospinal fluids received by hematology and cytology laboratories for 1 year. Cases were divided into 3 categories-benign, atypical, and malignant--and slides of discrepant diagnoses were reviewed. RESULTS: During this period, 198 of 3212 (0.61%) cases received by the hematology laboratory and 252 of 4402 (0.57%) cases received by the cytology laboratory were diagnosed as malignant or atypical. Of 3212 cases simultaneously received by the cytology and hematology laboratories, 17 diagnosed as malignant by hematology were diagnosed benign by cytology (sensitivity 96%). Sixteen cases diagnosed as malignant by cytology were diagnosed as benign by hematology (sensitivity 97%). No benign cases were diagnosed as malignant (specificity 100%). Review of the glass slides of the discrepant cases revealed 8 cases undercalled by hematology and 7 cases undercalled by cytology. CONCLUSION: Papanicolaou stain is superior for carcinoma and Wright-Giemsa stain for hematopoietic disorders, but used together they may reduce false negative results. Delays in processing, staining technique, and interobserver variability contribute to discrepancy.     

A comparison of variability in Papanicolaou and liquid-based cytology inadequacy rates using Shewhart control charts

OBJECTIVE: To use Shewhart control charts to compare variability in inadequacy rates from Papanicolaou (Pap) and liquid-based cytology (LBC). DESIGN: Retrospective analysis of quality assurance data. SETTING: Eleven Welsh cytology laboratories. METHODS: Shewhart 'p' charts were plotted for proportions of slides reported as inadequate. Charts were compared for statistical control. MAIN OUTCOME MEASURES: Evidence of statistical control in the processes. RESULTS: Control charts allowed easy interpretation of patterns in the data. Variability in inadequacy rates was much lower for LBC than for Pap cytology. CONCLUSION: Monitoring inadequate rates with Shewhart charts provides more information than tabular monitoring reports, assisting in quality improvement. With respect to inadequacy rates, LBC is less variable than Pap cytology.     

Issues for application of virtual microscopy to cytoscreening,perspectives based on questionnaire to Japanese cytotechnologists

To clarify the issues associated with the applications of virtual microscopy to the daily cytology slide screening, we conducted a survey at a slide conference of cytology. The survey was conducted specifically to the Japanese cytology technologists who use microscopes on a routine basis. Virtual slides (VS) were prepared from cytology slides using NanoZoomer (Hamamatsu Photonics, Japan), which is capable of adjusting focus on any part of the slide. A total of ten layers were scanned from the same slides, with 2 micrometer intervals. To simulate the cytology slide screening, no marker points were created. The total data volume of six slides was approximately 25 Giga Bytes. The slides were stored on the Windows 2003 Server, and were made accessible on the web to the cytology technologists. Most cytotechnologists answered "Satisfied" or "Acceptable" to the VS resolution and drawing speed, and "Dissatisfied" to the operation speed. To the ten layered focus, an answer "insufficient" was slightly more frequent than the answer "sufficient", while no one answered "fewer is acceptable" or "no need for depth". As for the use of cytology slide screening, answers "usable, but requires effort" and "not usable" were about equal in number. In a Japanese cytology meeting, a unique VS system has been used in slide conferences with markings to the discussion point for years. Therefore, Japanese cytotechnologists are relatively well accustomed to the use of VS, and the survey results showed that they regarded VS more positively than we expected. Currently, VS has the acceptable resolution and drawing speed even on the web. Most cytotechnologists regard the focusing capability crucial for cytology slide screening, but the consequential enlargement of data size, longer scanning time, and slower drawing speed are the issues that are yet to be resolved.     

Rapid screening: a comparative study

Although rapid screening of negative and inadequate cervical smears is a quality assurance requirement for all UK laboratories, there has been little attempt to standardize the method and laboratories make use of a number of different techniques and times. The aim of this study was to assess the sensitivity of these various techniques by measuring their ability to pick out known false-negative smears. Completed questionnaires from 123 laboratories across England revealed that 52% of laboratories use a "step" technique, 19% use "turret", 15% use random paths and 34% attempt to rescreen the whole slide quickly. Twenty-two percent of laboratories use a mixture of techniques. Timings are also variable, with the majority of laboratories allowing screeners to review slides at a pace decided by themselves but usually between 1 and 2 min. The study involved 120 participants who performed a total of 24 000 rapid screens. The results showed that, of the 90 abnormal slides used in the study, 62 cases (69%) were identified as abnormal or needing review by more than 50% of participants. Overall rapid screening picked out 58% of high-grade squamous abnormalities, 59% of low-grade abnormalities and 72% of glandular lesions. Step screening performed best, followed by whole slide/random and then turret. One minute was the optimum time and there was a significant fall in performance once individuals attempted to rescreen large numbers (>50). The most significant finding was the marked variation in the performance of individuals using the same slide sets.     

Validation of a multicolor interphase fluorescence in situ hybridization assay for detection of transitional cell carcinoma on fresh and archival thin-layer, liquid-based cytology slides.

OBJECTIVE: To evaluate the feasibility of performing multicolor interphase fluorescence in situ hybridization (FISH) on ThinPrep slides of transitional cell carcinoma (TCC). STUDY DESIGN: Slides from 20 voided urine specimens were prepared by the ThinPrep technique (Cytyc, Boxborough, Massachusetts, U.S.A.), pretreated using a pretreatment kit and subjected to hybridization with the multicolor FISH probe UroVysion (Vysis, Downers Grove, Illinois, U.S.A.). Archival slides were placed in xylene, destained in alcohol and washed prior to pretreatment. Urines from patients with cytology-positive, biopsy-proven grade 1 (n = 5), 2 (n = 7) and 3 (n = 5) TCC and negative cytology and biopsy (n = 3) were selected. Freshly prepared (n = 10) and archival (n = 10) slides were used. RESULTS: All carcinoma cases were FISH positive (> 5 cells with complex abnormalities of > or = 2 studied chromosomes per slide). None of the normal samples were aneusomic. Gain of chromosomes 3, 7 and 17 constituted the majority of positive cases. Proper destaining and slight decrease in stringency wash conditions enabled reliable detection of signals in archival cases. CONCLUSION: Routine ThinPrep slides can be used for multicolor interphase FISH analysis of urine cytology specimens. Archival slides provide the opportunity to analyze by FISH the nature of atypical cells identified by cytology. This revised method allows FISH technology more accessibility for routine use in cytology laboratories.     

External quality assurance for cervical cytology in developing countries. Experience in Peru and Nicaragua

Given interest from the professionals concerned, an external quality assurance scheme for cervical cytology can successfully be introduced in developing countries. This is a very important precondition if screening programs are to be expanded and decreases in mortality from cervical cancer are to occur in developing countries. Nicaragua and Peru have been experimenting with an external quality assurance system adapted from the Scottish and Northern Ireland scheme. It has been received with enthusiasm and acceptance and has helped cytology laboratories in these countries focusing on quality issues. Nevertheless, a successful quality control scheme that is to result in improvements in the quality of professionals' diagnostic skills needs to be accompanied by a remedial program for subperformers.     

Semantic Focusing Allows Fully Automated Single-Layer Slide Scanning of Cervical Cytology Slides

Liquid-based cytology (LBC) in conjunction with Whole-Slide Imaging (WSI) enables the objective and sensitive and quantitative evaluation of biomarkers in cytology. However, the complex three-dimensional distribution of cells on LBC slides requires manual focusing, long scanning-times, and multi-layer scanning. Here, we present a solution that overcomes these limitations in two steps: first, we make sure that focus points are only set on cells. Secondly, we check the total slide focus quality. From a first analysis we detected that superficial dust can be separated from the cell layer (thin layer of cells on the glass slide) itself. Then we analyzed 2,295 individual focus points from 51 LBC slides stained for p16 and Ki67. Using the number of edges in a focus point image, specific color values and size-inclusion filters, focus points detecting cells could be distinguished from focus points on artifacts (accuracy 98.6%). Sharpness as total focus quality of a virtual LBC slide is computed from 5 sharpness features. We trained a multi-parameter SVM classifier on 1,600 images. On an independent validation set of 3,232 cell images we achieved an accuracy of 94.8% for classifying images as focused. Our results show that single-layer scanning of LBC slides is possible and how it can be achieved. We assembled focus point analysis and sharpness classification into a fully automatic, iterative workflow, free of user intervention, which performs repetitive slide scanning as necessary. On 400 LBC slides we achieved a scanning-time of 13.9±10.1 min with 29.1±15.5 focus points. In summary, the integration of semantic focus information into whole-slide imaging allows automatic high-quality imaging of LBC slides and subsequent biomarker analysis.     

Restoration of broken cytology slides and creation of multiple slides from a single smear preparation.

A technique was developed for restoring broken cytology slides so that they are close to their original condition and for making multiple slides from a single smear preparation. The method is applicable to both cytologic preparations and histologic sections. In this study the fragmented smear preparation was treated with Pro-Texx, which penetrated, impregnated and solidified the full thickness of the pieces of the smear, enabling them to be lifted from the pieces of the broken slide. The removed pieces of the smear preparation were reassembled onto a new slide, which was then restained and coverslipped. In preparing multiple teaching slides, the treated smear preparation was divided as planned, with each portion mounted onto a separate slide, which was then restained and coverslipped. Ten other fine needle aspiration cases with broken slides have been restored, and more teaching slides were prepared from a single smear preparation using the same technique. All were equally successful. This technique provides an excellent method of smear transfer in cases of broken slides and creation of multiple slides from a single smear preparation for cytology teaching. This is particularly useful for unusual cases.     

Interlaboratory reproducibility of atypical glandular cells of undetermined significance: a national survey

OBJECTIVE: The aim of this study was to evaluate the inter-laboratory reproducibility for atypical glandular cells (AGC) (The Bethesda System (TBS) 2001) of the laboratories involved in the screening programmes in Italy. METHODS: A set of 35 selected slides were circulated among 167 laboratories involved in local population-based cervical screening programmes. Each laboratory provided one single diagnosis per smear. The smears were read blind to the original diagnosis and to the diagnoses provided by other laboratories. A 'majority' diagnosis was defined for each case and assumed as the reference standard. The diagnosis provided from each laboratory was compared with the majority diagnosis. RESULTS: According to the majority report the 35 slides in the set were classified as negative in nine cases, AGC in eight, adenocarcinoma in eight, and squamous lesion or squamous + glandular lesion in 10. The crude agreement between all pairs of laboratories was 49.43%. K-values were 0.46, 0.21, 0.34, 0.36 and 0.32 for negative, AGC/AIS (adenocarcinoma in situ of endocervix), AdenoCa, Sq/Sq + Gl and all reporting categories respectively. Concordance according to overall K was moderate to substantial in 77% of the participating laboratories. CONCLUSIONS: The present study shows that the AGC category is not easily reproducible. The data confirmed the importance, in a screening scenario, of AGC/AIS diagnoses, but also presented difficulties in differentiating between the two diagnoses. In addition to the results obtained from the circulation of the slides, laboratories which had annually a low number of cervical smears were able to gain experience focused on particular morphological pictures.     

External quality control for immunocytochemistry on cytology samples: a review of UK NEQAS ICC (cytology module) results

I. S. Kirbis, P. Maxwell, M. S. Fle?ar, K. Miller and M. Ibrahim External quality control for immunocytochemistry on cytology samples: a review of UK NEQAS ICC (cytology module) results Objective: To date, external quality control for immunocytochemistry on cytology samples is provided only by the United Kingdom national external quality assessment service for immunocytochemistry and in situ hybridisation (UK NEQAS ICC & ISH). For the purpose of this study a retrospective analysis of a comprehensive collection of quality‐related data regarding immunocytochemistry on cytology samples collected through this service was analysed. Methods: The quality of immunocytochemical reactions, using on‐line collected data, was analysed for the last 23 UK NEQAS ICC cytology module external quality assessments carried out on cytology samples completed in the period from 2004 to 2010. Results: Our study showed that the majority of participants in the cytology module (66%) sent formalin‐fixed paraffin‐embedded (FFPE) tissue sections for assessment as in‐house control slides and only 34% sent cytology slides of various types. The highest UK NEQAS ICC score for the quality of immunocytochemical staining among in‐house control slides was achieved on cell block sections, followed by cytospins, FFPE tissue sections, liquid‐based cytology slides and smears. With regard to fixation, acetone‐fixed slides achieved significantly lower scores than other reported fixatives. The strength of agreement in perception of immunocytochemical staining quality was good between in‐house assessors (Kappa = 0.64) but only fair between in‐house and UK NEQAS ICC assessors (Kappa = 0.22). Conclusions: Good quality of immunocytochemical staining can be achieved on cytology slides prepared and fixed in different ways as well as on cell blocks. Unified criteria for high‐quality immunocytochemical staining and proper internal and external quality assurance could facilitate further improvement and standardization of immunocytochemistry on cytology samples.