Technical External Quality Assessment for SurePath® stained liquid-based cytology gynaecological cervical samples using control material – a novel approach

Aims and objective: The Technical External Quality Assessment Scheme (TEQA) introduced in Wales is based on NHSCSP publication No 19 [External Quality Assessment Scheme for the Evaluation of Papanicolaou Staining in Cervical Cytology] which sets out the policies and standard operating procedures for the TEQA of Papanicolaou staining of gynaecological cervical samples. As part of a development plan for the TEQA scheme in Wales, the use of a control sample was introduced to the assessment process – a common control sample can provide a consistent assessment parameter independent of the recommended slide selection process [External Quality Assessment Scheme for the Evaluation of Papanicolaou Staining in Cervical Cytology, NHSCSP Publication No 19, February 2004] enabling direct comparison of staining standards for laboratories within the region; this counters selection variation bias, establishing a process that may be more representative of routine staining results. Methods: A cervical sample was selected in line with the criteria described in publication 19 [External Quality Assessment Scheme for the Evaluation of Papanicolaou Staining in Cervical Cytology, NHSCSP Publication No 19, February 2004]. Thirteen slides were prepared by the scheme facilitator from this anonymized sample. These control slides were subsequently ‘fixed’ but not stained, then distributed to the laboratories participating in the TEQA scheme. The slides were stained using their standard regime, then returned to the facilitator for assessment. The slides showed consistent staining with no significant inter‐laboratory variation, however, the eosinophilic stained components exhibited an artificial colouration, which slightly altered the expected stained appearance; this was thought to be due to ‘cross‐reactivity’ of the spray fixative with the preserving agent. To address this artefact, a further development of control procedures was devised utilizing a pooled control sample procedure. Residual material from a number of similar samples was pooled and distributed in aliquots to participant laboratories for standard processing and staining; the completed slides were returned to the scheme facilitator for assessment. Results: The pooled sample slides were assessed at the next scheduled quarterly TEQA assessment. The overall scoring for these samples produced an acceptable level of Papanicolaou staining for 12 of the laboratories – only one laboratory produced a marginal score. The artefactual presentation of eosinophilia was not seen. Discussion/conclusion: This method of producing control material establishes consistency in the TEQA comparative assessment process, counters selection bias and reduces the time demands associated with slide selection. It may also prove useful in identifying technical problems within laboratories during sample preparation prior to or during staining, including equipment or process faults. This technique is now well established locally as an enhancement of the current TEQA scheme for the assessment of slide staining. We feel that this enhancement could be incorporated as a new initiative in the current National TEQA scheme as a complement to the established selection process.     

Personal view. Is it reality or an illusion that liquid‐based cytology is better than conventional cervical smears?

Liquid-based cytology (LBC) has been heralded as the way forward for cervical screening, and as the answer to many of its problems. It is already used as a sole method of cell preparation in many private clinics in the UK. It is being used for colposcopy smears in many NHS clinics and is now being piloted for primary screening in three screening centres in England, as well as one in Scotland and one in Wales. LBC has been welcomed as a new technology because it deals with the problem of specimen adequacy at source, removing responsibility for slide preparation and fixation from the clinician or nurse. It provides uniformly well-fixed preparations that are free of inflammatory exudate and blood, and seem easier to screen than conventional smears. There are many articles in the world literature suggesting that LBC is more accurate than conventional screening, and it is thought likely to reduce the number of false negative tests. The main reasons for piloting LBC in the NHS Cervical Screening Programme (NHSCSP) lie in its potential for reducing screening times and for reducing the numbers of repeats for inadequate tests. LBC is expensive in terms of equipment, capital costs, maintenance, consumables, training, technical preparation time, transportation and disposal of liquid media. Its costs could be justified if they were offset by the money saved from reduced screening time and repeat tests, but only if its accuracy in terms of sensitivity and specificity were proven to be equal to or better than conventional cytology. Although that is generally held to be true by the public and medical profession alike, there is very little hard evidence to support it.     

Liquid‐based cytology: is this the way forward for cervical screening?

Liquid-based cytology (LBC) is currently being marketed as an alternative methodology to replace the conventional PAP smear in cervical cytology. A substantial body of literature exists in support of LBC, some of which is at least partially sponsored by product manufacturers. The majority of published literature in support of LBC employs Bethesda reporting terminology. In this study we have analysed published raw data and presented this in NHSCSP terminology. Claims relating to sensitivity, specificity and smear adequacy have then been considered with reference to this data. Our analysis of existing data does not support the nationwide implementation of LBC at present. Further studies are recommended in order to evaluate the place of this technology within the NHSCSP.     

Posters. P7 Development of a web‐based resource pack for cytology training officers

The NHSCSP Cervical Cytopathology Training Log and accompanying Workbook are central to the education and training of new recruits in cytology laboratories in the UK. These are currently available only in paper format and do not fully address the needs of training officers and trainees in Wales. A web‐based resource pack, which complements the NHSCSP training documents, has been developed by the Welsh Cytology Training School to address these problems. The pack consists of the following sections and has recently been posted on the Welsh intranet:

• ? guide for training officers;
• ? teaching aids, including handouts and ‘powerpoint’ tutorials;
• ? image library;
• ? worksheets; and
• ? competency sheets.

The electronic format allows for instant updating and simultaneous availability to all training officers in Wales. It has been devised in an effort to standardize the training of new cytology recruits in laboratories throughout Wales, thereby ensuring that all new trainees receive the same high‐quality education and training wherever they are employed. CPD modules in gynaecological and non‐gynaecological cytology are being developed. Samples from the resource pack will be presented.     

Liquid-based cytology can improve efficiency of cervical smear readers: evidence from timing surveys in two NHS cytology laboratories

OBJECTIVE: Cervical screening programmes in England and Wales were advised by the National Institute for Clinical Excellence in 2003 to adopt liquid-based cytology (LBC) in place of conventional Papanicolaou (Pap) cytology to facilitate laboratory efficiency. Pilot evaluations in England and Scotland monitored daily or weekly workloads of smear readers and concluded that LBC could increase hourly throughput rates. This study, instead, used timing surveys to determine screening rates. METHODS: Two National Health Service cytology laboratories in Manchester and Stockport were partially converted to the LBC ThinPrep process for a cervical screening trial. Three 1-week timing surveys were conducted over 7 months. The surveys covered all LBC-trained staff. The first survey in Manchester also covered staff undertaking conventional Pap screening. The smear readers used timers to record time taken for examining and reporting each slide. RESULTS: In Manchester, in the first survey, nearly 1 minute per slide was saved by the LBC method during primary microscopy. In both laboratories, the mean microscopy time for primary screening of LBC slides was reduced by almost 1 minute between the first and second surveys. There was no difference between the second and third surveys. Microscopy by cytopathologists was also 1 minute per slide quicker with LBC than conventional Pap. The LBC inadequate rates for both laboratories were <2.0%. Organizational factors impacted on the hourly LBC primary screening rates in the laboratories, the rate for Stockport being higher than the rates in the pilot evaluations. CONCLUSIONS: The timing surveys confirm that the LBC ThinPrep technology can improve laboratory efficiency. However, decision-makers should also consider the overall costs and benefits of introducing the technology in screening programmes, including the capital investment and workforce implications.     

P-6SCREENER SENSITIVITY – ALL CHANGE FOR LBC

Introduction:  This poster aims to provide a discussion point for the calculation of screener performance. LBC has brought about changes in the way slides are interpreted, single dispersed isolated dyskaryotic cells take on a new meaning and the process of quality control, rapid review has changed. These changes challenge the rationale behind screener sensitivity calculations especially as many laboratories are in an early learning phase with regard to LBC.
Method:  Screener sensitivities and the PPV of reporting consultants for a period of six months post LBC conversion are compared with those since the introduction of LBC.
Results:  Screener sensitivities have dropped below the 95% threshold for high-grade dyskaryosis.
Discussion:  The change in rapid review or preview from a partial stepped rescreening of a conventional smear to a full rescreening of LBC slides has meant that all missed abnormalities that may not have been visualised in the conventional slide have a greater possibility of detection in the LBC slide. In analysing screener sensitivity a holistic approach that assesses the reasons for missing or misdiagnosing high-grade abnormalities is advised. Over reporting by consultants as indicated by PPV and slide review should be taken into account when there is a suspected poor performer. The recent move to refer all mild dyskaryotic smears for colposcopic assessment and the EQA requirement for screeners to detect dyskaryosis without the necessity for grading suggests that there may be a need to reassess the basis of current screener sensitivity calculations.     

A comparison of variability in Papanicolaou and liquid-based cytology inadequacy rates using Shewhart control charts

OBJECTIVE: To use Shewhart control charts to compare variability in inadequacy rates from Papanicolaou (Pap) and liquid-based cytology (LBC). DESIGN: Retrospective analysis of quality assurance data. SETTING: Eleven Welsh cytology laboratories. METHODS: Shewhart 'p' charts were plotted for proportions of slides reported as inadequate. Charts were compared for statistical control. MAIN OUTCOME MEASURES: Evidence of statistical control in the processes. RESULTS: Control charts allowed easy interpretation of patterns in the data. Variability in inadequacy rates was much lower for LBC than for Pap cytology. CONCLUSION: Monitoring inadequate rates with Shewhart charts provides more information than tabular monitoring reports, assisting in quality improvement. With respect to inadequacy rates, LBC is less variable than Pap cytology.     

The Yorkshire slide exchange external quality assessment (EQA) scheme

A slide circulation scheme measuring cervical screening performance of individual cytologists in 15 laboratories in Yorkshire Regional Health Authority is described. The advantages and disadvantages are compared with the current National Proficiency Testing (NPT) scheme. The results indicate that a slide circulation scheme can be successfully used in cervical cytology external quality assessment (EQA). Levels of participation are better than those currently achieved by regional variations of the NPT scheme, and the use of laboratory consensus in the selection of scoring slides appears to be no less valid than the use of a pre‐selected slide pool assembled by an expert panel. The volume of data accumulated in one round is considerably greater than that achieved by proficiency testing and the educational value is regarded as high. However, the scheme is very time consuming for participants and consequently expensive for laboratories. The lack of external supervision increases the risk of unfair practices within individual laboratories. Because of these problems, Yorkshire has now switched to an NPT scheme.     

Quality assurance of biological monitoring in occupational and environmental medicine

Biological monitoring of chemical exposure in the workplace has become increasingly important in the assessment of health risk as an integral part of the overall occupational health and safety strategy. In environmental medicine biological monitoring plays also an important role in the assessment of excessive, acute or chronic exposure to chemical agents. To guarantee that the results obtained in biological monitoring are comparable with threshold limit values and results from other laboratories, the analysis must be carried out with tested and reliable analytical methods and accompanied by a quality assurance scheme. Confounding influences and interferences during the pre-analytical phase can be minimised by recommendations from experienced laboratories. For internal quality control commercially available control samples with an assigned concentration are used. External quality control programs for biological monitoring are offered by several institutions. The external quality control program of the German Society of Occupational and Environmental Medicine has been organised since 1982. In the meantime the 27th program has been carried out offering 96 analytes in urine, blood and plasma for 47 substances. This program covers most of the parameters relevant to occupational and environmental medicine. About 350 laboratories take part in these intercomparison programs. At present, ten German and 14 international laboratories are commissioned to determine the assigned values. The data evaluated from the results of the intercomparison programs give a good overview of the current quality of the determination of analytes assessed in occupational and environmental toxicological laboratories. For the analysis of inorganic substances in blood and urine the tolerable variation ranges from 7.5 to 43.5%. For organic substances in urine the tolerable variation ranges from 12 to 48%. The highest variations (36-60%) were found for the analysis of organochlorine compounds in plasma. The tolerable variations for the determination of solvents in blood by head space gas chromatography range from 26 to 57%. If the recommendations for the pre-analytical phase, the selection of reliable analytical methods by the laboratory and the carrying out of adequate quality control are observed, the pre-requisites for reliable findings during biological monitoring are fulfilled     

Comparison of the conventional cervical smear and liquid-based cytology: results of a controlled, prospective study in the Abruzzo Region of Italy

OBJECTIVE: To compare conventional cervical testing (CCT) and liquid-based cytology (LBC) within a randomized trial performed during 2001-2002 in the Abruzzo Region of Italy, including a cost-outcome comparative analysis. STUDY DESIGN: Study subjects were recruited in the framework of a controlled, randomized study organized in the Abruzzo Region. Women aged 2 6-64 years were randomized to an active arm (LBC) or control arm (CC1). The particip ating laboratories had no previous ex perience with LBC. RESULTS: The inadequacy rate was 4.3% in CCT and 1.3% in the LBC arm (D < 0.001). Atypical squamous cells of undetermined sign ifi cance and atypical glands of undetermined significance reports were more frequent at CCT vs. LBC. A small, insignificant excess of low grade squamous intraepithelial lesions or high grade squamous epithelial lesions+ reports was observed in the LBC arm. The cervical intraepithelial neoplasia 2+ (CIN2+) detection rate was not statistically different in the 2 arms (CCT=0.54%, LBC= 0.66%, p = 0.28). In the overall series positive predictive value was slightly but not significantly higher in the LBC arm. LBC increased costs by 4.2% per both screened women and CIN2+ detected. CONCLUSION: The study reflects the introductory phase of LBC in laboratories without prior LBC experience. In this setting LBC reduced the inadequacy rate and decreased reading and was at least as sensitive as and more specific than CCT. Utilization of LBC in organized screening programs will be based on local feasibility, considering that the high cost of LBC is only partially compensated for by other benefits, such as residual cellular material, available for molecular testing, including human papillomavirus testing.     

An audit of the positive predictive value of high-grade dyskaryosis in cervical smears: 2001–2002

The positive predictive value (PPV) of high-grade dyskaryosis for cervical intraepithelial neoplasia grade 2 (CIN2) or worse on histology is published annually for the laboratories in the UK National Health Service Cervical Screening Programme (NHSCSP). The PPV fell in 2001 compared with 2000 for four of the five consultants reporting cervical smears in our laboratory, the greatest fall being from 91.6% to 77.9%. Investigation of the possible reasons for the fall suggested the main cause lay outside the laboratory in the type of biopsy taken at colposcopy. We conclude that biopsy type affects accuracy of PPV calculations. There is variation in collection and submission of KC61 data including PPV across laboratories. This factor needs to be taken into account when publishing and comparing laboratory data for the NHSCSP.     

Can external quality control improve pig AI efficiency?

External quality control programmes carried out by central laboratories have been long established in human andrology with the aim of enhancing the accuracy and reproducibility of semen assessment. Compared to human, demands on boar semen assessment in AI stations are more complex, with the need both to identify boars with poor ejaculate quality and to monitor individual boar differences for semen storage. Additionally, appropriate assessment serves as a control instrument to ensure the security and efficiency of semen processing. Despite current limitations regarding the ability of sperm assays to estimate the potential fertility of males, it is evident that boar fertility is related to certain conventional semen tests, e.g. sperm morphology. In central studies carried out on stored semen from 11 AI stations, flow cytometric assessment of plasma and acrosome membrane integrity proved to be more sensitive in detecting sperm damage associated with ageing and temperature stress as compared to light microscopy. Membrane integrity of stored semen differed between AI stations indicating significant influences of semen processing on sperm quality. Thus external control of semen quality in reference laboratories may be useful to monitor the efficiency of internal semen quality control in individual AI stations, to identify males with lower semen quality and/or poor response to semen storage, and to verify the precision of sperm counting. The possibility that central laboratories with sufficient resources may be able to identify functionally different responding sperm subpopulations for better estimation of fertility is discussed. Ideally, external quality control schemes for AI stations would comprise application of validated tests with high relevance for fertility (including bacterial status), analysis of semen processing on the AI station, and training courses for laboratory personnel.     

External quality assessment in gynaecological cytology: The Trent Region experience

A Department of Health Executive Letter stated in 1998 that the principal function of external quality assessment (EQA) is educational. Subsequently, in England, it has no longer been acceptable to assess performance in gynaecological cytology by proficiency testing. This paper describes the EQA scheme in gynaecological cytology that has been run by the Trent Regional Gynaecological Pathology Quality Assurance Group for the NHS Cervical Screening Programme (NHSCSP) since 1998. It conforms as closely as possible to the recommendations published by the Department of Health Working Group on Histopathology EQA Accreditation, and replaced the national proficiency testing protocol. The educational value of the scheme is derived predominantly from a numerical score which provides confidential and quantitative feedback to all participants. Personal performance monitoring occurs as a secondary function. For primary screeners and checkers, this is based purely on the distinction between negative, inadequate and abnormal smears. For pathologists, personal performance monitoring also includes grading of abnormalities. The EQA has been designed so that all professional groups participate in a manner that closely mimics normal practice. Only slides that have achieved an 80% consensus amongst participants are used in the EQA. Substandard performance has been defined as those participants with scores falling below the 2.5%ile. The paper describes the EQA in detail and illustrates its use by means of the second round results. The EQA protocol developed within Trent and described in this paper has contributed to proposals contained in the current national EQA in gynaecological cytology for the NHSCSP. In particular this paper highlights the effectiveness of the scoring system contained within the Trent and National EQA protocols.     

Assessing the wellbeing of cytoscreeners: experience in two NHS cytology laboratories

OBJECTIVE: Cervical screening programmes in England are in transition as the liquid-based cytology (LBC) method replaces conventional Papanicolaou screening and staff in NHS laboratories are trained to analyse LBC smears. Cytoscreeners and biomedical scientists undertake routine microscopy of slides, but the scientists usually have a wider professional role. Attitudinal surveys were carried out in laboratories where LBC was partially introduced. METHODS: Staff in two cytology laboratories in Greater Manchester were surveyed twice over 6 months. The questionnaire assessed work pressures using scales from the Measures of Work Characteristics instrument, work-related stress using the General Survey version of the Maslach Burnout Inventory, job intentions and job satisfaction. RESULTS: Cytoscreeners, many aged over 50 years, formed over 60% of respondents in both surveys (27/42 in the first survey), and biomedical scientists and doctors, 30%. Both groups were under moderate pressure from work demands in each survey, but cytoscreeners had significantly less autonomy over their working methods (P < 0.001). Although both groups experienced similar levels of exhaustion, cytoscreeners were much more cynical or indifferent towards work in the second survey (P = 0.008) and had lower expectations of being effective (P < 0.001). For the cytoscreeners, there were strong negative correlations in both surveys between cynicism and the work characteristics of influencing decisions and autonomy/control. CONCLUSIONS: The strength of the relationship between work performance and wellbeing serves to emphasize the importance of the new LBC technology in ameliorating low morale where it exists. Further attitudinal research involving larger samples of laboratories is warranted to assess the full impact of this innovation.     

Monitoring and evaluating the performance of the UK NHS Cervical Screening Programme: monitoring performance by using cytology outcomes adjusted for population characteristics

Current quality assurance measures used in the NHS cervical screening programme (NHSCSP) include a review of laboratories with percentages of moderate/severe and borderline/mild smear results outside the 10th-90th percentiles. The method is limited by the fact that many of these outlier smear percentages may reflect laboratories covering populations with low or high risk and/or short or long average screening intervals. This paper outlines a new approach to aid the detection of outlier laboratories, by using data collected at the primary care trust (PCT) or health authority (HA) level and making allowances for population characteristics and screening interval. The setting is the NHSCSP in England using annual data provided by HAs. Data from the screening year 2000-01 is used to illustrate the methodology, although the methods can also be applied to data at the PCT level (now being collected for 2002-03 onwards). Percentages of smear results have been analysed against a series of explanatory variables using logistic regression models. These explanatory variables include Townsend deprivation index, uptake-corrected ethnic minority composition, a measure of screening interval, area type and region. An expected percentage of borderline/mild and moderate/severe smears is estimated from the models and an observed : predicted ratio (OPRmod/sev and OPRbord/mild) calculated. Low values are suggestive of relative undercalling and high values overcalling, after allowance for population characteristics. Analysis of data for 2000-01 showed that the OPRmod/sev for the 99 HAs varied from 0.68 to 1.44. Laboratories with low percentages of moderate/severe smears, but associated with PCTs or HAs with OPRmod/sev values closer to unity may not need to be investigated as their observed rates are consistent with predicted rates based on population characteristics. The method could also be directly applied to laboratories if further information on the population covered by each laboratory were routinely collected.     

Intercenter reproducibility of binary typing for Staphylococcus aureus

The reproducibility of the binary typing (BT) protocol developed for epidemiological typing of Staphylococcus aureus was analyzed in a biphasic multicenter study. In a Dutch multicenter pilot study, 10 genetically unique isolates of methicillin-resistant S. aureus (MRSA) were characterized by the BT assay as presented by van Leeuwen et al. [J. Clin. Microbiol. 2001 39 (1) 328]. The BT assay, including a standardized DNA extraction protocol was performed in duplicate in eleven medical microbiology laboratories. Two different hybridization detection procedures were applied and a prelabeled DNA sample as process control was included. Only three laboratories accurately identified all strains. Divergence in technical procedures resulted in misinterpretation due to an increasing number of faint or absent hybridization signals in combination with high background staining. The binary type of the process control was determined correctly by all participating laboratories. The feasibility of the BT protocol was related directly to the skill of the laboratory personnel. On the basis of the national study, we concluded that the DNA extraction protocol needed modification to improve DNA yield and purity. Subsequently, seven European laboratories participated in an international study to determine the reproducibility of the modified BT protocol. Each center was asked to analyze 10 DNA samples previously extracted from 10 MRSA strains (phase 1) and, additionally, to analyze 10 MRSA strains, using the standardized or their in-house DNA isolation protocol (phase 2). A prelabeled DNA process control sample was included again. The binary types of all DNA samples were identified correctly by all but one laboratories. This latter laboratory diverged from the protocol by adding an excess of labeled DNA to the hybridization mixture, resulting in a high background and, therefore, noninterpretable BT results. All centers produced identical BT results for the process control. Five of the seven centers correctly identified the binary types of all 10 MRSA strains in phase 2 of the international study. Three of these centers used their in-house DNA extraction protocol. Divergence from the standard BT protocol in the remaining two centers resulted in no interpretable BT data for the 10 MRSA strains. The study demonstrated that each center that followed the BT protocol to the letter could generate reproducible results, irrespective whether or not an in-house DNA isolation protocol was used. The current BT protocol thus represents a simple method generating robust, reproducible genotype data for S. aureus strains.     

Harmonization guidelines for HLA-peptide multimer assays derived from results of a large scale international proficiency panel of the Cancer Vaccine Consortium

Purpose  The Cancer Vaccine Consortium of the Cancer Research Institute (CVC-CRI) conducted a multicenter HLA-peptide multimer proficiency panel (MPP) with a group of 27 laboratories to assess the performance of the assay. Experimental design  Participants used commercially available HLA-peptide multimers and a well characterized common source of peripheral blood mononuclear cells (PBMC). The frequency of CD8+ T cells specific for two HLA-A2-restricted model antigens was measured by flow cytometry. The panel design allowed for participants to use their preferred staining reagents and locally established protocols for both cell labeling, data acquisition and analysis. Results  We observed significant differences in both the performance characteristics of the assay and the reported frequencies of specific T cells across laboratories. These results emphasize the need to identify the critical variables important for the observed variability to allow for harmonization of the technique across institutions. Conclusions  Three key recommendations emerged that would likely reduce assay variability and thus move toward harmonizing of this assay. (1) Use of more than two colors for the staining (2) collect at least 100,000 CD8 T cells, and (3) use of a background control sample to appropriately set the analytical gates. We also provide more insight into the limitations of the assay and identified additional protocol steps that potentially impact the quality of data generated and therefore should serve as primary targets for systematic analysis in future panels. Finally, we propose initial guidelines for harmonizing assay performance which include the introduction of standard operating protocols to allow for adequate training of technical staff and auditing of test analysis procedures. Electronic supplementary material  The online version of this article (doi:) contains supplementary material, which is available to authorized users.     

The Quality of Sputum Smear Microscopy in Public-Private Mix Directly Observed Treatment Laboratories in West Amhara Region,Ethiopia

Ethiopia adopted Public-Private Mix Directly Observed Treatment Short Course Chemotherapy (PPM-DOTS) strategy for tuberculosis (TB) control program. Quality of sputum smear microscopy has paramount importance for tuberculosis control program in resource-poor countries like Ethiopia. A cross-sectional study was conducted to assess the quality of sputum smear microscopy in 37 Public-Private Mix laboratories in West Amhara, Ethiopia. The three external quality assessment methods (onsite evaluation, panel testing and blind rechecking) were employed. Onsite assessment revealed that 67.6% of PPM-DOTS laboratories were below the standard physical space (5 X 6) m². The average monthly workload per laboratory technician was 19.5 (SD±2.9) slides with 12.8% positivity rate. The quality of Acid Fast Bacilli (AFB) staining reagents was sub-standard. The overall agreement for blind rechecking of 1,123 AFB slides was 99.4% (Kappa = 0.97). Reading of 370 AFB panel slides showed 3.5% false reading (Kappa = 0.92). Moreover, the consistency of reading scanty bacilli slides was lower (93%) compared to 1+, 2+ and 3+ bacilli. Based on blind rechecking and panel testing results, PPM-DOTS site laboratories showed good agreement with the reference laboratory. Physical space and qualities of AFB reagents would be areas of intervention to sustain the quality of sputum smear microscopy. Therefore, regular external quality assessment and provision of basic laboratory supplies for TB diagnosis would be the way forward to improve the quality of sputum smear microscopy services in PPM-DOTS laboratories.