- Research note
- Open access
- Published:
Misdiagnosis of pulmonary tuberculosis and associated factors in peripheral laboratories: a retrospective study, Addis Ababa, Ethiopia
BMC Research Notes volume 11, Article number: 291 (2018)
Abstract
Objective
Sputum smear microscopy reading errors are likely to result in failure to detect persons with infectious TB. This study was intended to review misdiagnosis of pulmonary TB and associated factors in peripheral laboratories.
Results
During the study period 1033 (10.5%) sputum smear positive and 8783 (89.5%) smear negative slides were reported by peripheral laboratories. The slides were re-read by the central referral laboratories (CRLs) as the reference standard reading. Of 1033 positive slides reported by peripheral laboratories, 25 (2.4%) were false positive. Out of 8783 smear negative slides reported by peripheral laboratories, 35 (0.4%) were false negative. The sensitivity, specificity, positive predictive value and negative predictive value of peripheral laboratories were 96.64, 99.72, 97.58, and 99.61% respectively. The peripheral laboratories and CRLs have an observed agreement (Po) of 0.9939. Of 135 peripheral laboratories, 93 (68.9%) read negative and positive slides correctly, 49 (36.3%) did not have lens cleaning tissue papers, 11 (8.1%) lacked frosted slides, and 14 (10.4%) had shortage of reagents. As conclusions, the peripheral laboratories and CRLs had high agreement for sputum smear microscopy reading. However, a few TB cases were misdiagnosed despite having the disease; these individuals might continue to spread the infection in the community.
Introduction
Laboratory services continue playing critical role in diagnosing TB and treatment monitoring [1, 2]. However, it requires strong quality assurance (QA) systems be in place [3,4,5,6]. In contrary, reading errors in ZN-stained sputum smear microscopy are likely to result in failure to detect persons with infectious TB, consequently continues to spread infection in the community, or may unnecessary treated for non TB cases [5,6,7]. Moreover, in adequately training, erratic reagent, supplies, and poor equipment maintenance inflate the problems.
Accurate and reliable TB microscopy result relies on external quality assessment (EQA) programs that support, train, and monitor testing performance of individual laboratories [3, 8]. External quality assessment comprises proficiency testing, blind-rechecking of samples and on-site evaluation [7,8,9]. In study setting, blind-rechecking programs is crucial EQA method in assessing sputum smear microscopy reading performance of the laboratory [7, 8]. It provides an opportunity to assess quality performance elements including specimen quality, smear size and thickness, and quality of staining. All these information may be very useful to assessing possible reasons for false positive or false negative results, and implementing plans for retraining and corrective action [3, 9, 10].
Information concerning the performance of EQA in private and public laboratories in Addis Ababa is very limited; hence we reviewed 135 public and private health facilities’ ZN sputum smear microscopy EQA performance, to determine misdiagnosis of pulmonary TB cases and associated factors in private and public health facilities in Addis Ababa, Ethiopia.
Main text
Methods
Retrospective review of EQA records in 135 public and private laboratories in Addis Ababa Ethiopia was conducted, from October, 2014 to March, 2016. These peripheral laboratories provide TB diagnostic services and they participate in ZN smear microscopy Regional External Quality Assurance Scheme (REQAS). This study compared the results of peripheral laboratories’ ZN-stained sputum smear microscopy reading performances with CRLs as a gold standard.
Study subjects
One hundred thirty five peripheral laboratories (45 privates and 90 public) providing TB diagnostic service to patients in Addis Ababa were considered for the current study.
Data sources and sampling
Data were collected from 135 health facilities in Addis Ababa. The health facilities’ ZN-stained sputum smear microscopy EQA performances and onsite EQA records were used as data source.
Inclusion and exclusion criteria
All peripheral laboratories having complete EQA performance records in the CRLs data storage, from the years 2014–2016 were included. However, TB laboratory results performed by other than ZN technique were excluded.
Data management and statistical analysis
The collected data were checked for completeness and consistency and entered into using Epi-info software. The data were coded and analysed using SPSS version 20.0 (SPSS Inc. Chicago, USA) software. ZN-stained sputum smear microscopy reading agreement between the peripheral microscopy centers and the CRLs were measured by using Kappa (K). Inter-observer variability was assessed on the basis of κ-values, with kappa coefficient: 0.81–1 = almost perfect, 0.61–0.8 = substantial, 0.41–0.60 = moderate, 0.21–0.40 = fair, 0.01–0.20 = slight and ≤ 0 = poor agreement between slide readers [11]. Sensitivity, specificity, PPV and NPV of the peripheral laboratories were calculated against the final readings of the CRLs as a gold standard. Bivariate and Multivariate logistic regression model using odds ratio (OR) at 95% confidence interval (CI) were calculated. P value less than 0.05 were taken as statistically significant.
Data quality assurances
Before extracting data from records, data collectors were adequately trained and the collected data were checked for completeness by data collectors and authors. Data collection process was supervised and monitored by the principal investigator.
Operational definition
-
Central referral laboratories (CRLs): Regional and intermediate level (Hospital) laboratories serving as ZN smear microscopy a quality assurance (REQAS) centers for peripheral laboratories.
-
Peripheral laboratories: Laboratories located at a Health Center or private Hospital and different level of Clinics, providing ZN smear microscopy diagnostic services.
-
Discordant slides: Positive slides read as negative or vice versa.
Result
ZN-stained sputum smears microscopy reading agreement
During the study period 135 peripheral laboratories were involved in REQAS. Among these, 45 (33.3%) were private and the remaining 90 (66.7%) public health facilities. Of 135 peripheral laboratories, 93 (68.9%) correctly read negative and positive sputum smear slides. The remaining 42 (31.1%) laboratories misread at least one positive sputum smear slides as negative or vice versa. Out of 42 health peripheral laboratories reported false reading results, 23 (54.8%) were public and the remaining 19 (45.2%) were private’ laboratories. However, there was no statistically significant difference in sputum smear microscopy false reading results between public and private laboratories (P value > 0.05).
Of 9816 ZN-stained sputum smear slides were collected from the peripheral laboratories for re-checking, 1033 (10.5%) were reported as positive, and the reaming 8783 (89.5%) were reported as negative by peripheral laboratories. The slides were re-read by the CRLs, which were considered as the reference standard reading. Of 1033 sputum smear slides reported as positive by peripheral laboratories, 1008 (97.6%) were true positive, the remaining 25 (2.4%) were false positive. Out of 8783 sputum smear slides reported as negative by peripheral laboratories, 8748 (99.6%) were true negative, the remaining 35 (0.4%) were false negative. The overall discordant rate between peripheral laboratories and CRLs was 60 (0.61%) (Table 1).
The study has shown an observed agreement (Po) of 0.9939, expected agreement (Pe) of 0.8109 and calculated kappa value was 0.97, which indicated almost perfect agreement. The sensitivity, specificity, PPV and NPV of peripheral laboratories in ZN-stained sputum reading was 96.64, 99.72, 97.58 and 99.6% respectively.
Smear quality
None of the peripheral laboratories assessed met sputum smear quality standards. Of 9816 collected sputum smear slides from the peripheral laboratories, 3475 (35.4%) specimen quality, 3316 (33.8%) evenness, 3004 (30.6%) smear size and 2817 (28.7%) labeling were found as poor. Moreover, 3846 (39.2%) smears were prepared with inappropriate thickness, and 3029 (30.9%) smears were unacceptable staining background cleanness. Compared to the performance of public and private laboratories for each of the quality indices, of 3168 sputum smear slides collected from the private laboratories, 1163 (36.7%) specimen quality, 1042 (32.9%) evenness, 991 (31.3%) smear size, 916 (28.9%) labeling, 1291 (40.8%) thickness, and 1039 (32.8%) staining background were unacceptable. Of 6648 slides collected from the public laboratories, 2312 (34.8%) specimen quality, 2274 (34.2%) evenness, 2013 (30.3%) smear size and 1901 (28.6%) labeling, 2552 (38.4%) thickness, and 2053 (30.9%) staining background were found as poor.
Tuberculosis laboratory facilities and infrastructures
On-site evaluation of EQA was conducted in 135 peripheral laboratories to assess the status of TB laboratory infrastructures and factors affecting the quality of ZN-stained sputum microscopy diagnosis. The entire assessed peripheral laboratories had functional light microscope, 104 (77.0%) had separate work station for smearing, staining, microscopy examination and recording. Of the total TB laboratories assessed, 79 (58.5%) had clean, separate and ventilated TB laboratory room, 127 (94.1%) had regular water supply and 131 (97.0%) had back up electric power supply (Table 2).
Shortage of supplies including all type of reagents (Carbol-fuchsin, methylene blue and Acid alcohol), lens tissue; frosted slides, internal quality control (IQC) reagents were identified in most peripheral laboratories. Of 135 peripheral laboratories, 49 (36.3%) did not have lens cleaning tissue papers, 11 (8.1%) lacked frosted slides, 14 (10.4%) had shortage of ZN-staining reagents, and nearer to half (42.2%) did not filter 1% carbol-fuchsin during staining of sputum smears. However, all peripheral laboratories used the appropriate personal protective equipment (PPE) when performing TB laboratory procedures, and they used incinerator to dispose sputum, and other sputum contaminated solid wastes (Table 2).
Quality assurance
There were gaps in having valid internal quality control materials in all assessed laboratories. Among these, 38 (28.1%) laboratories prepare smears from known positive and negative sputum as internal quality control to check reagents quality before staining patient sample. About 59 (43.7%) did not check sputum quality before processing. Among 135 visited laboratories, 109 (80.7%) had standard TB laboratory request form and result log book, 107 (79.3%) had TB national guideline; manual, SOPs and other reference materials for smear microscopy technique. More than half (76.3%) of the peripheral laboratories’ staffs members were trained on sputum smear microscopy (Table 2). From those who took training, 73 (70.9%) were from public health facilities.
Factors affecting sputum smear microscopic reading
In binary logistic regression, false reading of sputum smear microscopy had significant association with checking the quality of sputum before smear preparation, having separate TB laboratory room and filtering carbol-fuchsin before staining sputum smear (P value < 0.05). However, in multivariate logistic regression analysis, false reading had no significant association with these factors (P value > 0.05) (Table 3).
Discussion
In the current study, sputum smear microscopy reading agreements between the peripheral laboratories with the CRLs were evaluated, using CRLs as reference standard. The sensitivity, specificity, PPV and NPV of the peripheral laboratories were 96.64, 99.72, 97.58 and 99.61%, respectively, which is comparable to 95, 99.7, 93.3 and 99.7% respectively reported in Ethiopia and 91.3, 98.9, 92.2 and 98.8% respectively reported in Argentine [12, 13]. In contrast, it is higher than others studies [14,15,16]. In present study overall sputum smear reading agreement between the peripheral diagnostic laboratories and CRLs was 99.4%, which is comparable to 99.5% reported in west Amhara Region [17] and 99.7%, reported Lima, Peru [18]. However, it is higher compared to 96.8% reported in south Ethiopia [19] and 87% reported in Addis Ababa [16] and 89.2% report in Tanzania [20]. Although, the proportion of sputum smear microscopy reading agreement of 99.4% achieved is higher than acceptable performance of > 80% [7, 10, 21], still disagreement of 0.6% may indicate a need to improve the quality of TB microscopic reading.
In this study overall discordant (false reading) results of sputum microscopy reported by the peripheral laboratories was 60 (0.6%), which is lower than the previous reports of 7.8% in Argentine, 3.5% in west Amhara Region, 3.2% in southern Ethiopia, 3.3% in India, and 5.5% in eastern part of Ethiopia [13, 17, 19, 22, 23]. It is higher than study reported 0.2% in Ethiopia and 0.3% in Taiwan [12, 24]. These variations might be due to sputum smear microscopy reading is highly dependent on the training, diligence of microscopist and laboratory supplies. The other possible reason, unfiltered fuchsin crystals reagents, weak decoloration of AFB might affect the quality of ZN smear microscopy reading and lead to false reading results [16, 20, 26].
In the present study specimen quality, evenness, smears size, inappropriate labeling, thickness, and smears with unacceptable staining background cleanness were 35.4, 33.8, 30.6, 28.7, 39.2 and 31.5% respectively, which is relatively lower than other studies [24,25,26]. Specimen container, sample transport condition, specimen quality, labeling, smearing, and staining technique including failure to filter carbol fuchsin are some of the factors that compromise ZN sputum smears quality performance indices [20, 26].
In the current study 79 (58.5%) of the peripheral laboratories having clean, separate and ventilated TB laboratory room, which is higher than 18.2–42% previously reported in other studies [15, 16, 27, 28]. Unventilated TB laboratory room can create unfavorable working environment, which might affect the overall quality of sputum smear microscopy services from pre-analytical to post analytical phases. In addition, this may create a chance of cross contamination [2, 29].
Regarding TB laboratory safety issue, all the peripheral laboratories used the appropriate PPE and disposed sputum and other sputum contaminated solid wastes appropriately. This finding was higher when compared with study conducted in Malawi, which reported most hospitals’ laboratories didn’t wear white coat, face mark, protective apron and soap for washing hand [27]. The difference might be due to availability of PPE, professionals’ attitude towards PPE. A poor laboratory safety practice does not only put the laboratory workers at risk of infection, but also the patients and any other person accessing the laboratory services.
Conclusion
In the present study peripheral laboratories and CRLs had high agreement for ZN sputum smear microscopy reading. However, a few TB cases were misdiagnosed despite having the disease; these individuals might continue to spread the infection in the community. This indicates the needs to improve ZN-stain sputum smear microscopy reading to attain the end TB strategy.
Limitations of the study
-
Results of this study depend only on the TB-EQA record review. Therefore, not illustrate providers view.
Abbreviations
- AFB:
-
acid fast bacillus (or bacilli)
- AOR:
-
adjusted odds ratio
- CI:
-
confidence interval
- CRLs:
-
central referral laboratories
- EQA:
-
external quality assessment
- NPV:
-
negative predictive value
- COR:
-
crude odds ratio
- SPSS:
-
Statistical Package for Social Sciences
- PPV:
-
positive predictive value
- TB:
-
tuberculosis
- WHO:
-
World Health Organization
- ZN:
-
Ziehl–Neelsen stain
- REQAS:
-
Regional External Quality Assurance Scheme
References
Onyebujoh PC, Thirumala AK, Ndihokubwayo J-B. Integrating laboratory networks, surveillance systems and public health institutes in Africa. Afr J Lab Med. 2016;5(3):431. https://doi.org/10.4102/ajlm.v5i3.431.
World Health Organization, Stop TB Partnership Retooling Task Force, Stop TB Partnership New Diagnostics Working Group. New laboratory diagnostic tools for tuberculosis control;2009. http://www.stoptb.org/assets/documents/global/retooling/Retooling_Stakeholders.pdf. Accessed 22 June 2017.
External Quality Assessment for AFB Smear Microscopy. https://www.aphl.org/aboutAPHL/publications/Documents/External_Quality_Assessment_for_AFB_Smear_Microscopy.pdf. Accessed 4 July 2017.
Steingart KR, Ramsay A, Pai M. Optimizing sputum smear microscopy for the diagnosis of pulmonary tuberculosis. Expert Rev Anti Infect Ther. 2007;5(3):327–31.
Van Denu A, Portaels F. Limitations and requirements for quality control of sputum smear microscopyfor acid-fast bacilli. Int J Tuberc Lung Dis. 1998;2(9):756–65.
World Health Organization, Quality Assurance of Sputum Microscopy in DOTS Programmes. Regional guidelines for countries in the Western Pacific Regional Office for the Western Pacific. Manila: WHO; 2003. http://www.who.int/ihr/training/laboratory_quality/11_cd_rom_tb_eqa_wpro.pdf. Accessed 30 June 2017.
Federal Ministry of Health (FMOH). Guidelines for quality assurance of smear microscopy for tuberculosis diagnosis, vol. 1. Addis Ababa: Federal Ministry of Health (FMOH); 2009. p. 23–30.
World Health Organization. Overview of external quality assessment (EQA): module 10, content sheet 10-1. Geneva: World Health Organization; 2011. http://www.who.int/ihr/training/laboratory_quality/10_b_eqa_contents. Accessed 30 June 2017.
Quality Assurance of Sputum Microscopy in DOTS Programmes. Regional guidelines for countries in the Western Pacific. Geneva: World health organization. ISBN: 92 9061 056 5. http://www.who.int/ihr/training/laboratory_quality/11_cd_rom_tb_eqa_wpro.pdf. Accessed 2 June 2017.
Laboratory National Tuberculosis Reference. Standard manual for laboratory technicians on sputum smear microscopy. 2nd ed. Bhutan: National Tuberculosis Reference Laboratory; 2011 (Google Scholar).
Viera AJ, Garrett JM. Understanding inter-observer agreement: the Kappa Statistic. Fam Med. 2005;37(5):360–3.
Melese M, Jerene D, Alem G, Seid J, Belachew F, Kassie Y, et al. Decentralization of acid fast bacilli (AFB) external quality assurance using blind rechecking for sputum smear microscopy in Ethiopia. PLoS ONE. 2016;11(3):e0151366. https://doi.org/10.1371/journal.pone.0151366.
Kusznierz GF, Latini OA, Sequeira MD. Quality assessment of smear microscopy for acid-fast bacilli in the Argentine tuberculosis laboratory network, 1983–2001. Int J Tuberc Lung Dis. 2004;8(10):1234–41.
Selvakumar N, Kumar V, Gopi PG, Sivagamasundari S, Prabhakaran E, Vasanthanand S, Narayanan PR. Proficiency to read sputum AFB smears by senior tuberculosis laboratory supervisors under training at a reference laboratory in India. Indian J Tuberc. 2005;52:11–4.
Wu MH, Chiang CY, Jou R, Chang SY, Luh KT. External quality assessment of sputum smear microscopy in Taiwan. Int J Tuberc Lung Dis. 2009;13(5):606–12 (PubMed PMID: 19383194).
Mosissa Lemi, Kebede Abebaw, Mindaye Tedla, Getahun Muluwork, Tulu Sisay, Desta Kassu. External quality assessment of AFB smear microscopy performances and its associated factors in selected private health facilities in Addis Ababa, Ethiopia. Pan Afr Med J. 2016;24:125. https://doi.org/10.11604/pamj.2016.24.125.7459.
Manalebh A, Demissie M, Mekonnen D, Abera B. The quality of sputum smear microscopy in public-private mix directly observed treatment laboratories in West Amhara Region, Ethiopia. PLoS ONE. 2015;10(4):e0123749. https://doi.org/10.1371/journal.pone.0123749.
Otero L, Van Deun A, Agapito J, Ugaz R, Prellwitz G, Gotuzzo E, Van der Stuyft P. Quality assessment of smear microscopy by stratified lot sampling of treatment follow-up slides. Int J Tuberc Lung Dis. 2011;15(2):211–6.
Shargie EB, Yassin MA, Lindtjorn B. Quality control of sputum microscopic examinations for acid-fast bacilli in Southern Ethiopia. Ethiop J Health Dev. 2005; 19(2):104–8.
Basra D, Matee MIN, McNerney R. Quality assessment of sputum smears microscopy for detection of acid fast bacilli in peripheral health care facilities in Dar es Salaam, Tanzania. East Afr Med J. 2006;83(6):306–10.
Mulat M. Quality performance evaluation of laboratories on AFB smears microscopy in Eastern Amhara Region, Ethiopia. Department Of Medical Laboratory Sciences; 2011. Google Scholar.
Selvakumar N, Prabhakaran E, Rahman F, Chandu NA, Srinivasan S, Santha T, et al. Blinded rechecking of sputum smears for acid-fast bacilli to ensure the quality and usefulness of restaining smears to assess false-positive errors. Int J Tuberc Lung Dis. 2003;7(11):1077–82.
Ayana DA, Kidanemariam ZT, Tesfaye HM, Milashu FW. External quality assessment for acid fast bacilli smears microscopy in eastern part of Ethiopia. BMC Res Notes. 2015;8:537. https://doi.org/10.1186/s13104-015-1478-0.
Kumar V, Raghavan R, Nagamiah S, Chauhan LS. External quality assessment of smear microscopy by the National Reference Laboratory in nine states of India. Int J Tuberc Lung Dis. 2009;13(9):1183–5.
Fujiki A, Giango C, Endo S. Quality control of sputum smear examination in Cebu Province. Int J Tuberc Lung Dis. 2002;6:39–46.
Franco C. Calidad del exámen directo de esputo en la Red de Laboratorios de BacteriologÃa de la TBC de Colombia. Bol Oficina Sanit Panam. 1993;115:103–9.
Nyirenda TE, Mundy CJ, Harries AD, Banerjee A, Salaniponi FM. Safety in laboratories carrying out sputum smear microscopy: a dilemma for resource-poor countries. Int J Tuberc Lung Dis. 1998;2(8):690–3 (PubMed PMID: 9712286).
Nnaji GA, Chukwu JN. Comparative analysis of errors in reading sputum smears microscopy by supervisors and peripheral laboratory technicians in southeastern Nigeria. Trop J Med Res. 2015;18:80–4.
Mycobacteriology Laboratory Manual. World Health Organization Regional Office for the Western Pacific Stop TB, April 2014. http://www.who.int/tb/laboratory/mycobacteriology-laboratory-manual.pdf. Accessed 27 June 2017.
Authors’ contributions
DMD designed the study, develops the proposal, lead data collection, analysis and writing up the result. BD, and AT critically review and made progressive suggestions in the study. KT, HM, CS, YWK, KA, DD, MS, AZ, AT, TKH were participated in data collection, analysis, interpretation, and write up the result. All authors read and approved the final manuscript.
Acknowledgements
The authors would like to acknowledge Addis Ababa City Administration health Bureau Pubic Health research and Emergency management core processes. We sincerely thank respective health facilities for their cooperation. Our thanks also extend to all of the CRLs laboratory staffs for their commitment during slides rechecking.
Competing interests
The authors declare that they have no competing interests.
Availability of data and materials
All data were presented in the result parts of the manuscript.
Consent for publish
Not applicable.
Ethical approval and consent to participate
Ethical approval was obtained from Ethics committee of Addis Ababa City Administration Health Bureau Public Health Research and Emergency management core processes.
Funding
The authors had no funding support or funding to report.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Desalegn, D.M., Kitila, K.T., Balcha, H.M. et al. Misdiagnosis of pulmonary tuberculosis and associated factors in peripheral laboratories: a retrospective study, Addis Ababa, Ethiopia. BMC Res Notes 11, 291 (2018). https://doi.org/10.1186/s13104-018-3414-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13104-018-3414-6