- Research note
External quality assessment of malaria microscopy diagnosis among public health facilities in West Amhara Region, Ethiopia
BMC Research Notesvolume 10, Article number: 764 (2017)
To evaluate the importance of external quality assessment program on malaria microscopic diagnosis.
A total of 3148 slides were collected in 4 consecutive external quality assessment rounds and blindly rechecked at Amhara Public Health Institute. The average agreement between health facility and APHI slide readers was 96.6%. The percent agreement for parasite detection and species identification for P. falciparum became improved in four consecutive EQA rounds from 93.88 to 99.24% and 92.67 to 97.35% respectively. The rates of false positive and false negative were also dramatically decreased in each round from 10.5 to 0.79% and 2.14 to 0.74% respectively. Therefore, we recommend that malaria EQA program should maintain and expand in all malaria diagnostic health facilities in the region to provide accurate and reliable malaria microscopic service.
Malaria is a serious public health problem in many parts of the world, demanding an unacceptable toll on the health and economic welfare of the world’s poorest communities . Annual malaria cases in Ethiopia are estimated to be around 5 million cases per year. Its transmission is unstable and seasonal .
Prompt and accurate diagnosis of malaria is part of effective disease management that is based on clinical suspicion and detection of parasites in the blood . Blood smear microscopy diagnosis is the most affordable, accessible and reliable technique for diagnosis of malaria infection .
Failure to detect persons with malaria can lead to the continued spread of infection in the community, miss use of anti-malaria drugs and fasten the appearance of drug resistance . Active quality assurance program, competent and motivated staff, effective training, regular mentoring and adequate supply will ensure uninterrupted and quality malaria microscopic diagnosis service .
External quality assessment (EQA) is a quality assurance method for objectively checking the laboratory’s performance through panel testing, blinded rechecking of slides and on-site supervision. The blind rechecking method is a process by which slides are randomly selected from diagnostic health centers, transported to the higher level laboratory and reexamined blindly to evaluate the performance of laboratories . Studies done by Pakistan and Congo showed that external quality assessment methods were found to be feasible and acceptable to improve the quality of malaria microscopy service [7, 8]. The major deficiencies may be due to poor competency, poor equipment, poor reagents, or poor infrastructure and work practices that require urgent alteration . EQA program ensures reliable malaria microscopic diagnosis that recognized as an important component of effective malaria case management and control. However, an EQA program has not been conducted previously and not recognized as an important method to improve the quality of malarial microscopic diagnosis services in the study area. Therefore, this study had an objective of evaluating the importance of external quality assessment program on the improvement of malaria microscopic diagnosis at health center laboratories in the region.
An institutional based, cross-sectional study was conducted from July 2013 to October 2014. The study was carried out at malaria diagnostic health centers in West Amhara region. The region has five zones and two city administrations that have a total population of 11,240,275 . There were 8 hospitals, 278 diagnostic health centers and one research institute in the region which provide different health care services. EQA program of malaria has been coordinated by Amhara Public Health Institute (APHI).
A total of 20 health centers were enrolled and participated in this program and all were included in this evaluation. In accordance with the national malaria EQA guideline, 40 giemsa stained slides (20 positive and 20 negative) were randomly selected from each participated diagnostic sites in every 4 months. A total of 4 consecutive EQA rounds conducted from July 2013 to October 2014. All the selected slides with their result from each site sent to APHI for rechecking in every round. Then slides were distributed to trained quality officers at APHI without disclosing the result of health centers. When discrepant results identified, the slides were rechecked by senior quality officer for confirmation and the result was considered as final. Discordant slides then taken to their corresponding diagnostic sites by APHI experts to show their errors and trained practically on site to improve the skill of the lab staff of diagnostic sites. Additionally, APHI has prepared and sent a feedback in the form of a written report; showing details of gaps and offering suggestions to improve the quality of diagnosis services after each round of rechecking. The discordant result stands for any positive result reported as negative, or any negative result reported as positive, or any species misdiagnosis.
Data were entered and analyzed using Microsoft Office Excel 2007. Each laboratory was evaluated for percentage of agreement, false positive rate, false negative rate and species misdiagnosis. The trend of the performance of each laboratory also calculated. Finally, the result was presented with tables, graphs, and figures.
Ethical clearance was secured from the Amhara Regional Health Bureau Ethical Review Committee. Official permission was also obtained from each participated health centers. The result was kept confidentially and communicated to Amhara Regional Health Bureau, Amhara Public Health Institute, Ethiopian Public Health Institute and other partners.
Agreement of results
A total of 3200 slides were collected in 4 consecutive EQA rounds in 16 months period from 20 health facility laboratories. Of which 52 slides were damaged during transportation and in the process. Out of 3148 slides, 1487 slides were reported as positive and 1661 slides were reported as negative at participated health facilities laboratories. All collected slides were rechecked at APHI and 1402 slides reported as positive and 1639 slides were reported as negative. Out of the total collected slides, the result of 96.6% was agreed between the participated health facilities and APHI readers. However, the result of 3.4% slides was discordant. As the EQA program has continued from round one to four the number of discordant slides was decreased notably (see Table 1).
The percent agreement result between participated health facilities and APHI slide readers improved in each 4 consecutive EQA rounds (94, 95, 98 and 99%). Species identification percent agreement for P. falciparum, between participated health facilities and APHI readers, was also improved, from 92 to 97%, as the implementation of EQA program has been continued.
False negative, false positive and species misdiagnosis
There were a total of 213 discordant slides of which 107 slides were species misdiagnosed, 83 slides were false positive and 23 slides were a false negative. The number of discordant slides in all disagreement types was decreased with continued EQA implementation (see Table 2).
A total of 546 P. falciparum blood film slides were reported as P. falciparum whereas 36 P. falciparum blood film slides were read as P. vivax, mixed and negative. Seven hundred forty-eight (748) P. vivax blood film slides were reported as P. vivax correctly whereas 90 P. vivax blood film slides were read as P. falciparum, mixed and negative. A total of 1644 negative blood films were read as negative whereas 83 negative giemsa stained blood films were read as P. falciparum, P. vivax and mixed. Eight-five giemsa stained blood film slides were misdiagnosed as P. vivax which was the most frequent followed by 64 blood film slides were misdiagnosed as P. falciparum (see Table 3). The false positive rate was dramatically decreased in each malaria EQA rounds from 10.5 to 0.79%.
Immediate and long-term clinical, public health and health planning decisions for malaria control are based on laboratory test results. Incorrect delayed or misinterpreted tests can have serious consequences for patients and communities; undermine confidence in the service and waste scarce resources. Rechecking may detect malaria misdiagnosis in routine work and assess the overall quality of testing. This should not be considered a criticism of the person who performed the routine examination .
Prior to the implementation of external quality assessment program in the participated health facilities, training was provided on malaria microscopy and EQA for all laboratory personnel and all required reagents and equipment were supplied. On-site supervision was also conducted in accordance with the national EQA program three times a year, every 4 months by APHI . Each round of rechecking and assessment was followed by feedback in the form of a written report, showing details of incorrect results and offering suggestions for quality improvement. This evaluation showed that EQA participated health facilities were achieved remarkable improvements to provide accurate and reliable malaria microscopic diagnosis service. The average percent agreement of detection and species identification, between participated health facility and APHI, were improved from 93.88 to 99.24% and 92.67 to 97.35% respectively.
This finding was in line with the report from Pakistan that showed external quality assessment and supervision approach was found to be feasible and acceptable to improve the quality of malaria microscopy service . However, the overall agreement on detection of malaria parasite and identification of malaria species were higher than a study done in Hawassa, the southern part of Ethiopia, which showed 88 and 74.3% respectively. This variation could be due to assessment method difference that means our evaluation method was rechecking whereas their assessment method was proficiency testing .
Laboratories that reporting false positive results were lower in the last round of external quality assessment than in the previous three rounds. These findings were in agreement with the study conducted in the Democratic Republic of the Congo that the number of laboratories reporting false positive result was lower in the second assessment than the previous assessment . This indicates that supportive site visits offered an opportunity to assess the actual condition and skills practiced in the laboratory and provide problem-solving strategies, corrective action and onsite training based on the identified gaps and the previous assessment feedback. This made the laboratories to maintain and improve the good performance of malaria microscopy diagnosis.
In the present study, the overall discordant result was 6.76% which was higher than reported from Pakistan 0.5 to 1% discordant slides. The difference may be due to the extent of external quality assessment implementation program and there may be also a difference in assessment method .
The current evaluation showed high false positive rate in four consecutive external quality assessment rounds from 10.5 to 0.79%. This finding was in line with the report from Hawassa , Canada , UAS  that showed 6.9, 2, and 7.8% respectively. However, it is lower than a finding from Democratic Republic of Congo  that showed 24.6%. The variation could be due to different assessment methods. These false positive results suggest that laboratory personnel often incorrectly report the presence of parasites; this could lead to unnecessary treatment or a delayed diagnosis of the true cause of illness and distract the clinician from considering other causes of fever and disease.
An accurate, correct laboratory diagnosis is essential as false negatives can result in untreated malaria patients and potentially severe consequences, including death. False negatives can also significantly undermine both clinical confidences in laboratory results and credibility in the community. False positive results are equally problematic. Patients presenting with fever not caused by malaria may be misdiagnosed and the true cause of their fever not treated. This can also have severe consequences, including the death of the patient. In addition, misdiagnosis of malaria will result in the unnecessary prescription of high-cost drugs and the unnecessary exposure of the patient to potentially toxic drugs. This is a needless burden to both the patient and the medical services .
The health facilities achieved remarkable improvements in quality service after participation in malaria external quality assessment program. The average percent agreement was 96.6% from the collected slides in four EQA rounds and the percent agreement became improved in each consecutive round and had a very good agreement (99.24%) with 0.79% false positive rate, 0.74% false negative rate and 97.35% agreement in species identification for P. falciparum at fourth round. Therefore, we recommend that to maintain and expand malaria external quality assessment program in the region to assure quality malaria microscopy service.
Due to inconsistent record management, the study could not evaluate the performance of health facilities regarding the quality of blood film preparation and staining procedures. It did not also assess associated factors for discordant results.
external quality assessment
World Health Organization. World Malaria Report 2016. Licence: CC BY-NC-SA 3.0 IGO. Geneva: World Health Organization.
Federal Democratic Republic of Ethiopia Minister of Health. National malaria strategic plan 2014–2020. Addis Ababa: 2014.
Ethiopian Health and Nutrition Research Institute Ethiopian Federal Ministry of Health. Manual for the laboratory diagnosis of malaria, First Edition. Ethiopian Health and Nutrition Research Institute Ethiopian Federal Ministry of Health; 2012.
Fantahun B, Yeshambel B, Jemal A, et al. Does the practice of blood film microscopy for detection and quantification of malaria parasites in northwest Ethiopia fit the standard? BMC Health Serv Res. 2014;14:529.
World Health Organization. Malaria microscopy quality assurance manual. Version 1. World Health Organization; 2009.
Ethiopian Health and Nutrition Research Institute Federal Ministry of Health. Malaria laboratory diagnosis external quality assessment scheme guideline; 2009.
Muhammad AK, John DW, Muhammad A, et al. Munir District level external quality assurance (EQA) of malaria microscopy in Pakistan: pilot implementation and feasibility. Malaria J. 2011;10:45.
Pierre M, Philippe G, Albert L, et al. External quality assessment of giemsa-stained blood film microscopy for the diagnosis of malaria and sleeping sickness in the Democratic Republic of the Congo. Bull World Health Organ. 2013;91:441–8.
Amhara Regional Health Bureau. Regional malaria Annual Report. Bahir Dar: Ethiopia; 2013.
Ayalew F, Tilahun B, Taye B. Performance evaluation of laboratory professionals on malaria microscopy in Hawassa Town, Southern Ethiopia. BMC Research Notes. 2014;7:839.
Thomson S, Lohmann RC, Crawford L, et al. External quality assessment in the examination of blood films for malarial parasites within Ontario, Canada. Arch Pathol Lab Med. 2000;124:57–60.
Edson ED, Glick T, Massey L. Detection and identification of malaria parasite: a review of proficiency test results and laboratory practice. Lab Med. 2010;41(12):719–23.
Mukadi P, Gillet P, Lukuka A, et al. External quality assessment of malaria microscopy in the Democratic Republic of Congo. Malaria J. 2011;10:308.
HAH being the Principal Investigator contributed to proposal write-up, study design, data analysis, interpretation of results and write-up, MBS being the-Principal Investigator contributed to data analysis, interpretation of results and write-up, LD, and MMD, had contributed in monitoring and supervision, data analysis and write-up, ZDG, MAE and MWL, had contributed to data collection, data analysis and write-up. All authors read and approved the manuscript.
The authors would like to acknowledge staffs in Amhara Public Health Institute and health centers involved in this study for kind cooperation and support during blood film slide collection process. We also appreciate the active support of the ICAP-Ethiopia for blood film slide collection of malaria external quality assessment.
The authors declare that they have no competing interests.
Availability of data and materials
All data generated or analyzed during this study are included in this published article.
Consent for publication
Ethics approval and consent to participate
Before the start of the study, ethical approval has got from the Amhara Regional Health Bureau Ethical Review Committee. Official permission was also obtained from each participated health centers. The result was kept confidentially and communicated to Amhara Public Health Institute.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.