Skip to main content

Antimicrobial stewardship effectiveness on rationalizing the use of last line of antibiotics in a short period with limited human resources: a single centre cohort study

Abstract

Objective

Antibiotics reserve (ARs) are given as a last line of treatment when other antibiotics are no longer effective. Rising threat of antimicrobial resistance makes growing use of ARs a real problem to patient safety. A single centre interventional cohort study was conducted in order to measure impact on clinical outcomes of A-team programme with limited human resources in a short period. A-team programme started on 01. September 2017.

Results

In 3 months preintervention and 3 months intervention period, from 3038 and 3156 hospitalized adult patients, 249 (59% of them were male, median age = 69 years) and 96 (51% of them were male, median age = 70 years) received parenteral ARs. Total duration of hospitalization of patients on AR was reduced from 28 to 17 days of hospitalization on 100 patient-days (OR = 1.92; 95% CI 1.83–2.01; p < 0.001) with no statistical significant difference in rehospitalisation due to infection of patients that were treated with ARs within 2 months after discharge. Despite short period of time and limited human resources, A-team restrictive interventions rationalised parenteral AR use and led to positive impact on clinical outcomes. These results could help our and other A-teams in similar situation in continuing with the programme to bring more evidence.

Introduction

With estimated 10 million deaths until 2050, antimicrobial resistance (AMR) will reach the first place of main cause of deaths, before deaths from carcinoma or diabetes [1]. In addition to slow development of new antimicrobial drugs, these led to creation of list of priority pathogens by World Health Organization (WHO) to support research of new and effective drugs [2]. Moreover, to preserve existing antibiotics, WHO also updated their Essential Medicines List for antibiotics, and designated all drugs into access (first line choice), watch and reserve (last line antibiotics). Antibiotic reserves (ARs) should be given as the last line of treatment when other antibiotics no longer work [2]. ARs are useful for a wide range of infections but, because of need to reduce the risk of development of resistance and its relatively high cost, it would be inappropriate to recommend their unrestricted use [3]. Despite this, their use and resistance are increasing worldwide [4,5,6,7]. As a result, importance of antimicrobial stewardship teams (A-team) has never been more substantial [8,9,10].

A cost–benefit analysis showed that maintaining A-team leads to improvements in quality and cost of care with positive clinical outcomes (i.e. by assuring appropriate treatment), compared with standard of care [11]. Additionally, effect of AMR policies seems to be variable. Absence of progress is partly due to insufficient evidence base to inform policymakers about effectiveness, generalizability, and cost-effectiveness of initiatives [12]. Despite evidence of benefits of A-team implementation, it has still not been recognized and applied in Croatia. Some reasons: not enough infectious disease (ID) specialists or incorporated clinical microbiologists in majority of hospitals or no clinical pharmacists included in clinical medicine.

In this study, we aimed to determine whether implementation and multidisciplinary approach of A-team, in a short period of time, compared with period without A-team, would rationalize number of patients on parenteral AR, without negatively affecting clinical outcomes in acute secondary care public hospital with before mentioned obstacles. Achieving the goal could make A-team to continue with the programme and serve as example for other hospitals and countries with limited human resources.

Main text

Methods

Study design and setting

This was a single-centred cohort before and after study. The study was performed in 325 adult-bed acute secondary care general hospital “Dr. Tomislav Bardek” Koprivnica, Croatia, across all adult wards which covers area with 115 584 inhabitants [13]. Included were all hospitalized patients receiving parenteral ARs which were actively used in hospital and were on basic medical reimbursement list of Croatian health insurance fund (piperacillin/tazobactam, ceftazidime, ceftriaxone, cefepime, meropenem, ertapenem, amikacin, vancomycin and colistin (polymyxin E) as well as ciprofloxacin due to evidence of growing resistance [14, 15]. Chosen were two periods of 3 months (preintervention period from 01. May 2017 to 31. July 2017 and intervention period from 01. September 2017 to 30. November 2017). The A-team intervention started on 01. September 2017.

A-team consisted of multidisciplinary specialists such as 1 FTE ID specialist, 0.5 FTE clinical microbiologist and 0.5 FTE clinical pharmacist who cooperated on daily basis except after working hours, on weekends and holidays. One FTE is defined as full time equivalent of eight working hours from Monday to Friday. Outside that time, an attending physician (a specialist) could prescribe AR, which was reviewed on the first working day by A-team. In that way, there was no delay in the start of antibiotic treatment.

Criteria proposed by Centre for Disease Control and Prevention for appropriate use of antibiotics in hospital settings were described in Standard operative procedure and followed [16, 17].

Type and target of the intervention

We chose restrictive intervention due to evidence of more significant immediate effect on prescribing than education and persuasion interventions [18]. It included: a review of medical record by A-team, an interpretation of laboratory susceptibilities from clinical microbiologist, prior audit of ID specialist (bedside consultation) with validation and authorization of prescriptions by clinical pharmacist. The criteria for prescribing AR were: patients with symptoms that were significant or severe (with median definition of fever ≥ 37.5 °C [19]), high risk of complications or the infection is not resolving. This recommendation was communicated to treating physicians, but final commitment of implementing clinical decisions was the responsibility of the treating team. A recommendation was also documented in the medical record.

Inclusion and exclusion criteria

All adult inpatients who received parenteral AR were included in the study. Exclusion criteria were patients already under the care of ID physician, being treated in preintervention period or paediatric patients.

Assessment of the outcomes

Primary outcomes were number, proportion of patients with ARs prescribed and total duration of hospitalization of patients on ARs per 100 patient days. The number of rehospitalized patients due to infection which were previously treated with AR in 1st, 2nd and 3rd month after discharge was also investigated. Diagnoses for the infection were following according to WHO International Statistical Classification of Diseases and Related Health Problems ICD-10 descriptive codes (ICD) [20]: diseases of respiratory system (J00-J99) and certain infectious and parasitic diseases (A00-B99). Empirical usage and therapeutic medication were not distinguished in this study. Data were collected monthly from hospital computer system.

Secondary outcomes were the duration of treatment with AR prescribed per 100 patient days. Demographic information (age, gender, main ICD at hospital admission, presence of fever, comorbidities and admitted ward) was obtained to assess risk factors for starting AR.

Preintervention period

Preintervention period consisted of prescribing ARs on AR computer ordered form in all adult wards. Physician authorized for prescribing AR filled AR form with basic information on patient and drug (patient′s name and date of birth, working diagnosis, name of AR and daily dosage). This authorization was sent in printed form to the hospital pharmacy. The pharmacist and an experienced pharmacy technician checked the validity and dispensed AR for 2 or 3 days of therapy. Every further prolongation of AR therapy required a new authorization by authorized physician and validation from a pharmacist. The pharmacist did not have access to medical record for further information (e.g., allergy).

Preintervention period targeted at the same ARs with the same criteria for prescribing and same primary and secondary outcomes but without A-team.

Statistical analysis

Patient characteristics in both periods were compared using Wilcoxon rank-sum test for continuous variables and Fisher exact test for binary categorical variables.

The number of rehospitalization due to infection after 1, 2 and 3 months of discharge were compared using Fisher exact test. Duration of hospitalization of patients on AR and average duration under AR treatment were compared using a Chi-squared test.

All p values only less than 0.05 were considered statistically significant. Statistical analysis was performed in R, version 3.4.4. [21].

Results

Patient characteristics

Baseline characteristics are shown in Table 1. There was no statistically significant difference between baseline characteristics of proportion of patients on ARs in both periods. Median ages of patients on AR were 69 and 70 years in preintervention and intervention period. Most patients on AR had fever and were admitted to Intensive care unit (ICU) with no statistical difference in comorbidities and main ICD diagnosis on admission in both periods.

Table 1 Characteristics of patients to whom were prescribed antibiotics reserves (ARs) in pre- and intervention period

Preintervention and intervention period

In preintervention period, printed forms for all 249 patients were validated and approved. During intervention, A-team evaluated 354 patients of which 96 (27%) consulted on ARs, while in majority (73%) of patients recommended other antibiotic (which was not AR). The acceptance rate was 100% for all evaluated patients.

Results on primary outcomes

Results are shown in Table 2. Duration of hospitalization of patients on AR in preintervention and intervention was 28 and 17 days of hospitalization on 100 patient-days (OR = 1.92; 95% CI 1.83–2.01; p < 0.001), respectively.

Table 2 Primary outcomes

Secondary outcomes

Duration of treatment with AR prescribed in preintervention and intervention periods were 11 and 4 days per 100 patient days (OR = 2.7; 95% CI 2.5–2.9; p < 0.001), respectively. There was no statistical difference in both periods for risk factors for starting AR which were: male patients, median age of 70 years, internal ward admission, fever, existing comorbidities, disease of the respiratory system or certain infectious and parasitic diseases.

Discussion

Despite limited human resources of A-team and a short period, this study showed a significant impact on clinical outcomes, focusing on parenteral ARs. Restrictive interventions helped to save last line antibiotics for their future use when they are really needed. The first A-team in Croatia, which consisted of ID specialist, clinical microbiologist and clinical pharmacist, demonstrated an immediate impact of their interventions. Example is reduction of duration of hospitalization of patients in intervention period by nearly 40% (from 28 to 17 days of hospitalization on 100 patient-days) with unaffected rehospitalizations. This brought highly needed evidence of positive effects of interventions on patient-centred outcomes [10, 22]. There was no statistical significance in rehospitalisation of patients on AR due to infection in first 2 months after discharge. However, in the 3rd month after discharge rehospitalisation was raised from 3 to 7% in intervention group which was statistically significant (p = 0.033). One of the reasons could be high risk of mortality due to comorbidity that made patients more vulnerable to influenza in influenza period that had the highest peak during January and February 2018 [23]. Winter was monitoring period for intervention group while preintervention group was followed in autumn period, therefore patients had better chance to stay out of hospital. Second argument could be piperacillin 4 g/tazobactam 0.5 g shortage due to production reasons in intervention period, but that needs further investigation [24].

Complete acceptance rate reflected agreement between A-team, treating physicians and their teams. In addition, this was also in accordance with final step of A-team intervention, which consisted of dispensing AR from hospital pharmacy only after validation from clinical pharmacist with access to medical record. Improving antimicrobial prescribing by clinical pharmacist is in correlation with previous studies and guidelines [25,26,27]. Multidisciplinary approach has proved to be beneficial in this study for understanding the A-team interventions and therefore accomplishing primary outcomes. Other studies have also proven importance of multidisciplinary approach but in other areas such as preoperative prophylaxis, broad-spectrum antibiotic consumption in various settings or timeliness of antimicrobial therapy in patients with positive blood cultures [28,29,30,31].

Risk factors for starting AR can be used in hospitals with resource limitation as a measure of estimation of patients that need special attention.

Furthermore, our aim correlates with WHO Global Action Plan on Antimicrobial Resistance to contain antibiotic resistance, optimize antibiotic treatment and to preserve 'last-resort' antibiotics [32].

This study suggests that A-team restrictive interventions focused on parenteral ARs are useful strategy in improving antimicrobial prescribing without compromising clinical outcomes. Moreover, we proved possibility of achieving our goals despite limited human resources and short period. In addition, results could serve as evidence for including clinical pharmacists in clinical medicine in Croatia. Our research demonstrated the best practice that could be transferred to other national and transnational institutions.

Limitations

Study was a single centre non-randomized study, which was the first limitation. However, it was difficult to blind investigators or participants in trial of antimicrobial stewardship. Second limitation was two periods of 3 months which were short to prove sustainability, but we demonstrated A-team programme's value by focusing on outcome measures. Third, A-team just focused on AR and not on other antibiotics, which should be investigated in future studies. Nonetheless, we wanted to investigate the effectiveness of A-team on a small but very important group of antibiotics that are costly and under restricted use. In addition, the aim was to show our positive results to managers who could give us more resources to broaden our interventions to other classes of antimicrobials. Finally, we did not investigate AMR due to too short period of follow up, but this is our plan for future.

The future research is needed with a larger multi-centred study, more extended period of intervention, follow up and feedback of A-team with particular emphasis on effectiveness of clinical pharmacy services.

Availability of data and materials

The data that support the findings of this study are available from general hospital “Dr. Tomislav Bardek” Koprivnica, Croatia but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of general hospital “Dr. Tomislav Bardek” Koprivnica, Croatia.

Abbreviations

A-team:

antimicrobial stewardship team

AMR:

antimicrobial resistance

AR:

antibiotic reserve

FTE:

full time equivalent

ICD:

International Statistical Classification of Diseases and Related Health Problems

ICU:

intensive care unit

ID:

infectious disease

WHO:

World Health Organization

References

  1. O’Neill J. Antimicrobial resistance: tackling a crisis for the health and wealth of nations. Rev Antimicrob Resist. 2014; p. 1–18. https://amr-review.org/sites/default/files/AMR%20Review%20Paper%20-%20Tackling%20a%20crisis%20for%20the%20health%20and%20wealth%20of%20nations_1.pdf. Accessed 5 Feb 2019.

  2. World Health Organization. Prioritization of pathogens to guide discovery, research and development of new antibiotics for drug-resistant bacterial infections, including tuberculosis. Geneva: World Health Organization; 2017. p. 1–88. https://www.who.int/medicines/areas/rational_use/PPLreport_2017_09_19.pdf. Accessed 5 Feb 2019.

  3. World Health Organization. Chapter 9. Reserve anti-infective agents. In: The use of essential drugs: ninth report of the WHO expert committee. Geneva: World Health Organization; 2000. p. 1–68. https://apps.who.int/iris/bitstream/handle/10665/42373/WHO_TRS_895.pdf;jsessionid=61A739599D18D39C99AA7AF582F92D34?sequence=1. Accessed 13 Aug 2017.

  4. Meletis G. Carbapenem resistance: an overview of the problem and future perspectives. Ther Adv Infect Dis. 2016;3(1):15–21.

    CAS  PubMed  PubMed Central  Google Scholar 

  5. Codjoe FS, Donkor ES. Carbapenem resistance: a review. Med Sci. 2018;6(1):1. https://doi.org/10.3390/medsci6010001.

    Article  CAS  Google Scholar 

  6. McGuinness WA, Malachowa N, DeLeo FR. Vancomycin Resistance in Staphylococcus aureus. Yale J Biol Med. 2017;90(2):269–81.

    CAS  PubMed  PubMed Central  Google Scholar 

  7. Ramirez MS, Tolmasky ME. Amikacin: uses, resistance, and prospects for inhibition. Molecules. 2017;22:2267. https://doi.org/10.3390/molecules22122267.

    Article  CAS  PubMed Central  Google Scholar 

  8. Oberjé EJM, Tanke MAC, Jeurissen PPT. Antimicrobial stewardship initiatives throughout Europe: proven value for money. Infect Dis Rep. 2017;9(1):6800. https://doi.org/10.4081/idr.2017.6800.

    Article  PubMed  PubMed Central  Google Scholar 

  9. European Centre for Disease Prevention and Control. Infographics about antibiotic stewardship programmes. https://antibiotic.ecdc.europa.eu/en/infographics-about-antibiotic-stewardship-programmes. Accessed 15 July 2019.

  10. Davey P, Marwick CA, Scott CL, Charani E, McNeil K, Brown E, et al. Interventions to improve antibiotic prescribing practices for hospital inpatients. Cochrane Database Syst Rev. 2017. https://doi.org/10.1002/14651858.CD003543.pub4.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Scheetz MH, Bolon MK, Postelnick M, Noskin GA, Lee TA. Cost-effectiveness analysis of an antimicrobial stewardship team on bloodstream infections: a probabilistic analysis. J Antimicrob Chemother. 2009;63(4):816–25. https://doi.org/10.1093/jac/dkp004.

    Article  CAS  PubMed  Google Scholar 

  12. Dar OA, Hasan R, Schlundt J, Harbarth S, Caleo G, Dar FK, et al. Exploring the evidence base for national and regional policy interventions to combat resistance. Lancet. 2016;387(10015):285–95. https://doi.org/10.1016/S0140-6736(15)00520-6.

    Article  PubMed  Google Scholar 

  13. Croatian Bureau of statistics. Population census 2011. Croatian Bureau of statistics, Zagreb; 2013. https://www.dzs.hr/Eng/censuses/census2011/results/htm/e01_01_03/e01_01_03.html. Accessed 15 Sept 2017.

  14. Hrvatski zavod za zdravstveno osiguranje. Objavljene liste lijekova. Osnovna lista lijekova; 2017. https://www.hzzo.hr/zdravstveni-sustav-rh/trazilica-za-lijekove-s-vazecih-lista/arhiva-liste-lijekova/. Accessed 6 Aug 2019.

  15. Fasugba O, Gardner A, Mitchell BG, Mnatzaganian G. Ciprofloxacin resistance in community- and hospital-acquired Escherichia coli urinary tract infections: a systematic review and meta-analysis of observational studies. BMC Infect Dis. 2015;15:545. https://doi.org/10.1186/s12879-015-1282-4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Centers for Disease Control and Prevention (CDC). Core elements of hospital antibiotic stewardship programs. Atlanta, GA: US Department of Health and Human Services, CDS; 2014. p. 1–24. https://www.cdc.gov/antibiotic-use/healthcare/pdfs/core-elements.pdf. Accessed 2 June 2017.

  17. Mađarić V. Upravljanje primjenom antimikrobnih lijekova u OB Koprivnica—antibiotic stewardship program. Standardni operativni postupak, Koprivnica, Croatia 2017. p 1–25. Internal document for Standard operative procedure in Croatian language: available upon request.

  18. Davey P, Brown E, Charani E, Fenelon L, Gould IM, Holmes A, et al. Interventions to improve antibiotic prescribing practices for hospital inpatients. Cochrane Database Syst Rev. 2013;30(4):CD003543. https://doi.org/10.1002/14651858.CD003543.pub3.

    Article  Google Scholar 

  19. Dinarello CA, Porat R. Fever. In: Kasper D, Fauci A, Hauser S, Longo D, Jameson J, Loscalzo J, Kasper D, et al. editors. Harrison’s principles of internal medicine, 19e. New York: McGraw-Hill; 2014. p. 23. https://accessmedicine.mhmedical.com/content.aspx?bookid=1130§ionid=79724479. Accessed 23 June 2017.

  20. World Health Organization. International statistical classification of diseases and related health problems—10th revision 2016 v.3, 5th edn, Geneva: World Health Organization; 2015.

    Google Scholar 

  21. Core Team. A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2018. https://www.r-project.org/. Accessed 18 Apr 2019.

  22. Filice G, Drekonja D, Greer N, Butler M, Wagner B, MacDonald R, et al. Antimicrobial stewardship programs in inpatient settings: a systematic review, Summary and discussion. Washington: Department of Veterans Affairs (US); 2013.

    Google Scholar 

  23. European Centre for Disease Prevention and Control. Flu News Europe: weekly influenza updates 2018. In collaboration with WHO Regional Office for Europe, ECDC monitors and reports on influenza activity in Europe on a weekly basis throughout the flu season. https://ecdc.europa.eu/en/seasonal-influenza/surveillance-and-disease-data/flu-news-europe. Accessed 29 Apr 2018.

  24. Agency for medical products and medical devices of Croatia. Shortages and disruption in the supply chain. Nestašice lijekova. https://www.halmed.hr/en/Promet-proizvodnja-i-inspekcija/Promet/Prekid-opskrbe-trzista-lijekom-i-nestasice/. Accessed 15 Mar 2018.

  25. Dubrovskaya Y, Scipione MR, Siegfried J, Jen SP, Pham V, Papadopoulos J, et al. Multilayer model of pharmacy participation in the antimicrobial stewardship program at a large academic medical center. Hosp Pharm. 2017;52(9):628–34. https://doi.org/10.1177/0018578717726993.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Gilchrist M, Wade P, Ashiru-Oredope D, Howard P, Sneddon J, Whitney L, Wickens H. Antimicrobial stewardship from policy to practice: experiences from UK antimicrobial pharmacists. Infect Dis Ther. 2015;4(Suppl 1):51–64. https://doi.org/10.1007/s40121-015-0080-z.

    Article  PubMed  PubMed Central  Google Scholar 

  27. De With K, Allerberger F, Amann S, Apfalter P, Brodt HR, Eckmanns T, et al. Strategies to enhance rational use of antibiotics in hospital: a guideline by the German society for infectious diseases. Infection. 2016;44:395–439. https://doi.org/10.1007/s15010-016-0885-z.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Paskovaty A, Pflomm JM, Myke N, Seo SK. A multidisciplinary approach to antimicrobial stewardship: evolution into the 21st century. Int J Antimicrob Agents. 2005;25(1):1–10. https://doi.org/10.1016/j.ijantimicag.2004.09.001.

    Article  CAS  PubMed  Google Scholar 

  29. Turner MC, Behrens SL, Webster W, Huslage K, Smith BA, Wrenn R, et al. Multidisciplinary approach to Clostridium difficile infection in adult surgical patients. J Am Coll Surg. 2019;228(4):570–80. https://doi.org/10.1016/j.jamcollsurg.2018.12.045.

    Article  PubMed  Google Scholar 

  30. Tang SJ, Gupta R, Lee JI, Majid AM, Patel P, Efird L, et al. Impact of hospitalist-led interdisciplinary antimicrobial stewardship interventions at an academic medical center. JtComm J Qual Patient Saf. 2019;45(3):207–16. https://doi.org/10.1016/j.jcjq.2018.09.002.

    Article  Google Scholar 

  31. Cairns Kelly A, Doyle Joseph S, Trevillyan Janine M, Horne Kylie, Stuart Rhonda L, et al. The impact of a multidisciplinary antimicrobial stewardship team on the timeliness of antimicrobial therapy in patients with positive blood cultures: a randomized controlled trial. J Antimicrobial Chemother. 2016;71(11):3276–83. https://doi.org/10.1093/jac/dkw285.

    Article  CAS  Google Scholar 

  32. World Health Organization. Global action plan on antimicrobial resistance. Geneva: World Health Organization; 2015. p. 1–28. https://www.wpro.who.int/entity/drug_resistance/resources/global_action_plan_eng.pdf. Accessed 17 Apr 2019.

Download references

Acknowledgements

We would like to thank all who supported the implementation of antimicrobial stewardship team in our hospital.

Funding

The author received no specific funding for this work.

Author information

Authors and Affiliations

Authors

Contributions

Each author (DKP, VM, VJP, DK, PH and SM) had substantial contributions to the conception or design of the work, analysis, interpretation of data, substantively revised it and have approved the submitted version (and any substantially modified version that involves the author's contribution to the study). All authors have agreed both to be personally accountable for the author's own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the authors were not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Darija Kuruc Poje.

Ethics declarations

Ethics approval and consent to participate

Approval from Ethics committee from hospital “Dr. Tomislav Bardek” Koprivnica was obtained with identification numbers: 053-02/18-01/33 and 2137-15-01-18-02. As prescribing AR and other antibiotics before and after implementation of A-team were considered as routine care, and because both interventions were associated with minimal risk to patients, the need for consent to participate was waived (according to The Patient Rights Protection Act, legislation number NN 169/04, 37/08). All participant information obtained during the study was kept confidential.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kuruc Poje, D., Mađarić, V., Janeš Poje, V. et al. Antimicrobial stewardship effectiveness on rationalizing the use of last line of antibiotics in a short period with limited human resources: a single centre cohort study. BMC Res Notes 12, 531 (2019). https://doi.org/10.1186/s13104-019-4572-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13104-019-4572-x

Keywords