Skip to main content
Download PDF

Applicability of commercial clinical chemistry test kits for horse serum

BMC Research Notes volume 14, Article number: 13 (2021) Cite this article

Abstract

Objective

Validation of a test method is critical for confirming that the test can generate accurate and precise data. Although commercial biochemical test kits exist there are no specific and validated commercial clinical chemistry test kits designed for horses. The aim of this study was to validate commercial clinical chemistry test kits designed for a human serum for use in horses.

Results

Blood samples were collected from 29 apparently healthy adult male horses and pooled serum was prepared. Validation comprises replication and recovery experiments. Total observable error (TEo), sigma (σ) metrics, and quality goal index (QGI) were used to support the validation studies. Intra- and inter-assay variability was 2.05% and 2.08%, 2.26% and 1.89%, 2.4% and 1.63%, for total cholesterol, urea and total protein, respectively; recovery was 99.46%, 97.32%, and 100.1% for total cholesterol, urea and total protein, respectively. TEo% for the specified analytes was within the total allowable error (TEa). All three analytes satisfied the recommended requirement (> 3σ). The QGI for urea, as it had below 6σ was 0.95 indicating imprecision and inaccuracy. The results endorse the suitability of the studied commercial test kits and illustrated the acceptance criteria for horse’s serum.

Introduction

Clinical laboratory plays a fundamental role in disease diagnosis, assessment of risk for a disease, monitoring to therapy and/or progression of the disease by providing timely data for patient management and disease surveillance [1]. One area in this regard is clinical chemistry laboratory and becomes popular in veterinary medicine [2]. It is indispensable that veterinary clinical laboratories must achieve accurate and precise test results. Clinical laboratory tests performed using an automated clinical chemistry instruments involves calibrators, controls, and reagents [3]. Ensuring the consistency of clinical chemistry laboratory test result is vital to maintain that testing is done right and produces accurate results [4].

Quality in health care has an immense impact on patient management as approximately 80% of all diagnosis is made on the basis of laboratory test results [5]. Method validation is one of the important quality mechanisms that are designed to ensure the generation of scientifically valid and useful analytical data [6]. Though all commercial clinical chemistry test kits are validated for their use in medical laboratories, they are also commonly used in veterinary clinical laboratories [7]. It is imperative to conduct partial validation studies, independent of the manufacturer’s claim. Partial validation should be made to confirm the analytical procedure is fit for its intended purpose to be eligible for use under actual settings [8]. According to the European Medicines Agency (EMA) guideline on bioanalytical method validation, commercial kits need to be revalidated to ensure that the sample analysis is performed accurately and precisely. Furthermore, a change of biological matrix or species is a reason to perform a partial validation, which can range from the determination of the within-run precision and accuracy to an almost full validation [9]. Validation is a pre-requisite to perform sample analysis and also key to satisfy regulatory requirements [10].

Clinical chemistry tests are often used for the measurement of analytes in serum and other body fluids. However, the quality of clinical chemistry tests may introduce systematic and random errors. This calls the need for validation of clinical laboratory tests, regardless of its use in diagnostic or research industry [11]. Therefore the aim of the study is to validate commercially available selected clinical chemistry in vitro diagnostic kits: urea, total protein, and total cholesterol designed for a human serum for use in horse serum. The research was the first partial validation study of clinical chemistry test kits in the veterinary clinical laboratory environment. Healthcare professionals and academia in Ethiopia and elsewhere will benefit at large from the findings.

Main text

Methods

Study design

The Study design was developed using the American Society of Veterinary Clinical Pathology (ASVCP) guidelines: allowable total error guidelines for biochemistry [11]. Total allowable error (TEa) for biochemical analytes was indicated in the guideline. Sample collection and animal use were approved by the institutional animal research ethics review committee at the Addis Ababa university, College of veterinary medicine and agriculture (Certificate reference no VM/ERC/09/01/12/2020).

Study animals and sampling technique

The World Organization for Animal Health (OIE) guideline 3.6.6 selection and use of reference samples and panels recommended minimum of 5 samples to prepare serum pool [12]. In addition to computing a statistically valid number of samples as suggested by Bayes Success-Run Theorem for validation studies 95% confidence and 90% reliability used. Therefore n = 28.4. We used 29 samples for the study [13]. The study animals were an adult male horse of age (≥ 4.5 years) and whose body condition score 3 were recruited by convenient sampling technique at society for the protection of animals abroad (SPANA) Ethiopia clinic. Apparently healthy horses from owners who were consent after being informed about the purpose of the study were physically examined. Horses with a history of medication excluded due to the possible impact of drugs on analysis.

Blood collection and processing

Blood samples from study animals were collected by a veterinarian from the jugular vein using the standard operating procedure. The blood was allowed to clot at room temperature for between 30 min and serum was separated from the red blood cells by centrifugation at 1200×g for 10 min at 4 °C. Serum was immediately transferred to polypropylene tubes (Eppendorf Safe-Lock tubes) and stored at − 20 °C until measurements. Samples were collected during two weeks in January 2020. Pooled serum samples were created by mixing equal volumes of individual serum then homogenized using an agitator for 10 min at 180 rpm. After homogenization aliquots of the homogeneous pool were divided into twenty portions to avoid the effect of repeated thawing and freezing.

Analytical validation

To examine the accuracy and precision of commercial clinical chemistry kits (JOURILABS diagnostics reagents and stains-Addis Ababa, Ethiopia) total cholesterol, urea, and total protein were used and analysis of the parameters was determined by the methods/techniques described as follows: urea by kinetic urease/GLDH (Glutamate dehydrogenase), total protein by biuret and total cholesterol by CHOD-PAP (cholesterol peroxidase4-aminophenazone). The procedure of validation was adopted from the Westgard JO method validation protocol. The analytical validation comprises recovery studies for accuracy and replication experiments for precision [14]. The tests were performed on semi-automated chemistry analyzer (EMP-168 biochemical analyzer Chengdu Empsun Medical Technology Co., Ltd. China).

Replication experiments

Precision was assessed by evaluating the intra- and inter-assay variability using the pooled serum. Intra-assay variability (repeatability) was determined by measuring total cholesterol, urea, and total protein in the same sample 20 times sequentially within a single run. Inter-assay variability (reproducibility) was determined by analysing the same sample in duplicate for 20 consecutive days. To avoid the effect of repeated thawing and freezing, the samples used for the determination of inter-assay were aliquot and stored at − 20 °C until use [15].

Recovery experiments

The spike and recovery (SAR) assessment is essential for the analysis and accuracy evaluation of the method for particular sample types. Spike and recovery assay is used to determine whether the detection of an analyte is affected by biological sample matrix and differences in the standard curve diluent [16, 17]. Serum samples were spiked with different concentrations of standard Total cholesterol (26 mg/dl; 0.1 ml of 200 mg/dl standard solution was spiked in 1 ml serum) Urea (9.1 mg/dl; 0.1 ml of 100 mg/dl standard solution was spiked in 1 ml serum) and total protein (1.1 mg/dl; 0.1 ml of 12 mg/dl standard solution was spiked in 1 ml serum).

Quality requirement

Total allowable error (TEa)

The performance of tests was assessed by computing TEobs (%) and σ values. TEobs (%) = 2 × CV + bias (%), Bias (%) = [(target − measured) ÷ target] × 100%, where “target” is the spiked value for analyte and “measured” is the measured analyte concentration. The CV and bias (%) values from inter-assay were used to calculate TEobs (%). If TEobs (%) is less than TEa (%); the quality requirement passes and no further action needed. The TEa (%) employed in this study was total cholesterol: 20%, Urea: 12% and total protein: 10% adopted from the American society of veterinary clinical pathology (ASVCP) guidelines: allowable total error guidelines for biochemistry [11].

Sigma metrics (σ)

Sigma value (σ) calculated as σ = [TEa (%) − Bias (%)] ÷ CV. The interpretations of the σ values are > 2: Poor, > 3: Marginal, > 4: Good, > 5: Excellent, and > 6: World-class. Acceptable performance of a method is declared if TEobs < TEa [18, 19].

Quality goal index ratio (QGI)

QGI describes the extent to which both precision and bias meet their respective quality. This is used to find the reasons for the lower σ in analytes whether the problem is due to imprecision or inaccuracy or both. QGI ratio calculated as QGI = Bias/1.5 × CV %. The interpretations of the QGI with low σ values (< 6) are QGI < 0.8 shows imprecision, QGI 0.8–1.2 shows both imprecision and inaccuracy and QGI > 1.2 depicts inaccuracy [20].

Data analysis

Statistical analyses were performed using IBM SPSS 20. The normality distribution of the data was tested using the Kolmogorov–Smirnov test prior to statistical analysis. Data of accuracy from bias and precision from intra-assay and inter-assay CVs were estimated using routine descriptive statistical procedures.

Results

The present study validated total cholesterol, urea, and total protein test kits using pooled serum collected from 29 apparently healthy horses. Intra-assay precision was done by repeated measurements of pooled serum under specific and identical conditions on the same day. For inter-assay repeatability, the pooled serum was frozen in separate vials at − 20 °C, thawed at room temperature, and assayed on 20 consecutive days. The data generated was calculated in terms of mean SD and CV is presented in Table 1.

Table 1 Precision of the pooled serum for total cholesterol, urea and total protein
Full size table

To assess accuracy, a recovery method based on standard addition was used to evaluate the ability of the assay to recover the amount of analyte added to baseline pooled serum. The baseline pooled serum was obtained by the dilution of pooled serum with distilled water. While the spiking was done by the addition of standard solutions to pooled serum then both diluted and spiked pooled serum was assayed on 5 replicates and the average value is depicted in Table 2.

Table 2 Recovery for the pooled serum for total cholesterol, urea and total protein
Full size table

The TEo was expresses by combining random error (% CV) from the precision and systematic error (bias) from the accuracy estimation. The TEo for the specified analytes was within the TEa indicated in ASVCP guidelines (Table 3). The quality of testing also assessed by sigma metrics and all analytes satisfied the recommended requirement (> 3 sigma values). Total cholesterol and total protein showed > 6σ zone (world-class quality) while urea showed 4.9σ (Good class quality). The QGI for urea, as it had below 6σ was 0.95 falling in the range of 0.8–1.2 shows both imprecision and inaccuracy (Table 3).

Table 3 The sigma metrics and quality goal index ratio for Total cholesterol, Urea, and Total Protein
Full size table

Discussion

This study was undertaken to determine whether commercial clinical chemistry test kits are applicable to test analytes in horse serum. There are few studies on the validation of commercial kits and this study is the first in a veterinary laboratory environment in Ethiopia. Our study focused on the recovery and repeatability experiments which then followed by calculating sigma values and quality goal index for three analytes namely total cholesterol, urea, and total protein in horse serum.

According to the findings of the study for the intra-assay and inter-assay precision to be accepted, SD must not exceed 0.25 × TEa and 0.33 × TEa respectively for the given analyte [15, 21]. In this regard intra-assay and inter-assay precision for total cholesterol demonstrated < 5% and < 6.6%, urea < 3% and 3.96%, total protein < 2.5% and < 3.3%. The precision profile representing the %CV is within the established acceptance criteria.

The findings of recovery percentages were between expected values and measured values demonstrate that all tests were within the acceptance range of 80–120% [22, 23]. Besides the error observed was less than the allowable error assigned for the analytes [11]. Quality index ratios for total cholesterol and protein indicate no problem in terms of accuracy and precision  while in case of urea the root cause for impression and inaccuracy should be investigated before it routinely used as the quality of the test in such cases cannot be assured [24, 25].

Conclusion

Validation of the bioanalytical methods should be an integral part in laboratory management and health care. Commercial clinical chemistry test kits are often validated by the manufacturers. There is a need to verify the validity of the test kits before applying to diagnostic and research purposes particularly when the sample matrix is different. The study demonstrated that the commercial kits used in the study satisfied the acceptable criteria and recommended its use for horse serum. However, a full validation study of the clinical chemistry test kits for their fitness in a number of laboratories and clinical decision limit is recommended.

Limitations

  • The study was unable to conduct comparison studies due to financial constraints.

  • The study was unable to conduct validation on high and low concentration due to the unavailability of materials.

  • The study was limited to conduct on male horse.

Availability of data and materials

The data used to support this study are available from the corresponding author on request.

Abbreviations

AAU:

Addis Ababa University

ASVCP:

American Society of Veterinary Clinical Pathology

CV:

Coefficient of variation

EMA:

European Medicines Agency

OIE:

World Organisation for Animal Health

QGI:

Quality goal index

SAR:

Spike and recovery

SD:

Standard deviation

SPANA:

Society for Protection of Animal’s Abroad

TEa :

Total allowable error

TEo :

Total observed error

References

  1. WHO Regional Committee for Africa Resolution AFR/RC58/R2: strengthening public health laboratories in the WHO African region: a critical need for disease control. In: WHO Regional Committee for Africa. Final Report: 58th Session of the WHO Regional Committee for Africa. WHO Regional Office for Africa, Brazzaville 2008; p. 11–13.

  2. Rishniw Mark, Pion Paul D, Maher Tammy. The quality of veterinary in-clinic and reference laboratory biochemical testing. Vet Clin Pathol. 2012;41(1):92–109.

    PubMed  Google Scholar 

  3. Cho MC, Kim SY, Jeong TD, Lee W, Chun S, Min WK. Statistical validation of reagent lot change in the clinical chemistry laboratory can confer insights on good clinical laboratory practice. Ann Clin Biochem. 2014;51(6):688–94.

    Article  PubMed  Google Scholar 

  4. Miller WG, Erek A, Cunningham TD, Oladipo O, Scott MG, Johnson RE. Commutability limitations influence quality control results with different reagent lots. Clin Chem. 2011;57(1):76–83.

    Article  CAS  PubMed  Google Scholar 

  5. Agarwal R, Chaturvedi S, Chhillar N, Goyal R, Pant I, Tripathi CB. Role of intervention on laboratory performance: evaluation of quality indicators in a Tertiary Care Hospital. Indian J Clin Biochem. 2012;27:61–8.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Thompson M, Ellison SLR, Wood R. Harmonized guidelines for single-laboratory validation of methods of analysis. IUPAC technical report. Pure Appl Chem. 2002;74(5):835–55.

    Article  CAS  Google Scholar 

  7. Pasciu V, Baralla E, Nieddu Maria, Succu S, Porcu C, Leoni GG, Sechi P, Bomboi GC, Berlinguer F. Commercial human kits’ applicability for the determination of biochemical parameters in sheep plasma. J Vet Med Sci. 2019;81(2):294–7.

    Article  CAS  PubMed  Google Scholar 

  8. Guidance for industry bioanalytical method validation U.S. Department of Health and Human Services food and drug administration centre for drug evaluation and research (CDER) Center for Veterinary medicine (CVM). 2001. http://academy.gmp-compliance.org/guidemgr/files/4252FNL.PDF. Accessed 14 Dec 2020.

  9. EMA Guideline on Bioanalytical Method Validation 2011. https://www.ema.europa.eu/en/documents/scientific-guideline/guideline-bioanalytical-method-validation_en.pdf. Accessed 14 Dec 2020.

  10. Mano Y. Method validation studies and an inter-laboratory cross validation study of lenvatinib assay in human plasma using LC-MS/MS. Pract Lab Med. 2018;12:e00103.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Harr KE, Flatland B, Nabity M, Freeman KP. ASVCP guidelines: allowable total error guidelines for biochemistry. Vet Clin Pathol. 2013;42(4):424–36.

    Article  PubMed  Google Scholar 

  12. OIE Validation Guidelines 2014 [Internet] Selection and use of reference samples and panels. https://www.oie.int/fileadmin/Home/eng/Health_standards/aahm/current/GUIDELINE_3.6.6_REFERENCE_SAMPLES.pdf. Accessed 14 Dec 2020.

  13. Ferryanto L. Statistical sampling plan for design verification & validation of medical devices. J Valid Tech. 2015;21(1):1–9.

    Google Scholar 

  14. Westgard JO. Method validation-the experimental plan. In: Westgard JO, editor. Basic Method Validation. 3rd ed. Madison: Westgard QC, Inc; 2008. p. 61–9.

    Google Scholar 

  15. Westgard JO. Method validation-the replication experiment. In: Westgard JO, editor. Basic Method Validation. 3rd ed. Madison: Westgard QC, Inc; 2008. p. 114–22.

    Google Scholar 

  16. Lee JW. Fit-for-purpose method development and validation for successful biomarker measurement. Phram Res. 2006;23(2):312–28.

    Article  CAS  Google Scholar 

  17. Westgard JO. Method validation-the interference and recovery experiments. In: Westgard JO, editor. Basic Method Validation. 3rd ed. Madison: Westgard QC, Inc; 2008. p. 154–66.

    Google Scholar 

  18. Nevalainen D, Berte L, Kraft C, Leigh E, Picaso L, Morgan T. Evaluating laboratory performance on quality indicators with the six sigma scale. Arch Pathol Lab Med. 2000;124(4):516–9.

    CAS  PubMed  Google Scholar 

  19. Westgard JO. A method evaluation decision chart (MEDx chart) for judging method performance. Clin Lab Sci. 1995;8:277–83.

    CAS  PubMed  Google Scholar 

  20. Westgard JO, Westgard SA. An assessment of σ metrics for analytic quality using performance data from proficiency testing surveys and the CLIA criteria for acceptable performance. J Vet Diagn Invest. 2008;20:536–44.

    Article  Google Scholar 

  21. Daniel W, Anders K, John W, Jan S, Kristen M. Evaluation of precision performance of quantitative measurement methods; Approved guideline. NCCLS Document EP5-A2. 2004;24(25):7–13.

    Google Scholar 

  22. Andreasson U, Perret-Liaudet A, van van Waalwijk Doorn LJC, Blennow K, Chiasserini D, Engelborghs S, Fladby T, Genc S, Kruse N, Kuiperij HB, Kulic L, Lewczuk P, Mollenhauer B, Mroczko B, Parnetti L, Vanmechelen E, Verbeek MM, Winblad B, Zetterberg H, Koel-Simmelink M, Teunissen CE. A practical guide to immunoassay method validation. Front Neurol. 2015;19(6):179.

    Google Scholar 

  23. Valentin MA, Ma S, Zhao A, Legay F, Avrameas A. Validation of immunoassay for protein biomarkers: bioanalytical study plan implementation to support pre-clinical and clinical studies. J Pharm Biomed Anal. 2011;55(5):869–77.

    Article  CAS  PubMed  Google Scholar 

  24. Westgard JO. Six sigma quality design and control. 2nd ed. Madison: Westgard QC Inc.; 2006.

    Google Scholar 

  25. Westgard JO, Westgard SA. The quality of laboratory testing today an assessment of sigma metrics for analytic quality using performance data from proficiency testing surveys and the CLIA Criteria for Acceptable Performance. J Clin Pathol. 2006;125:343–4.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge Mr. Tibebu Ashine (B.Sc., MPH) and Dr. Hana Zewdu (DVM, M.Sc.) staffs of SPANA-Ethiopia for their cooperation during sample collection. Corresponding author also acknowledges Dr. Bineyam Taye (B.Sc., MPH, Ph.D., Associate Professor at Colgate University, NY, USA) who stirred the topic of method validation during graduate studies at AAU.

Funding

This research was supported by the Addis Ababa University (AAU) research and technology transfer office through adaptive problem solving research fund (Reference No: RD/LT/PY-034/2019, Dated 26-November-2019). AAU covers all expenses and played administrative role during procurement of items used in research.

Author information

Authors and Affiliations

  1. Department of Biomedical Sciences, College of Veterinary Medicine and Agriculture, Addis Ababa University, Addis Ababa, Ethiopia

    Yoseph Cherinet Megerssa, Fikru Regassa Gari & Fanos Tadesse Woldemariyam

  2. Department of Biosystems, Division of Animal and Human Health Engineering, Laboratory of Host–Pathogen interaction, KU Leuven, Leuven, Belgium

    Fanos Tadesse Woldemariyam

Authors
  1. Yoseph Cherinet Megerssa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fikru Regassa Gari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fanos Tadesse Woldemariyam
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YC conceived and design the study, responsible for data integrity, analysis, and interpretation. YC, FR, and FT drafted and revised the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Yoseph Cherinet Megerssa.

Ethics declarations

Ethics approval and consent to participate

The study obtained research ethical clearance approved by the institutional animal research ethics committee at the Addis Ababa University, College of veterinary medicine and agriculture (Certificate Reference No VM/ERC/09/01/12/2020).

Consent to publish

Not applicable.

Competing interests

The authors declare that no competing interests to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Megerssa, Y.C., Gari, F.R. & Woldemariyam, F.T. Applicability of commercial clinical chemistry test kits for horse serum. BMC Res Notes 14, 13 (2021). https://doi.org/10.1186/s13104-020-05434-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13104-020-05434-2

Keywords

BMC Research Notes

ISSN: 1756-0500

Contact us