Effect of autolysis on the specificity of bovine spongiform encephalopathy rapid tests
© Meloni et al; licensee BioMed Central Ltd. 2010
Received: 3 March 2010
Accepted: 14 July 2010
Published: 14 July 2010
Routine rapid testing for Bovine Spongiform Encephalopathy (BSE) has highlighted some problems with BSE rapid test performance, the most significant being the number of initially reactive samples and the false positive results on autolyzed tissue. This point is important for BSE active surveillance in risk populations, because tissue autolysis is often unavoidable in routine cases. A robust test suitable for use on field material is therefore needed. To date, very limited information regarding the effect of autolysis on the robustness of rapid tests has been documented; therefore, the National Reference Centre for Animal Encephalopathies (CEA) rapid test laboratory selected 450 autolyzed and negative brain stem samples from fallen stock bovines older than 24 months to assess the specificity of four tests approved for BSE active surveillance: Biorad TeSeE, Enfer TSE version 2.0, Prionics® Check LIA, and IDEXX Herd Check BSE Antigen Kit EIA. The samples were graded according to the degree of autolysis and then dissected into five portions, four of which randomly assigned to processing by rapid tests and one to be available for confirmatory Western blot analysis.
The specificity of the four systems was 100% for all three grades of autolysis, while the percentage of initially reactive results was 0.00 (95%CI 0.00-0.82), 0.22 (95%CI 0.006-1.23), 0.44 (95%CI 0.05-1.60), and 0.89 (95%CI 0.24-2.26) for the Biorad TeSeE, the Prionics® Check LIA, the IDEXX Herd Check BSE and the Enfer TSE tests, respectively. No association with the degree of autolysis could be drawn.
The present study demonstrates that the four rapid tests can be considered well-running diagnostic tools regardless of tissue quality; nevertheless, the number of initial reactive samples reported for some systems must not be underestimated in routine testing.
Furthermore the compliance with the reported performance can be guaranteed only when an ongoing high careful batch quality control system is in place.
Bovine spongiform encephalopathy (BSE), a fatal infectious neurodegenerative disease of cattle, is characterized by the concentration of an anomalous isoform of the natural prion protein (PrPc), denominated PrPres, in the central nervous system (CNS) [1, 2]. PrPres differs from PrPc in its high insolubility and partial protease resistance: these characteristics are exploited by the majority of the methods currently used for BSE diagnosis. Evidence for the origin of variant Creutzfeldt-Jakob Disease (vCJD) from BSE [3, 4] led the European Commission (EC) to strengthen control programs, introducing active surveillance by means of rapid tests to monitor the ruminant infection . Since 1999 the EC has assessed 19 rapid tests, 9 of which were approved for survey including a new version of the Enfer TSE test for BSE diagnosis .
In 1999 the EC carried out the first scientific evaluation of four new rapid post mortem BSE tests in which diagnostic accuracy and analytic sensitivity on brain tissue from clinically affected bovines was assessed . Subsequent EU validation exercises extended assessment parameters to include test robustness on autolyzed material as a fundamental criterion, simulating routine field diagnosis [8–10].
Active surveillance samples come primarily from slaughtered animals; for this target category the caudal brainstem is collected immediately after the animal's death and sent to the laboratory. But a fairly high percentage of samples (13.5% in 2007 in EU Member States ) come from fallen stock cattle; in Italy, some 90% of samples arrive at the laboratory in condition of autolysis, owing to the time between the animal's death and collectionof the sample.
Previous studies investigated the effect of autolytic changes on the detection of Scrapie-associated fibrils (SAF) [12, 13] and then on PrPres immunodetection by immunoblotting and immunohistochemistry [14–17]. The ability of some rapid test systems to correctly classify BSE autolyzed positive samples was also ascertained . The outcome of those studies was an undiminished sensitivity for PrPres detection for all diagnostic methods evaluated, even when applied to severely autolyzed tissues.
To date, there is a little reliable information  about the effect autolysis can have on rapid test performance for large-scale throughput samples in terms of number of initially reactive samples and false positive results. To fill this gap, we wanted to determine whether natural autolysis affected the performance of four rapid tests commonly used in the EU for mandatory surveillance of BSE (Prionics® Check-LIA Test, Enfer TSE Kit version 2.0, Bio-Rad TeSeE Test, IDEXX HerdChek BSE Antigen Test Kit EIA) on negative and autolyzed field samples.
A total of 450 autolyzed bovine brain stem samples (medulla oblongata at the level of the obex) from fallen stock animals older than 24 months, sent to the Rapid Test Laboratory of the National Reference Centre for TSE (CEA - National Reference Laboratory [NRL]) for BSE monitoring, were collected from June to September 2008 and assigned a progressive number.
■ Grade 1: reduced consistence, obex easily recognizable, absence of abnormal colours;
■ Grade 2: reduced consistence, obex not always recognizable, presence of abnormal colours;
■ Grade 3: liquid state, obex not recognizable, presence of abnormal colours.
Up to 150 samples were collected for each grade of autolysis.
■ Prionics® Check-LIA Test is a microplate-based immunoassay (ELISA) that uses monoclonal antibodies to detect proteinase K resistant PrPres (Test A);
■ Enfer TSE Kit version 2.0 automated sample preparation is a chemiluminescent ELISA test involving an extraction procedure and an ELISA technique that uses an enhanced chemiluminescent reagent (Test B);
■ Bio-Rad TeSeE Test uses a sandwich immunoassay technique to detect PrPres following denaturation and concentration steps (Test C);
■ IDEXX HerdChek BSE Antigen Test Kit EIA is an immunoassay that uses a chemical polymer for selective PrPres capture and a monoclonal detection antibody directed against the conserved regions of the PrP molecule (Test D);.
The fifth aliquot was stored to be available for confirmatory Western blot assay in case of positive results to the rapid tests.
For completely autolyzed samples in which the obex region was not identifiable, the aliquot was taken from the same tissue area.
The samples were analyzed according to CEA standard operating protocols based on the test manufacturer's instructions.
Percentage of initially reactive samples and specificity with relative confidence limits at 95% was calculated using STATA  software.
The samples were collected according to OIE Manual of Diagnostic Tests and Vaccines for Terrestrial Animals 2008  standard operating protocols in the frame of Regulation (EC) No 999/2001  dispositions.
Results and discussion
Number and percentage of initially reactive samples and specificity
(95% CI 0.00-2.43)*
(95% CI 0.00-2.43)*
(95% CI 0.00-2.43)*
(95% CI 0.00-0.82)
(95% CI 99.18-100)*
(95% CI 0.16%-4.73)
(95% CI 0.02-3.66)
(95% CI 0.02-3.66)
(95% CI 0.24-2.26)
(95% CI 99.18-100)*
Prionics Check LIA
(95% CI 0.02-3.66)
(95% CI 0.00-2.43)*
(95% CI 0.00-2.43)*
(95% CI 0.006-1.23)
(95% CI 99.18-100)*
IDEXX HerdChek BSE
(95% CI 0.00-2.43)*
(95% CI 0.00-2.43)*
(95% CI 0.16-4.73)
(95% CI 0.05-1.60)
(95% CI 99.18-100)*
In rapid test validation studies, the objective of field trials is to demonstrate that the performance of a new diagnostic system is not inferior to those already approved for active surveillance. For this purpose, the diagnostic sensitivity and specificity of a new rapid test and its robustness are evaluated in field trials carried out by national reference laboratories (NRL) which run a high volume of samples of heterogeneous quality in parallel with the test in use. All diagnostic tests produce false positives and false negatives, but the best keep both rates (error probabilities) to nearly zero. In the recent BSE scenario, in which the epidemic is reported on the decline in most countries, with only two cases detected in Italy in 2009, the specificity of the systems in use is crucial: false reports of new cases unnecessarily alarm public opinion and even a few false positives can greatly overstep the true positives a test will detect .
Field trials provide test manufacturers with a better opportunity to acquire practical experience and to develop the user manual final version. That said, the real robustness of a test emerges only when it is applied during routine testing, in different climatic conditions and on poor quality samples. For this purpose, we tested only naturally autolyzed samples as documented by previous studies (Wear et al., 2005) to better mimic routine field conditions.
According to Italian NRL data, some laboratories regularly obtain a large number of initially reactive results from poor-quality samples. This is why verifying the robustness of rapid tests on autolyzed samples becomes relevant for BSE surveillance and also for correcting potential technical problems.
The meaning of surveillance measures could be affected if rapid test performance is influenced by the autolysis state per se or because of the loss of neuroanatomy of the target area. In this connection, previous studies [15, 16] reported that while correct sampling is important, tissue quality appears to be a minor factor influencing false results of a test.
Here we show that all four rapid tests displayed 100% specificity even in the severely autolyzed samples. However, differences in test performance on initially reactive samples were noted, with test C resulting the best-performing system. For the other three tests, a direct link between the number of initially reactive routes and the degree of autolysis could not be highlighted either when initially reactives were taken as a whole or related to a specific test.
The test A underwent the field trial in 2002, but no initial reactivity on poor-quality samples was reported. Our results on this test are in accordance with those obtained in that frame, while a recent paper from Carra et all  on the evaluation of test A in routine monitoring activity reports a high prevalence of false positive results and frequencies of retested samples on fresh matrix and, with a higher percentage, on poor quality tissues. These data could be referred both to individual batch issues and/or local technical matters.
Nevertheless, it's worth to be considered that in the EFSA Scientific Opinion on Analytical sensitivity of approved TSE rapid tests of 2009  a striking rate of initial reactive results (100%) achieved on reference negative tissue samples prepared both according to the manufacturer protocol, both with the Central Reference Laboratory (CRL) for TSE of Weybridge protocol (water:tissue 50:50), is reported for test A. No repeat testing was done on initial reactives in the context of this TSE analytical sensitivity study. Therefore, analytical sensitivity of test A has been recently re-assessed by CRL for TSEs  on different sets of reference positive and control negative dilutions prepared according to the manufacturer protocol without having initial reactive results on negative samples. Nevertheless the causes of previous initial reactives remain unidentified. Such situations could highlight a major problem in the quality control system put in place by the manufacturer, causing a failure in the performances of single batches released for routine activity, independently from the condition of sample under investigation. As a matter of fact test A is the only one among the approved BSE rapid test still not undergoing the official batch testing system, in place since 2008 under the responsibility of NRLs  before the admittance within the EU market.
No initially reactive samples for either the tests B and D were shown in 2005 field trial. Our results regarding initial reactive samples by these tests as a whole can be compared to those obtained in EU field trial. The high number of autolyzed samples tested in this study can partially explain the apparent differences from the EU evaluation data, in which the number of autolytic samples tested was limited (200). This means that, during the EU field trials, the confidence interval at 95% (95% CI) for the number of initially reactive samples relative to 200 poor-quality samples tested equals 0% - 1.83%. The percentage of initially reactive samples in a worst-case scenario of our study would be 0.89% (4/450 for test D), which is compatible with the 95% CI of the EU field trial. Furthermore, as already reported for test A, local technical issues related to temperature and humidity can not be ignored. Finally, test C was evaluated as "CEA" test in 1999, but no evaluation of robustness was provided.
Initially reactive samples need to be retested, as expected with all test procedures, which leads to increased laboratory workload. Furthermore, samples producing false positive results at retesting can create false alarms and require time-consuming confirmatory testing. This, in turn, triggers a cascade of public health measures, including herd quarantine, animal transportation and slaughter prohibition and bans on commercialization of milk and by-products until the diagnostic result is confirmed by the NRL. In the meantime, an economically wasteful scare begins to spread across the market. To avert such situations, the screening purpose of rapid tests dictates that they perform equally well on autolyzed and good-quality samples alike.
In our study, the poor-quality tissues were still adequate for testing, highlighting that the robustness of the techniques are not compromised under adverse conditions of temperature and time between slaughter and testing. Nonetheless, the problem of initially reactive samples with regard to some diagnostic systems, must be strategically considered in laboratories with large workloads.
Other, it should be looked on that unresolved problems related to the quality control system applied during the manufacture of new test batches can severely affect the performances of rapid tests.
Sources and manufacturers
Prionics® Check LIA Test, Prionics AG, Wagistrasse 27a, CH-8952 Schlieren-Zurich, Switzerland.
Enfer TSE test, Enfer Scientific Limited Unit T, M7 Business Park Newhall, Naas, Co. Kildare, Ireland
Bio-Rad TeSeE, Bio-Rad, 3, Boulevard Raymond Poincaré, F-92430 Marnes la Coquette, France.
IDEXX Herd Check BSE Antigen Kit EIA, Idexx Laboratories Inc., Westbrook, ME, U.S.
This work was based on samples collected through active surveillance programme on bovine BSE funded by the EU and within CEA sources. This study was conducted and funded within the frame of Turin rapid test laboratory. We would like to thank Daniela Loprevite, Dolores Di Vietro, Luca Nocilla for the technical collaboration, and Rosanna Muià for her support.
- Prusiner SB: Molecular biology of prion diseases. Science. 1991, 252 (5012): 1515-22. 10.1126/science.1675487.PubMedView ArticleGoogle Scholar
- Collinge J: Human prion diseases and bovine spongiform encephalopathy (BSE). Human Molecular Genetics. 1997, 6 (10): 1699-705. 10.1093/hmg/6.10.1699.PubMedView ArticleGoogle Scholar
- Collinge J, Sidle KC, Meads J, Ironside J, Hill AF: Molecular analysis of prion strain variation and the aetiology of 'new variant' CJD. Nature. 1996, 383 (6602): 685-90. 10.1038/383685a0.PubMedView ArticleGoogle Scholar
- Caughey B, Raymond GJ: The scrapie-associated form of PrP is made from a cell surface precursor that is both protease- and phospholipase-sensitive. J Biol Chem. 1991, 266 (27): 18217-23.PubMedGoogle Scholar
- European Commission. Official Journal of European Communities, European Commission: Regulation (EC) No 999/2001 of the European Parliament and of the Council of 22 May 2001 laying down rules for the prevention control and eradication of certain transmissible spongiform encephalopathies. Off J Eur Communities Volume 147. 2001, European Commission. Official Journal of European Communities, 1-40.Google Scholar
- European Commission. Official Journal of European Communities, European Commission: Regulation (EC) No 162/2009 of the European Parliament and of the Council of 26 February 2009 amending Annexes III and X to Regulation (EC) No 999/2001 laying down rules for the prevention control and eradication of certain transmissible spongiform encephalopathies. Off J Eur Communities Volume 55. 2009, European Commission. Official Journal of European Communities, 11-16.Google Scholar
- Moynagh J, Schimmel H, Kramer GN: The evaluation of tests for the diagnosis of transmissible spongiform encephalopathy in bovines. Unit B3 Management of Scientific Committees Directorate General 24 Consumer Policy and Health Protection. 08/07/1999
- European Commission health & Consumer Protection Directorate-General Scientific Steering Committee: Opinion of the Scientific Steering Committee on the field trial evaluation of two new rapid BSE post mortem tests. 2003, Adopted on 6 March, [http://ec.europa.eu/food/fs/sc/ssc/out316_en.pdf]Google Scholar
- Wolfang P, Pavel V: The Field Trial of Seven New Rapid Post Mortem Tests For The Diagnosis of Bovine Spongiform Encephalopathy in Bovines. European Commission health & Consumer Protection Directorate-Joint Research Centre Institute for Reference Materials and Measurements. 12/11/2004, [http://irmm.jrc.ec.europa.eu/html/activities/TSE_testing/GlobalreportphaseII.pdf]
- European Food Safety Authority (EFSA): Scientific Report on the Evaluation of Two Rapid post mortem BSE Tests. The EFSA journal. 2005, 48: 1-10.Google Scholar
- Office for Official Publications of the European Communities,Directorate E, Safety of the food chain E2, Food Hygiene Alert System and Training: Report on the monitoring and testing of ruminants for the presence of transmissible spongiform encephalopathies (TSEs) in the EU in 2007. 2009, Office for Official Publications of the European Communities, [http://ec.europa.eu/food/food/biosafety/bse/preliminary_annual_report_tse2007_en.pdf]Google Scholar
- Scott AC, Wells GA, Chaplin MJ, Dawson M: Bovine spongiform encephalopathy: detection of fibrils in the central nervous system is not affected by autolysis. Res Vet Sci. 1992, 52 (3): 332-6.PubMedView ArticleGoogle Scholar
- Stack MJ, Scott AC, Done SH, Dawson M: Scrapie associated fibril detection on decomposed and fixed ovine brain material. Res Vet Sci. 1993, 55 (2): 173-8.PubMedView ArticleGoogle Scholar
- Race R: Diagnostic implications of detection of proteinase K-resistant protein in spleen lymph nodes and brain of sheep. Am J Vet Res. 1992, 53 (6): 883-9.PubMedGoogle Scholar
- Debeer SO, Baron TG, Bencsik AA: Immunohistochemistry of PrPsc within bovine spongiform encephalopathy brain samples with graded autolysis. J Histochem Cytochem. 2001, 49 (12): 1519-24.PubMedView ArticleGoogle Scholar
- Chaplin MJ, Barlow N, Ryder S, Simmons MM, Spencer Y, Hughes R, Stack MJ: Evaluation of the effects of controlled autolysis on the immunodetection of PrP(Sc) by immunoblotting and immunohistochemistry from natural cases of scrapie and BSE. Res Vet Sci. 2002, 72 (1): 37-43. 10.1053/rvsc.2001.0518.PubMedView ArticleGoogle Scholar
- Monleón E, Monzón M, Hortells P, Vargas A, Badiola JJ: Detection of PrP(sc) in samples presenting a very advanced degree of autolysis (BSE liquid state) by immunocytochemistry. J Histochem Cytochem. 2003, 51 (1): 15-8.PubMedView ArticleGoogle Scholar
- Wear A, Henderson K, Webster K, Patel I: A comparison of rapid bovine spongiform encephalopathy testing methods on autolyzed bovine brain tissue. J Vet Diagn Invest. 2005, 17 (2): 99-102.PubMedView ArticleGoogle Scholar
- Carra E, Taddei R, Barbieri I, Botti G, Tranquillo V, Iori A, Gibelli L, Cerioli M, Cavadini F, Gelmetti D, Pongolini S, Capucci L: Evaluation of three rapid diagnostic tests used in bovine spongiform encephalopathy monitoring in Italy. J Vet Diagn Invest. 2009, 21 (6): 830-6.PubMedView ArticleGoogle Scholar
- Stata Corp: Stata Statistical Software: Release 8.0 College Station TX StataCorp PL. 2003Google Scholar
- World Organisation for Animal Health: Manual of Diagnostic Tests and Vaccines for Terrestrial Animals 2008. [http://www.oie.int/ENG/normes/mmanual/A_index.htm]
- European Food Safety Authority (EFSA): Scientific Opinion on Analytical sensitivity of approved TSE rapid tests. The EFSA journal. 2009, 7 (12): 1436-Google Scholar
- European Food Safety Authority (EFSA): Scientific Opinion on Analytical sensitivity of approved TSE rapid tests - new data for assessment of two rapid tests. The EFSA journal. 2010, 8 (4): 1591-Google Scholar
- TSE Community Reference Laboratory: Batch Testing Protocol for Batch Release of TSE rapid test kits. EU TSE CRL at VLA Weybridge UK, Reference: CRLPDB01 v2.0, 1 June 2007, [http://www.defra.gov.uk/vla/science/docs/sci_tse_crlpdb01_v2_0.pdf]