- Short Report
- Open Access
IGRA tests perform similarly to TST but cause no adverse reactions: pediatric experience in Finland
BMC Research Notesvolume 2, Article number: 9 (2009)
Two commercial interferon gamma release assays (IGRAs) (QuantiFERON®-TB Gold in Tube and T SPOT®-TB) to detect a contact with M. tuberculosis have recently become available. The majority of studies agree that the sensitivity and specificity of these methods are superior to the Tuberculin Skin Tests (TSTs) in detecting an exposure to bacteria in latently infected individuals and in clinical tuberculosis. However, the data in children remains limited.
Consecutively collected samples from children (n = 99) representing age range from zero to 18 years were analyzed in a retrospective non-blinded study. The two IGRAs were modified and adapted to the needs of Finland, a country of a low tuberculosis incidence. For 27 children, both tests were performed simultaneously and compared with the TST and clinician's diagnosis. The sensitivity, specificity, and accuracy of both IGRAs was determined. QuantiFERON TB Gold and T SPOT-TB performed (respectively) as follows: sensitivities 0.92 (95% confidence interval, CI, 0.67–0.99) and 0.85 (0.64–0.95); specificities 0.91 (0.77–0.97) and 1.00 (0.93–1.00); accuracies 0.91 (0.80–0.97) and 0.96 (0.88–0.99). This compares favorably to the TST whose known figures are 0.90, 0.95, and 0.95, respectively. The agreement between the IGRAs was high, k = 0.89. Finally, both methods agreed well with the TST, k = 0.86 for TST/QuantiFERON-TB Gold and k = 0.76 for TST/T SPOT-TB.
The sensitivity and specificity of IGRA methods compares well with the TST without the inconveniences and complications associated with TST, including exaggerated delayed type hypersensitivity reactions. These properties place them as acceptable substitutes for TST.
Diagnosis of childhood tuberculosis (TB) remains challenging . Two commercial IFN-γ release assays (IGRAs), namely T-SPOT.TB and QuantiFERON®-TB Gold In-Tube (QFGT), have been recently developed. These methods show acceptable diagnostic accuracy for active TB in adults  and have better correlation with tuberculosis exposure than the TSTs in contact tracing for revealing latent infections (LTBI) [3, 4]. However, pediatric data are limited, and studies evaluating the performance of IGRAs in children have been called for especially in low-incidence countries [2, 5, 6].
In Finland the incidence of TB is low, 5.6/100 000 inhabitants in 2006 . Only zero to six child TB diagnoses per annum has been registered during the last ten years . Universal BCG vaccination of newborns was practiced until 2006 
Between September 2004 and January 2007 our laboratory adapted the tests to the general needs in Finland. After completion of the field evaluation  the methods became available for routine diagnostics. We then evaluated the performance of IGRAs in children and compared them to the TST and clinical diagnoses.
Between 15.9.2004 and 15.10.2007 we analyzed samples from 99 consecutive children and adolescents. The flow diagram of the study is presented in Fig. 1. We reviewed the medical records of the patients and collected data on demographics, clinical, microbiological and radiological examinations, and the BCG vaccination history (Table 1). This study was approved by the Ethical Committee of the Hospital for Children and Adolescents, University of Helsinki (Nr.164/E7/05).
Ly-TbSpot procedure and quality control
The Ly-TbSpot, a modified version of T-SPOT.TB (Oxford Immunotec, Oxford, UK) , was performed using standard operation procedures (SOP). Firstly, the results were expressed as a number of reactive spots/million lymphocytes. The lymphocyte count from isolated peripheral blood mononuclear cell (PBMC) preparation was calculated with an automated hematologic analyzer (Advia® 60, Bayer, Germany). Secondly, duplicate ELISPOT wells were used for each antigen and media. Thirdly, Purified Protein Derivative (PPD) (Statens Serum Institut, Copenhagen, Denmark) was used as an additional positive control. Fourthly, we adopted a double cut-off policy, i.e. the responses below 25 spot/million lymphocytes were considered as non-reactive according to the guidelines by the manufacturer; the responses between 25 and 55 spots were considered borderline and over 55 spots were interpreted as reactive. An internal control of cryopreserved cells was run with each new batch of reagents.
B-TbIFNγ procedure and quality control
B-TbIFNγ is a modified version of the QuantiFERON®-TB Gold In-Tube (Cellestis Limited, Carnegie, Victoria, Australia) . In accordance with the SOP of our laboratory, stimulation of blood cells was done in tubes of the manufacturer. However, for measurement of IFN-γ levels, we used EIA of PeliKine Compact human EIA (Sanquin, Amsterdam, The Netherlands). This resulted in a steeper calibration curve and ensured more accurate result interpretation in the cut-off zone (Fig. 2). Two cut-off levels were applied. The samples showing a net reactivity (the reactivity of a sample minus the reactivity of the nil control) < 0.35 IU/ml were interpreted as non-reactive. Those showing reactivity between 0.35 and 0.50 IU/ml were interpreted as borderline and those with a reactivity exceeding 0.50 IU/ml were interpreted as reactive. For the internal quality control, an artificially prepared IFN-γ solution to simulate a low reactive sample was used.
Method of TST
TST was performed with two TU, purified protein derivative (PPD, RT23, Statens Serum Institut, Copenhagen, Denmark) according to the Mantoux technique. The result was recorded after 48–72 h. A cut-off for positivity was defined as 10 mm or more in BCG-vaccinated and 5 mm or more in non-vaccinated children. If a child had a negative TST result, but was examined because of contact with an infectious TB case, the test was repeated .
For methods evaluation we used conventional interpretations of definitive and probable TB and of LTBI.
The results of the tests were considered eligible if the reactivities to the mitogen were as suggested by the manufactures. Seven samples were excluded from the ELISPOT analysis because of high non-specific background.
The concordances between the IGRAs, and of each test with the TST, were assessed in three categories by describing proportions of agreement (PA) and with the Cohen's kappa statistic with linear weighting. 95% confidence intervals (CI) were calculated with the Wilson efficient-score method which was corrected for continuity. Using a conservative approach, the cases interpreted in the grey zone were placed into categories of false positives or false negatives for the calculations of specificity, sensitivity and accuracy.
Final diagnosis of the participants
Overall, 99 samples were analyzed, and their characteristics are shown in Table 1, Table 2, and Figure 1. The subjects were tested as follows: with the Ly-TbSpot alone, with the B-TbINFγ alone, and with both Ly-TbSpot and B-TbIFNγ. Participant numbers were 52, 20, and 27 (out of 99 total), respectively. Seven results were excluded from calculations because non-specific background reactivity made it impossible to interpret the samples as definitely non-reactive. Of those tested with the Ly-TbSpot alone, six cases were positive and one was a borderline case; of those tested with the B-TbINFγ alone, one was interpreted as a borderline and one was positive; of those tested with both methods, 11 were positive by both methods and two samples were interpreted as borderline only with the B-TbINFγ method. The majority of the patients were either new immigrants or had at least one parent from a country with a high incidence of TB. The median age of the participants was nine years and the age range was from two weeks to adolescence.
The major indication for performing IGRA was recent contact with an infectious case of TB (62 of 99 patients). Thirty-seven children were examined because of symptomatic illness, with TB considered a diagnostic modality. Ten children were diagnosed with TB; five had pulmonary TB, only one of them culture positive; five were diagnosed with extrapulmonary TB. One patient also had an HIV infection, and one patient was HIV infected but had no TB.
Immunological conversion was observed in a 13-year-old boy who was examined several times because of the repeated household contacts with TB. His patient history and the kinetics of the immunological responses in all the three methods are presented in Table 3.
The TST was performed in 87 (out of 99) subjects, in eight the test was not performed, and in four the data was missing from the records. Of those tested, positive TST was recorded in 25 cases, the size of the induration ranging from 10 to 30 mm. In one subject the TST converted from zero to 16 mm (Table 3). In another subject the TST test caused a severe delayed type hypersensitivity reaction, which resulted in a cosmetically unacceptable scar (Fig. 3A–C). A similar severe hypersensitivity reaction was observed in a third case that was not enrolled in the current study (Fig 3D, E).
Performance characteristics of the IGRAs
Combined performance characteristics for IGRAs are presented in Table 4. None of the samples tested with the Ly-TbSpot were condemned as false positives, whereas three samples fell into the borderline category with the B-TbIFNγ (see Fig. 1). According to our interpretation criteria, three patients in the Ly-TbSpot and one in the B-TbIFNγ cohorts were grouped as false negatives. One was a 7-year-old boy with tuberculous lymphadenitis who had a borderline Ly-TbSpot result in our definition, but the TST induration was 20 mm. The second was a 15-year-old boy with TB contact who had TST induration of 13 mm but his Ly-TbSpot results were repeatedly negative. The third case was a 6-year-old girl with no symptoms whose sibling was diagnosed with TB. She had a TST conversion within a year, the TST induration at the time of assessment was 10 mm, but both IGRAs remained non-reactive. The fourth case was a 9-year-old boy from a highly endemic area whose TST induration was 11 mm but the B-TbIFNγ remained non-reactive. Because of the lack of the gold standard for LTBI, in the last three cases the diagnosis was based primarily on extensive exposure to TB and positive TST, in accordance with the recommendations in our country .
Agreement between Ly-TbSpot, B-TbIFNγ and the TST
The calculated data are presented in Table 5. The κ values above 0.75 imply good agreement, more than might have occurred by chance.
Analysis of non-interpretable results
Non-specific background activation of cells for IFNγ production was observed in seven samples analyzed with the Ly-TbSpot. Of those, six samples were from members of a family newly immigrated from Ethiopia. These patients showed reactivity without stimulation with an added antigen, the size of the spots being very small. This non-specific reactivity was interpreted as the reactivity of other than effector T-cell populations, most probably of NK cells. All results obtained with the B-TbIFNγ-method were acceptable.
The influence of the cut-off levels on performance characteristics of the Ly-TbSpot
Theoretical values for sensitivity, specificity, positive and negative predictive values were plotted against differential cut-off points. The analysis showed that the accuracy of the test peaked to 0.97 in the range of 24 to 48 spots/million lymphocytes (Fig. 4). Hence, by preserving our current double cut-off policy, and a conservative way of interpretation, we achieved an accuracy of 0.96. This means that any pediatric sample falling into the borderline category may most probably represent a pathological condition.
We present results of a retrospective, non-blinded study of two modified IGRAs for the diagnosis of childhood TB. The modifications were aimed to avoid false positive interpretations. Because no method can guarantee 100% sensitivity and specificity, we made a pragmatic decision to offer the best possible specificity even at the cost of sensitivity. Changing of the cut-off levels of the commercial IGRA methods has been suggested by other investigators. Lee at al  suggested lowering the cut-off in the QFGT method. This change would have resulted in a drop of specificity from 91.6% to 87.0% which we, contrary to Lee, do not regard as a minimal loss. Arend et al  also recommended dropping the cut-off of the QFGT to achieve a detection rate of potentially infected persons similar to that of TST. The recommendation is not acceptable for the reason that TST is by no means a gold standard. The sensitivity of QFGT could instead be improved e.g. by using more sensitive EIA techniques. In fact, although there was high agreement between IGRAs and TST in our studies, three earlier studies found a lower agreement: two studies [16, 17] performed on pediatric samples in low risk countries observed concordant results between the IGRAs but inferior specificity of the TST, and one large cohort study of TB disease in African children  found lower agreement with the TST. In another cohort study of contact tracing, performed on Gambian children, the clinical sensitivity of the TST was found superior to that of the ELISPOT in diagnosing LTBI . In that study, however, the discordance between the tests was not significant . In a recent study from Gambia  comparing the new IGRAs to TST in contact tracing, ELISPOT was found more sensitive than the QFGT in the diagnosis of TB disease while equally sensitive in the diagnosis of LTBI. That study showed no significant discordance between IGRAs but the results of the TST were influenced by the BCG vaccination status. The observed discrepancies in the estimation of the three methods are most probably attributed to the differences in the research population, their vaccination status and exposure to other mycobacteria, and most importantly, in the variability of the methods' performance using variable threshold levels.
Our study raises several important issues. When performing TST, intradermal inoculation of PPD in children exposed to M. tuberculosis may produce an excessive delayed type hypersensitivity reaction. Secondly, demonstration of the test variability around the cut-off zone in real laboratory settings convinces that interpretation of immunodiagnostic methods should take into account the method imprecision and utilize a grey zone.
The sensitivity and specificity of IGRA methods compares well with TST but do not cause exaggerated delayed type hypersensitivity reactions.
Tuberculin Skin Tests
Interferon Gamma Release Assays
Latent Tuberculosis Infection
Standard Operation procedure
- Positive (PPV) and (NPV):
Negative Predictive Values
Proportions of Agreement
Enzyme-linked Immunosorbent Spot Assay
Enzyme-linked Immunosorbent Assay
QuantiFeronGold in Tube
Natural Killer cells
Purified Protein Derivative
Human Immunodeficiency Virus.
Starke JR: Diagnosis of tuberculosis in children. Pediatr Infect Dis J. 2000, 19: 1095-96. 10.1097/00006454-200011000-00015.
Menzies D, Pai M, Comstock G: Meta-analysis: new tests for the diagnosis of latent tuberculosis infection: areas of uncertainty and recommendations for research. Ann Int Med. 2007, 14: 340-54.
Ewer K, Deeks J, Alvarez L, Bryant G, Waller S, Andersen P, Monk P, Lalvani A: Comparison of T-cell-based assay with tuberculin skin test for diagnosis of Mycobacterium tuberculosis infection in a school tuberculosis outbreak. The Lancet. 2003, 361: 1168-73. 10.1016/S0140-6736(03)12950-9.
Zellweger JP, Zellweger A, Ansermet S, de Senerclens B, Wrighton-Smith P: Contact tracing using a new T-cell-based test: better correlation with tuberculosis exposure than tuberculin skin test. Int J Tuberc Lung Dis. 2005, 9: 1242-47.
Lalvani A, Millington KA: T cell-based diagnosis of childhood tuberculosis infection. Curr Opin Infect Dis. 2007, 20: 264-271. 10.1097/QCO.0b013e32813e3fd8.
Mazurek GH, Jereb J, Lobue P, Iademarco MF, Metchock B, Vernon A, Division of Tuberculosis Elimination, National Center for HIV, STD, and TB Prevention, Centers for Disease Control and Prevention (CDC): Guidelines for using the QuantiFERON-TB Gold test for detecting Mycobacterium tuberculosis infection, United States. MMWR Recomm Rep. 2005, 54: 49-55.
Infectious diseases in Finland. [http://www.ktl.fi/attachments/suomi/julkaisut/julkaisusarja_b/2007/2007b13.pdf]
Finnish Infectious Disease Register, National Public Helath Institute. [cited 2008 April 25], [http://www3.ktl.fi/stat/]
Salo E: BCG in Finland: Changing from a universal to a selected programme. Euro Surveill. 2006, 11: 18-20.
Tuuminen T, Sorva S, Liippo K, Vasankari T, Soini H, Eriksén-Neuman B, Miettinen A, Seppälä I: Feasibility aspects of commercial interferon (IFN)-γ based methods for the diagnosis of latent Mycobacterium tuberculosis infection in Finland, a country of low incidence and high BCG vaccination coverage. Clin Microbiol Infect. 2007, 13: 836-8. 10.1111/j.1469-0691.2007.01750.x.
Oxford Immunotec. Technical handbook T-SPOT. TB. 2007, [cited 2008 April 24], [http://www.oxfordimmunotec.com/downloads/Technical%20handbook%20TH-TB-UK-V3%20300407.pdf]
Cellestis : Clinicians Guide to QuantiFERON-TB Gold. 2007, [cited 2008 April 24], [http://www.cellestis.com/IRM/content/gold/QFT-Gold_US_Clinicianguide.pdf]
Valtakunnallinen tuberkuloosiohjelma: STM 2006:21 (Finnish). [http://www.stm.fi/Resource.phx/publishing/store/2006/09/pr1158658370802/passthru.pdf]
Lee JY, Choi HJ, Park I-N, Hong S-B, Oh Y-M, Lim C-M, et al: Comparison of two commercial interferon-γ assays for diagnosing Mycobacterium tuberculosis infection. Eur Resp J. 2006, 28: 24-30. 10.1183/09031936.06.00016906.
Arend S, Thijsen S, Leyten E, Bouwman J, Willeke P, Franken , et al: Comparison of two interferon-γ and tuberculin skin test for tracing tuberculosi contacts. Am J Respit Crit Care Med. 2007, 175: 618-27. 10.1164/rccm.200608-1099OC.
Detjen AK, Kell T, Roll S, Hauer B, Mauch H, Wahn U, Magdorf K: Interferon-gamma release assays improve the diagnosis of tuberculosis and nontuberculous mycobacterial disease in children in a country with low incidence of tuberculosis. Clin Infect Dis. 2007, 1: 322-8. 10.1086/519266.
Connell T, Ritz N, Paxton G, Buttery J, Curtis N, Ranganathan S: A three-way comparison of tuberculin skin testing, QuantiFERON-TB Gold and T-SPOT. TB in children. PLos ONE. 2008, 3: 1-8. 10.1371/journal.pone.0002624.
Liebeschuetz S, Bamber S, Ewer K, Deeks J, Pathan AA, Lalvani A: Diagnosis of tuberculosis in South Aftrican children with a T-cell based assay: a prospective cohort study. The Lancet. 2004, 364: 21996-2203. 10.1016/S0140-6736(04)17592-2.
Hill PC, Brookes RH, Adetifa IM, Fox A, Jackson-Sillah D, Lugos MD, Donkor SA, Marshall RJ, Howie SR, Corrah T, Jeffries DJ, Adegbola RA, McAdam KP: Comparison of enzyme-linked immunospot assay and tuberculin skin test in healthy children exposed to Mycobacterim tuberculosis . Pediatrics. 2006, 117: 1542-48. 10.1542/peds.2005-2095.
Adetifa IM, Lugos MD, Hammond A, Jeffries D, Donkor S, Adegbola RA, Hill PC: Comparison of the two interferon gamma release assays in the diagnosis of Mycobacterium tuberculosis infection and disease in the Gambia. BMC Infect Dis. 2007, 7: 122-10.1186/1471-2334-7-122.
We wish to thank for financial support in the evaluation of new IGRA-methods the following private Finnish foundations: Finnish Lung Health Association (Filha ry), Pulmonary Association Heli, and the Tuberculosis Association of the University of Tampere.
The authors declare that they have no competing interests.
ET carried out statistical analysis and interpretation of the data and was involved in the drafting of the manuscript; TT and IS have contributed to the conception and design of the study, drafting and revision of the manuscript; ES is a clinician who treated presented cases, she contributed to the acquisition of the data and drafting of the manuscript. All authors have given final approval of the version to be published.
About this article
- Purify Protein Derivative
- Interferon Gamma Release Assay
- Standard Operation Procedure
- Type Hypersensitivity Reaction
- Borderline Category