Correlation of SARS-CoV-2 RNA and nucleocapsid concentrations in samples used in INSTAND external quality assessment schemes
BMC Research Notes volume 16, Article number: 210 (2023)
In routine clinical laboratories, severe acute respiratory syndrome coronavirus (SARS-CoV-2) infection is determined by reverse-transcription PCR (RT-PCR). In the COVID pandemic, a wide range of antigen detection tests were also in high demand. We investigated the correlation between SARS-CoV-2 NCap antigen and N gene concentration by analyzing samples from several INSTAND external quality assessment (EQA) schemes starting in March 2021. The absolute N gene concentration was measured using reverse transcriptase digital PCR (RT-dPCR) as reference value. Moreover, the performance of five commercial ELISA tests using an EQA inactivated SARS-CoV-2 sample at different concentrations was assessed on the basis of these reference values.
Quantitative ELISA and RT-dPCR results showed a good correlation between SARS-CoV-2 NCap antigen and RNA concentration, but this correlation varies among SARS-CoV-2 isolates. A direct correlation between SARS-CoV-2 NCap antigen concentration and genome concentration should not be generally assumed.
Further correlation studies between SARS-CoV-2 RNA and NCap antigen concentrations are needed, particularly in clinical samples and for emerging SARS-CoV-2 variants, to support the monitoring and improvement of antigen testing.
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), first reported in December 2019 in Wuhan, China , has turned into a global public health problem [2, 3]. This disease has spawned the development of rapid and sensitive diagnostic tests based on nucleic acids and proteins to detect SARS-CoV-2 . Although antigen detection tests are inferior in terms of sensitivity compared to quantitative real-time PCR (RT-qPCR) for the detection of SARS-CoV-2, they do cover the high demand for early diagnosis due to their ease of use and rapid delivery of results [5, 6].
The correlation of SARS-CoV-2 NCap antigen concentration with cycle threshold (Ct) values such as RNA concentration in clinical samples has been investigated . However, RNA concentration can only be determined from Ct values if a calibrator is available and used, which was not the case in this study. In contrast, we compared calibration-free RNA absolute quantification by RT-dPCR with quantitative NCap antigen ELISAs to characterize the correlation of N gene and NCap antigen concentrations by analyzing dilution series of samples from the INSTAND External Quality Assessment (EQA) scheme for SARS-CoV-2 antigen detection (Program 410). For this purpose, we analyzed three quantitative ELISA assays for SARS-CoV-2 NCap antigen quantification and, for comparison, two qualitative ELISAs widely used in SARS-CoV-2 diagnostics. We used serial dilutions of one INSTAND EQA SARS-CoV-2 antigen sample from March 2021. Moreover, the quantitative ELISA kit with the best performance in terms of linearity, limit of detection (LOD) and limit of quantification (LOQ) was consequently used for correlation studies and for testing the samples from the cited EQA schemes of March, September and November 2021 and March 2022.
Materials and methods
Sample preparation and distribution
The samples derived from EQA schemes were provided by INSTAND e.V (https://www.instand-ev.de/en/instand-eqas/eqa-program/offer/virus-antigen-detection-sars-cov-2-ag/). INSTAND (Society for Promoting Quality Assurance in Medical Laboratories e.V.) has been designated as a German reference institution for quality assurance in medical laboratories by the German Medical Association and is accredited according to DIN EN ISO/IEC 17043:2010. The samples investigated in this study are shown in Table 1. For the SARS-CoV-2 isolates, aliquots of the corresponding Vero E6 (ATCC CRL-1586) cell culture supernatants were treated with 0.05% BPL for 14 h at 4 °C. BPL was then hydrolyzed at 37 C for two hours. Infectivity (measured in plaque forming units, PFU) was determined by plaque assay. Finally, 0.5 ml of the materials were aliquoted in screw cap micro tubes (2,0 mL, Sarstedt, Nümbrecht, Germany) and lyophilized. Each lyophilized vial was reconstituted in 0.5 ml of molecular water. Randomly selected vials of each of the EQA samples were analyzed for stability during the period of the EQA survey and for homogeneity according to DIN EN ISO/IEC 17043:2010 . Prior to the EQA survey, the EQA samples were tested by 2–5 INSTAND expert laboratories for suitability and declared qualified regarding the specified properties. For the evaluation of the commercial ELISA kits, EQA sample no. 410,004 was used (Table 1). For RNA and protein concentration correlation studies, we examined different dilutions of three SARS-CoV-2 isolates (Table 1; Fig. 2B C). Our participation in the INSTAND EQA Scheme involved the analysis of the sample sets corresponding to Program 410, distributed in September and November 2021 and March 2022 (Table 1).
The Roche Elecsys SARS-CoV-2 (product number: 09 345 272 190) and the Euroimmun SARS-CoV-2 (product number Eqs. 2606–9601) antigen tests were performed for the qualitative detection of SARS-CoV-2 NCap. The ProteinTech (KE30007), Abcam (Ab274341), and GeneTex (GTX535824) tests were used for quantitative measurements of the SARS-CoV-2 NCap. To compare the dilution linearity of the three quantitative ELISA tests, a highly concentrated SARS-CoV-2 sample (ID 410,004) and a series of five dilutions (2x, 4x, 8x,16x,32x) were examined in duplicate on three different days. For the qualitative ELISAs, just five dilutions (2x, 4x, 8x, 16x, 32x) were examined. Linear regression analysis was performed using Gen5 analysis software. LODs were determined as the concentration of recombinant nucleocapsid that provides a signal at least three times the standard deviation above the assay background generated using the correspondent kit assay diluent as a blank sample. For the LOQ, ten standard deviations were added to the background signal. For the background measurements of the different ELISA kits, 20 replicates were conducted.
After RNA extraction with the Qiagen QiaAmp RNA kit, one step RT-dPCR reactions were carried out as described in . For N gene quantification, a duplex assay was performed using China N and SarE genes with primers and probe concentrations of 400 nM and 200 nM, respectively, and optimized by varying the annealing temperature. The sequence of China N and SarE primers is described in [9,10,11], Droplet generation was conducted as described in . The PCR was performed under the following conditions: 60 min reverse transcription at 50 ºC and 10 min enzyme inactivation at 95 ºC followed by 45 cycles using a two-step thermal profile of 30 s denaturation at 95 ºC and 60 s annealing and extension at 55 ºC; followed by 10 min at 98 ºC and then cooled to 4 ºC. Following thermal cycling, the PCR plates were transferred to a droplet reader (QX200 BioRad, USA) and the data analyzed using QuantaSoft Analysis Pro 1.0.596 (BioRad, USA).
We participated in the Virus Antigen Detection SARS-CoV-2 EQA scheme (Program 410) of INSTAND in September/November 2021 and March 2022 together with 200 laboratories and used the Abcam ELISA kit for NCap antigen testing. Each program covers chemically inactivated samples from three different sources (Table 1). EQA Program 410 requires qualitative results from each EQA sample.
Statistical analyses were performed using Origin 2019 software (OriginLab Corporation, USA). The results of data analysis are presented as descriptive statistics by mean and standard deviation as appropriate. As a non-normal distribution was confirmed by a Kolmogorov–Smirnov test, a non-parametric Mann–Whitney U test was used to compare the SARS-CoV-2 nucleocapsid concentration between the ELISA kits. For all statistical analyses, p-values < 0.05 were deemed statistically significant.
A highly concentrated SARS-CoV-2 EQA sample distributed in March 2021, EQA Scheme Prog. 410 (EQA sample no. 410,004), was used to detect and measure the NCap by using different ELISA tests. NCap quantification was significantly lower when using the GeneTex assay (965 pg/ml) as compared to Abcam (2509 pg/ml) and Proteintech (2213 pg/ml). To verify the accuracy of the results from the samples investigated, we assessed the linearity at different levels of dilution in the diluent buffer of each ELISA kit (Fig. 1). Of the quantitative tests investigated, the Abcam test achieved the best linearity over the different dilutions (Fig. 1).
To further validate the Abcam ELISA performance, we analyzed the EQA SARS-CoV-2 samples included in Prog. 410 of INSTAND EQA from September/November 2021 and March 2022 (Table 1). The results were in good agreement with the qualitative target values for each of the EQA samples (Fig. 2A; Table 1).
We also investigated the correlation between SARS-CoV-2 genome and NCap antigen concentration levels using different dilutions of EQA samples of SARS-CoV-2. The NCap antigen concentrations were in the range of 36.33pg/ml to 2509.52 pg/ml for samples with the non-variant of concern (non-VOC) isolate and between 220.75 pg/ml and 1481.05 pg/ml for the samples containing VOCs. The RNA concentrations ranged from 9.1 × 104 copies/ml to 1.2 × 107 copies/ml for the samples containing non-VOC isolates and from 6.2 × 106 copies/ml to 7 × 107 copies/ml for VOC isolates. We demonstrated that both the SARS-CoV-2 non-VOC and VOC showed a good correlation between viral RNA and NCap antigen, with R2 = 0.93 and 0.98, respectively (Fig. 2B C). However, this correlation is not one-to-one (genome-to-protein) and depends on the SARS-CoV-2 isolate tested. For example, the amount of SARS-CoV-2 NCap antigen corresponding to approximately 107 RNA copies/ml was four times higher in the non-VOC isolate (410,004) than in the delta isolate (410,015) (Table 1).
The direct correlation of RNA and protein concentrations in SARS-CoV-2 as measured by diagnostics tests is still poorly understood. To date, RT-qPCR is considered the gold standard for SARS-CoV-2 detection . But this routinely used test has limitations regarding the quantification of the viral load of SARS-CoV-2 [13, 14]. By contrast, RT-dPCR is a calibration-free quantitative method that demonstrates better reproducibility and sensitivity than RT-qPCR [10, 15]. This work is the first characterization of SARS-CoV-2 NCap antigen concentration using highly stable and homogeneous samples from an EQA scheme (INSTAND) and correlating the results with RT-dPCR measurements. To correlate SARS-CoV-2 NCap and RNA concentration, we first chose the quantitative ELISA kit with the best performance in terms of linearity, LOD and LOQ. Our results suggest that the Abcam kit shows the best dilution linearity over the different dilutions of the EQA sample (R2 = 0.999) as well as the lowest LOD and LOQ. As such, it is the preferred assay for quantifying NCap antigen. The performance of the Proteintech kit is in terms of dilution linearity and LOD/LOQ less satisfactory than that of the Abcam kit. Moreover, this study indicates that GeneTEX protein quantification is less efficient and accurate than the other quantitative ELISA kits used here, showing poor dilution linearity and very high LOD and LOQ for protein measurements. Therefore, GeneTEX does not appear to be useful for NCap quantification in EQA samples.
In principle, if we compare the results of RT-dPCR and ELISA measurements using the dilution series of EQA samples, we expect to find a perfect one-to-one correlation. However, our study indicates no such one-to-one correlation of SARS-CoV-2 RNA and NCap antigen among the dilution series of the studied EQA samples. Hence, the amount of SARS-CoV-2 NCap antigen cannot be predicted based on the samples’ genome concentration. There are many factors affecting the correlation, including the nature of the SARS-CoV-2 isolate.
In conclusion, our data suggest that constant evaluation of the sensitivity of ELISA for detecting new SARS-CoV-2 variants is vital to support monitoring and antigen testing. Further analysis including clinical samples and RT-dPCR absolute quantification will also help us to better understand the correlation between RNA and NCap antigen.
The limitation of this study is the reduce number of SARS-CoV-2 variants of concern and non-variants of concern samples used; additionally clinical samples should be also tested to better understand the correlation between RNA and NCap antigen.
All data generated or analysed during this study are included in this article.
Coronavirus disease 2019
External quality asurance
Limit of detection
Limit of quantification
Non-variant of concern
Reverse transcriptase digital polymerase chain reaction
Reverse transcriptase quantitative polymerase chain reaction
Severe acute respiratory syndrome coronavirus 2
Variant of concern
Zhu N, Zhang W, Wang W, Li X, Yang B, Song J, et al. China Novel Coronavirus investigating and Research Team. A novel coronavirus from patients with Pneumonia in China, 2019. N Engl J Med. 2020;382(8):727–33. https://doi.org/10.1056/NEJMoa2001017.
Abubakar L, Salerncity AJ, Abass OK, Olajuyin AM. The impacts of COVID-19 on environmental sustainability: a brief study in world context. Bioresource Tech Reports. 2021;15:100713. https://doi.org/10.1016/j.biteb.2021.100713.
Zheng JX, Lv S, Tian LG, Guo ZY, Zheng PY, Chen YL, et al. The rapid and efficient strategy for SARS-CoV-2 Omicron transmission control: analysis of outbreaks at the city level. Infect Dis Poverty. 2022;11(1):114. https://doi.org/10.1186/s40249-022-01043-2. PMID: 36434701.
Kevadiya BD, Machhi J, Herskovitz J, Oleynikov MD, Blomberg WR, Bajwa N, et al. Diagnostics for SARS-CoV-2 infections. Nat Mater. 2021;20(5):593–605. https://doi.org/10.1038/s41563-020-00906-z.
WHO, Antigen-detection in the diagnosis of SARS-CoV-2 infection using rapid immunoassays, Interim guidance., 2020. https://www.who.int/publications/i/item/antigen-detection-in-the-diagnosis-of-sars-cov-2infection-using-rapid-immunoassays. Aaccessed 26 March 2021.
Duma Z, Ramsuran V, Chuturgoon AA, Edward VA, Naidoo P, Mkhize-Kwitshana ZL. Evaluation of various alternative economical and high Throughput SARS-CoV-2 Testing Methods within Resource-Limited settings. Int J Mol Sci. 2022;23(22):14350. https://doi.org/10.3390/ijms232214350. PMID: 36430827.
Pollock NR, Savage TJ, Wardell H, Lee RA, Mathew A, Stengelin M, et al. Correlation of SARS-CoV-2 Nucleocapsid Antigen and RNA concentrations in nasopharyngeal samples from children and adults using an ultrasensitive and quantitative Antigen Assay. J Clin Microbiol. 2021;59(4):e03077–20. https://doi.org/10.1128/JCM.03077-20.
DIN E, ISO ISO/IEC. 17043: 2010-05-Konformitätsbewertung-Allgemeine Anforderungen an Eignungsprüfungen (ISO/IEC 17043: 2010); Deutsche und Englische Fassung EN ISO/IEC 17043: 2010. Conformity assessment-General requirements for proficiency testing (ISO/IEC 17043: 2010); German and English version EN ISO/IEC 17043: 2010, 2010.
Falak S, Macdonald R, Busby EJ, O’Sullivan DM, Milavec M, Plauth A, et al. An assessment of the reproducibility of reverse transcription digital PCR quantification of HIV-1. Methods. 2022;201:34–40. https://doi.org/10.1016/j.ymeth.2021.03.006.
Vierbaum L, Wojtalewicz N, Grunert HP, Lindig V, Duehring U, Drosten C, et al. RNA reference materials with defined viral RNA loads of SARS-CoV-2.A useful tool towards a better PCR assay harmonization. PLoS ONE. 2022;20(17):e0262656. https://doi.org/10.1371/journal.pone.0262656.
Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DK, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2020;25(3):2000045. https://doi.org/10.2807/1560-7917.ES.2020.25.3.2000045.
Fathi KS, Maleki-Baladi R, Shahgolzari M, Gholizadeh M, Shayegh F, Arashkia A. The evolving direct and indirect platforms for the detection of SARS-CoV-2. J Virol Methods. 2022;300:114381. https://doi.org/10.1016/j.jviromet.2021.114381.
Evans D, Cowen S, Kammel M, O’Sullivan DM, Stewart G, Grunert HP. The Dangers of using cq to quantify nucleic acid in Biological samples: a lesson from COVID-19. Clin Chem. 2021;30(1):153–62. https://doi.org/10.1093/clinchem/hvab219.
Bello-Lemus Y, Anaya-Romero M, Gómez-Montoya J, Árquez M, González-Torres HJ, et al. Comparative analysis of In-House RT-qPCR detection of SARS-CoV-2 for Resource-Constrained settings. Diagnostics (Basel). 2022;12(11):2883. https://doi.org/10.3390/diagnostics12112883. PMID: 36428942.
Renault C, Bolloré K, Pisoni A, Motto-Ros C, Van de Perre P, Reynes J, et al. Accuracy of real-time PCR and digital PCR for the monitoring of total HIV DNA under prolonged antiretroviral therapy. Sci Rep. 2022;12(1):9323. https://doi.org/10.1038/s41598-022-13581-8. PMID: 35665775; PMCID: PMC9167282.
This work was supported by the European Metrology Programme for Innovation and Research (EMPIR) joint research project (20SIP03 Bio-Stand 2) which has received funding from the EMPIR programme co-financed by the Participating States and the European Union´s Horizon 2020 research and innovation programme and by the UK National Measurement System. The funder had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Open Access funding enabled and organized by Projekt DEAL.
Ethics approval and consent to participate
Consent for publication
Prof. Heinz Zeichhardt declares that he is majority owner and managing director of GBD Gesellschaft fuer Biotechnologische Diagnostik mbH, Berlin, and owner and managing director of IQVD GmbH - Institut fuer Qualitaetssicherung, Berlin. All other authors declared no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Valiente, E., Falak, S., Kummrow, A. et al. Correlation of SARS-CoV-2 RNA and nucleocapsid concentrations in samples used in INSTAND external quality assessment schemes. BMC Res Notes 16, 210 (2023). https://doi.org/10.1186/s13104-023-06497-7
- Nucleocapsid (NCap) antigen