2021; 41(6): 519-520
Ann Lab Med 2021; 41(6): 588-592
Published online November 1, 2021 https://doi.org/10.3343/alm.2021.41.6.588
Copyright © Korean Society for Laboratory Medicine.
Clinical Performance of the Standard Q COVID-19 Rapid Antigen Test and Simulation of its Real-World Application in Korea
1Department of Laboratory Medicine, Jeonbuk National University Medical School and Hospital, Jeonju, Korea; 2Department of Laboratory Medicine, National Medical Center, Seoul, Korea; 3Department of Laboratory Medicine and Genetics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea; 4Department of Laboratory Medicine, Asan Medical Center and University of Ulsan College of Medicine, Seoul, Korea; 5Department of Laboratory Medicine, Yonsei University College of Medicine, Severance Hospital, Seoul, Korea; 6Department of Laboratory Medicine, National Health Insurance Service Ilsan Hospital, Goyang, Korea; 7Department of Laboratory Medicine, Seoul National University College of Medicine, Seoul National University Hospital, Seoul, Korea
Correspondence to: Ki Ho Hong, M.D.
Department of Laboratory Medicine, Yonsei University College of Medicine, Severance Hospital, 50-1 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea
* These authors equally contributed to this study.
† At the time of the experiment, the affiliation of Ki Ho Hong was the Department of Laboratory Medicine of Seoul Medical Center, Seoul, Republic of Korea.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
The rapid antigen test (RAT) for coronavirus disease (COVID-19) represents a potent diagnostic method in situations of limited molecular testing resources. However, considerable performance variance has been reported with the RAT. We evaluated the clinical performance of Standard Q COVID-19 RAT (SQ-RAT; SD Biosensor, Suwon, Korea), the first RAT approved by the Korean Ministry of Food and Drug Safety. In total, 680 nasopharyngeal swabs previously tested using real-time reverse-transcription PCR (rRT-PCR) were retested using SQ-RAT. The clinical sensitivity of SQ-RAT relative to that of rRT-PCR was 28.7% for all specimens and was 81.4% for specimens with RNA-dependent RNA polymerase gene (RdRp) threshold cycle (Ct) values ≤23.37, which is the limit of detection of SQ-RAT. The specificity was 100%. The clinical sensitivity of SQ-RAT for COVID-19 diagnosis was assessed based on the Ct distribution at diagnosis of 33,294 COVID-19 cases in Korea extracted from the laboratory surveillance system of Korean Society for Laboratory Medicine. The clinical sensitivity of SQ-RAT for COVID-19 diagnosis in the Korean population was 41.8%. Considering the molecular testing capacity in Korea, use of the RAT for COVID-19 diagnosis appears to be limited.
Keywords: Coronavirus disease, Real-time reverse-transcription PCR, Laboratory surveillance, Rapid antigen test, Korea
The current standard method for laboratory diagnosis of coronavirus disease (COVID-19) is molecular testing such as real-time reverse-transcription PCR (rRT-PCR). When molecular testing resources are insufficient, rapid antigen test (RAT) may be considered for massive and rapid testing [1, 2]. The minimum performance requirements for a COVID-19 RAT compared with that of molecular testing have been suggested to be ≥90% clinical sensitivity and ≥97% specificity by the European Centre for Disease Prevention and Control (ECDC), and ≥80% clinical sensitivity and ≥97% specificity by the World Health Organization (WHO) . Nevertheless, the clinical performance of COVID-19 RATs is variable, which may hamper their clinical application [3–13].
Standard Q COVID-19 RAT (SQ-RAT; SD Biosensor, Suwon, Korea) was the first RAT that was approved by the Korean Ministry of Food and Drug Safety on November 11, 2020 (https://mfds.go.kr/brd/m_74/view.do?seq=44004). We evaluated the performance of SQ-RAT and estimated its clinical sensitivity for COVID-19 diagnosis in the Korean population. This retrospective study was approved by the Institutional Review Boards (IRBs) of Jeonbuk National University Hospital (Jeonju), Seoul Medical Center (Seoul), and National Medical Center (Seoul), Korea (IRB approval numbers CUH-2020-12-022, SMC-2020-12-007, and NMC-2012-096, respectively). The requirement for patient consent was waived by all IRBs. All statistical analyses were performed using MedCalc Statistical Software v19.2.1 (MedCalc Software Ltd., Ostend, Belgium). SQ-RAT procedures were performed according to the manufacturer instructions, and collected data were interpreted and thoroughly checked by two laboratory physicians.
First, we determined the distribution of the initial threshold cycle (Ct) values for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) detection using rRT-PCR of upper respiratory tract specimens in the Korean population. The data were collected from the COVID-19 laboratory surveillance system of Korean Society for Laboratory Medicine from February 7, 2020 to December 17, 2020 . Data from four commercial rRT-PCR testing, including PowerChek 2019 nCoV (Kogene Biotech, Seoul, Korea), Allplex 2019-nCoV (Seegene, Seoul, Korea), Standard M nCoV (SD Biosensor), and Real-Q 2019-nCoV (Biosewoom, Seoul, Korea), all targeting the RNA-dependent RNA polymerase gene (
Figure 1. (A) Distribution of
RdRpCt values of all rRT-PCR tests performed on initial upper respiratory tract specimens obtained from newly diagnosed COVID-19 patients in Korea as of December 8, 2020. *Data were collected using the PowerChek 2019 nCoV (Kogene), Allplex 2019-nCoV (Seegene), Standard M nCoV (SD Biosensor), and Real-Q 2019-nCoV (Biosewoom) tests. (B) Clinical sensitivity of SQ-RAT compared with that of rRT-PCR by Ct stratum in specimens. The Ct data were collected using Standard M nCoV.
Abbreviations: COVID-19, coronavirus disease; Ct, threshold cycle; LoD, limit of detection;
RdRp, RNA-dependent RNA polymerase gene; rRT-PCR, real-time reverse-transcription PCR; SQ-RAT, Standard Q COVID-19 rapid antigen test.
We tested residual nasopharyngeal swab specimens (collected from November 1 to November 30, 2020) with the Standard M nCoV Real-time Detection kit (SD Biosensor) according to the manufacturer’s instructions; those specimens were stored (–70°C) in universal transport medium (ASAN Transport Medium, Asanpharm, Seoul, Korea, or T-SWAB TRANSPORT Universal Transport Medium, Noble Biosciences, Hwaseong, Korea), after being used for SARS-CoV-2 rRT-PCR testing. We selected 380 SARS-CoV-2-positive specimens allocated to the six Ct strata and 300 SARS-CoV-2-negative specimens for SQ-RAT. The clinical sensitivity of SQ-RAT was 28.7% (109/380; 95% confidence interval [CI]: 24.2–33.5%), which decreased with increasing Ct value (Fig. 1B). A significant difference in clinical sensitivity was observed between specimens with Ct values ≤23.37 (81.4%) and >23.37 (10.6%), which corresponds to the manufacturer-claimed LoD of SQ-RAT (
As the conditions of residual specimens may affect RAT performance, the impact of freeze-thaw handling of upper respiratory tract specimens on the performance of SQ-RAT was evaluated using an independent set of 82 fresh upper respiratory tract specimens from COVID-19 patients. The specimens were tested using SQ-RAT within 24 hours of collection after confirming SARS-CoV-2 positivity by rRT-PCR. The specimens were frozen at –70°C for three days after initial testing, thawed at room temperature (20–25°C), and then retested using SQ-RAT within two hours. The SQ-RAT results before and after freezing showed 100% agreement for all 82 specimens, regardless of the initial Ct values. Thus, frozen specimens were acceptable for evaluating the performance of SQ-RAT (Table 1).
Finally, we estimated the clinical performance of SQ-RAT based on the proportion of the observed Ct value distribution in the Korean population. The estimated clinical sensitivity of SQ-RAT in rRT-PCR-confirmed COVID-19 patients in Korea was 41.8% when the clinical sensitivity of each stratum was projected onto the Ct distribution data (Fig. 1A). The estimated clinical sensitivity for each of the four rRT-PCR testing (Table 2) varied from 33.8% to 59.7%.
We examined the clinical performance of SQ-RAT for COVID-19 diagnosis using the Ct values of initial upper respiratory tract specimens collected from newly diagnosed patients in Korea. SQ-RAT showed good specificity; however, its overall clinical sensitivity was low compared with that reported in previous studies using the same kit [3, 4, 6, 8]. This discrepancy could be due to the difference in viral loads in the clinical specimens. Nevertheless, these findings were consistent with previous studies, in which the RAT showed good clinical sensitivity in specimens with high viral loads (Ct≤25), but not in specimens with low viral loads (Ct>25) [16, 17]. Together, these findings suggest that the viral load distribution in the target population has a direct impact on the clinical sensitivity of RATs.
The Ct value distribution in this study was obtained from online laboratory surveillance data comprising Ct values collected at diagnosis and submitted by independent and hospital-associated clinical laboratories in Korea, but not from public health laboratories. More than a half of the specimens had Ct values>25 at diagnosis; consequently, the clinical sensitivity of SQ-RAT for COVID-19 diagnosis in the general Korean population was estimated to be low, which decreased in specimens with high Ct values (low viral loads). As Korea has implemented an aggressive testing strategy, the Korean surveillance data used in this study might include more pre-symptomatic or asymptomatic cases with low viral loads than data from other countries [18, 19]. Several prospective evaluations of RATs in the general population reported a limited clinical performance. For example, the Liverpool pilot study reported that RATs would miss more than a half of the cases and that their clinical sensitivity did not fulfill the requirements of the ECDC and WHO [1, 9, 10, 20]. These findings indicate that the viral loads of the target population should be considered for performance evaluation of
This study had some limitations. First, differences in the performance and usage of PCR reagents might have affected the Ct value distribution. Second, SQ-RAT was evaluated using residual upper respiratory tract specimens. Although most RAT evaluation studies used residual specimens, the clinical sensitivity may have been affected by the specimen type [16, 17].
In summary, this study revealed that SQ-RAT has limited clinical sensitivity for COVID-19 diagnosis in the Korean population. Considering the sufficient molecular testing capacity in Korea, the usefulness of RATs for COVID-19 diagnosis seems to be limited to situations in which molecular testing cannot be accessed immediately.
We thank Mallikarjun Handigund (Department of Laboratory Medicine, Jeonbuk National University Hospital), Kyoung Ah Lee, Seung Hyun Kim, Yeoung Im An, Dong Geun Lee (Department of Laboratory Medicine, Seoul Medical Center), Youngsil Jung, and Jinwoo Park (Department of Laboratory Medicine, National Medical Center) for their contribution to our study.
Lee J, Kim SY, and Hong KH designed the study, analyzed the data, and wrote the manuscript. Lee J, Kim SY, and Kim N conducted the experiments. Huh HJ, Hong KH, Roh KH, Kim TS, and Lee H contributed to surveillance data collection. Hong KH performed the statistical analysis and interpretation. Sung H and Lee H contributed to the conception and revision of the manuscript. All authors read and approved the final manuscript.
CONFLICTS OF INTEREST
- European Centre for Disease Prevention and Control. Options for the use of rapid antigen tests for COVID-19 in the EU/EEA and the UK. Technical Report. ECDC. Stockholm, 2020.
- Hong KH, Lee SW, Kim TS, Huh HJ, Lee J, Kim SY, et al. Guidelines for laboratory diagnosis of coronavirus disease 2019 (COVID-19) in Korea. Ann Lab Med 2020;40:351-60.
- Iglὁi Z, Velzing J, van Beek J, van de Vijver D, Aron G, Ensing R, et al. Clinical Evaluation of Roche SD Biosensor Rapid Antigen Test for SARS-CoV-2 in municipal health service testing site, the Netherlands. Emerg Infect Dis 2021;27:1323-29.
- Yamayoshi S, Sakai-Tagawa Y, Koga M, Akasaka O, Nakachi I, Koh H, et al. Comparison of rapid antigen tests for COVID-19. Viruses 2020;12:1420.
- Corman VM, Haage VC, Bleicker T, Schmidt ML, Mühlemann B, Zucho wski M, et al. Comparison of seven commercial SARS-CoV-2 rapid point-of-care antigen tests: a single-centre laboratory evaluation study. Lancet Microbe 2021 Apr 7. doi: 10.1016/S2666-5247(21)00056-2.
- Olearo F, Nörz D, Heinrich F, Sutter JP, Rödel K, Schultze A, et al. Handling and accuracy of four rapid antigen tests for the diagnosis of SARS-CoV-2 compared to RT-qPCR. J Clin Virol 2021;137:104782.
- Pray IW, Ford L, Cole D, Lee C, Bigouette JP, Abedi GR, et al. Performance of an antigen-based test for asymptomatic and symptomatic SARS-CoV-2 testing at two university campuses-Wisconsin, September-October 2020. MMWR Morb Mortal Wkly Rep 2021;69:1642-7.
- Cerutti F, Burdino E, Milia MG, Allice T, Gregori G, Bruzzone B, et al. Urgent need of rapid tests for SARS CoV-2 antigen detection: evaluation of the SD-Biosensor antigen test for SARS-CoV-2. J Clin Virol 2020;132:104654.
- Mahase E. Covid-19: Innova lateral flow test is not fit for "test and release" strategy, say experts. BMJ 2020;371:m4469.
- Wise J. Covid-19: lateral flow tests miss over half of cases, Liverpool pilot data show. BMJ 2020;371:m4848.
- Deeks JJ and Raffle AE. Lateral flow tests cannot rule out SARS-CoV-2 infection. BMJ 2020;371:m4787.
- Schildgen V, Demuth S, Lüsebrink J, Schildgen O. Limits and opportunities of SARS-CoV-2 antigen rapid tests-an experience-based perspective. Pathogens 2021;10:38.
- Burstyn I, Goldstein ND, Gustafson P. Towards reduction in bias in epidemic curves due to outcome misclassification through Bayesian analysis of time-series of laboratory test results: case study of COVID-19 in Alberta, Canada and Philadelphia, USA. BMC Med Res Methodol 2020;20:146.
- Huh HJ, Hong KH, Kim TS, Song SH, Roh KH, Lee H, et al. Surveillance of coronavirus disease 2019 (COVID-19) testing in clinical laboratories in Korea. Ann Lab Med 2021;41:225-9.
- Scohy A, Anantharajah A, Bodéus M, Kabamba-Mukadi B, Verroken A, Rodriguez-Villalobos H. Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis. J Clin Virol 2020;129:104455.
- Dinnes J, Deeks JJ, Adriano A, Berhane S, Davenport C, Dittrich S, et al. Rapid, point‐of‐care antigen and molecular‐based tests for diagnosis of SARS‐CoV‐2 infection. Cochrane Database Syst Rev 2020;8:CD013705.
- Liotti FM, Menchinelli G, Lalle E, Palucci I, Marchetti S, Colavita F, et al. Performance of a novel diagnostic assay for rapid SARS-CoV-2 antigen detection in nasopharynx samples. Clin Microbiol Infect 2020;27:487-8.
- Lee S, Kim T, Lee E, Lee C, Kim H, Rhee H, et al. Clinical course and molecular viral shedding among asymptomatic and symptomatic patients with SARS-CoV-2 infection in a community treatment center in the Republic of Korea. JAMA Intern Med 2020;180:1447-52.
- Lee W, Hwang SS, Song I, Park C, Kim H, Song IK, et al. COVID-19 in South Korea: epidemiological and spatiotemporal patterns of the spread and the role of aggressive diagnostic tests in the early phase. Int J Epidemiol 2020;49:1106-16.
- Wise J. Covid-19: safety of lateral flow tests questioned after they are found to miss half of cases. BMJ 2020;371:m4744.