Article

Original Article

Ann Lab Med 2021; 41(6): 577-587

Published online November 1, 2021 https://doi.org/10.3343/alm.2021.41.6.577

Copyright © Korean Society for Laboratory Medicine.

Comparison of SARS-CoV-2 Antibody Responses and Seroconversion in COVID-19 Patients Using Twelve Commercial Immunoassays

Sojeong Yun , B.S.1, Ji Hyeong Ryu , M.S.2, Joo Hee Jang , B.S.1, Hyunjoo Bae , M.S.1, Seung-Hyo Yoo , M.T.2, Ae-Ran Choi , M.T.2, Sung Jin Jo , M.D.3, Jihyang Lim , M.D.3, Jehoon Lee , M.D.3, Hyejin Ryu , M.D.4, Sung-Yeon Cho , M.D.5,6, Dong-Gun Lee , M.D.5,6, Jongmin Lee , M.D.7, Seok Chan Kim , M.D.7, Yeon-Joon Park , M.D.2, Hyeyoung Lee , M.D.8, and Eun-Jee Oh, M.D.2

1Department of Biomedicine & Health Sciences, Graduate School, The Catholic University of Korea, Seoul, Korea; 2Department of Laboratory Medicine, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea; 3Department of Laboratory Medicine, Eunpyeong St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea; 4Samkwang Medical Laboratories, Seoul, Korea; 5Division of Infectious Diseases, Department of Internal Medicine, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea; 6Vaccine Bio Research Institute, College of Medicine, The Catholic University of Korea, Seoul, Korea; 7Division of Pulmonary, Allergy and Critical Care Medicine, Department of Internal Medicine, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea; 8Department of Laboratory Medicine, Catholic Kwandong University International St. Mary’s Hospital, Incheon, Korea

Correspondence to: Eun-Jee Oh, M.D., Ph.D.
Department of Laboratory Medicine, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul 06591, Korea
Tel: +82-2-2258-1641
Fax: +82-2-2258-1719
E-mail: ejoh@catholic.ac.kr

Received: January 12, 2021; Revised: March 12, 2021; Accepted: May 18, 2021

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Background: Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) antibody assays have high clinical utility in managing the pandemic. We compared antibody responses and seroconversion of coronavirus disease 2019 (COVID-19) patients using different immunoassays.
Methods: We evaluated 12 commercial immunoassays, including three automated chemiluminescent immunoassays (Abbott, Roche, and Siemens), three enzyme immunoassays (Bio-Rad, Euroimmun, and Vircell), five lateral flow immunoassays (Boditech Med, SD biosensor, PCL, Sugentech, and Rapigen), and one surrogate neutralizing antibody assay (GenScript) in sequential samples from 49 COVID-19 patients and 10 seroconversion panels.
Results: The positive percent agreement (PPA) of assays for a COVID-19 diagnosis ranged from 84.0% to 98.5% for all samples (>14 days after symptom onset), with IgM or IgA assays showing higher PPAs. Seroconversion responses varied across the assay type and disease severity. Assays targeting the spike or receptor-binding domain protein showed a tendency for early seroconversion detection and higher index values in patients with severe disease. Index values from SARS-CoV-2 binding antibody assays (three automated assays, one LFIA, and three EIAs) showed moderate to strong correlations with the neutralizing antibody percentage (r=0.517–0.874), and stronger correlations in patients with severe disease and in assays targeting spike protein. Agreement among the 12 assays was good (74.3%–96.4%) for detecting IgG or total antibodies.
Conclusions: Positivity rates and seroconversion of SARS-CoV-2 antibodies vary depending on the assay kits, disease severity, and antigen target. This study contributes to a better understanding of antibody response in symptomatic COVID-19 patients using currently available assays.

Keywords: SARS-CoV-2 antibody, Immunoassays, Neutralizing antibody, Seroconversion, Correlation, Disease severity, Positive percent agreement

Coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has become a global pandemic with continued transmission [1, 2]. Since there are currently no effective treatments for COVID-19, considerable efforts are focused on developing vaccines and therapeutic drugs [3]. However, the dynamics of humoral immune responses of COVID-19 patients using different serological assay platforms are largely unclear.

A wide range of SARS-CoV-2 binding antibody assays have been developed with different antigen targets and assay formats [4]. These assays can detect either isotype-specific antibodies (IgG, IgA, IgM) or total antibodies based on different assay principles such as chemiluminescent immunoassay (CLIA), enzyme immunoassay (EIA), lateral flow immunoassay (LFIA), and microsphere-based antibody assay. Most of these assays mainly target either spike (S) protein (the most exposed viral protein) or its receptor-binding domain (RBD), or nucleocapsid (N) protein, which is abundantly expressed. Although the performance and clinical utility of different binding antibody assays continue to be identified, the currently available assays show variable performance, and data on the early immune response and seroconversion are insufficient [46]. Many questions have also been raised about the index value of antibody assays for COVID-19 monitoring.

There is great interest in identifying SARS-CoV-2 neutralizing antibodies for measuring immune status and assessing vaccine responses. Neutralizing antibodies against both the viral S and N proteins have been found in COVID-19 patients, pointing to the potential value of SARS-CoV-2 binding antibody assays as a surrogate for neutralizing titers [79]. A SARS-CoV-2 surrogate virus neutralization test (sVNT) (GenScript Inc., Leiden, the Netherlands) is available for detecting neutralizing antibodies that block the interaction between angiotensin-converting enzyme 2 (ACE2) receptor protein and the RBD. However, limited data are available correlating the results of commercial assays with the presence of neutralizing antibodies detected by the sVNT.

We compared the serological characteristics and seroconversion ability in serial serum samples from COVID-19 patients using 12 commercial antibody assays: three automated, high-throughput CLIAs [SARS-CoV-2 IgG assay (Abbott, Chicago, IL, USA), Elecsys Anti-SARS-CoV-2 assay (Roche, Basel, Switzerland), and SARS-CoV-2 Total assay (Siemens, Munich, Germany)]; three EIAs [COVID-19 ELISA IgM+IgA and COVID-19 ELISA IgG (Vircell Microbiologists, Granada, Spain), anti-SARS-COV-2 ELISA (IgA) and anti-SARS-COV-2 ELISA (IgG) (Euroimmun AG, Lübeck, Germany), and Platelia SARS-CoV-2 Total Ab (BioRad Laboratories, Hercules, CA, USA)]; five LFIAs [ichroma COVID-19 Ab (Boditech Med Inc., Gangwon-do, Korea), STANDARD Q COVID-19 IgM/IgG Combo assay (SD Biosensor Inc., Gyeonggi-do, Korea), PCL COVID-19 IgG/IgM Rapid Gold (PCL Inc., Seoul, Korea), SGTi-flex COVID-19 IgM/IgG (Sugentech Inc., Daejeon, Korea), and Biocredit COVID-19 IgG+IgM Duo (Rapigen Inc., Gyeonggi-do, Korea)]; and one SARS-CoV-2 sVNT (GenScript Inc., Piscataway, NJ, USA). To our knowledge, this is the first study to compare 12 SARS-CoV-2 antibody assays using various assay platforms for assessing the early antibody response, seroconversion, neutralizing capacity, and association with disease severity during the early infection period in COVID-19 patients.

Patients and samples

For antibody response assessment, we retrieved 139 serial serum samples from 49 COVID-19 patients. All diagnoses were confirmed by real-time RT-PCR testing between March 2020 and October 2020 at Seoul St. Mary’s Hospital, Eunpyeong St. Mary’s Hospital, or Samkwang Medical Laboratories, Seoul, Korea. We also retrieved 195 serum samples from healthy donors to assess the negative percent agreement (NPA), including 95 serum samples collected before November 2019 (in the pre-COVID-19 period) and 100 serum samples from organ donors who tested negative for SARS-CoV-2 by real-time RT-PCR at Seoul St. Mary’s Hospital. Real-time RT-PCR with nasopharyngeal swabs was performed in the three laboratories using an Allplex 2019-nCoV Real-time PCR kit (Seegene, Seoul, Korea), PowerChek 2019-nCoV kit (KogeneBiotech, Seoul, Korea), or Real-Q 2019-nCoV Real-Time Detection kit (BioSewoom, Seoul, Korea), according to each manufacturer’s instructions. Serum remnants were retrieved from blood samples collected for routine laboratory assays. All serum samples were stored at 4°C for up to two weeks and aliquoted for assessment. Serum aliquots were stored at −80°C before the assays. Due to insufficient sample volumes, only 109 consecutive serum samples from 36 patients were subjected to the EIAs from Euroimmun, Vircell, and BioRad.

To assess the seroconversion response, we retrieved 75 serum samples from 10 COVID-19 patients during hospitalization at Seoul St. Mary’s Hospital. Each patient’s seroconversion sera set consisted of at least five serial samples with an initially SARS-CoV-2 antibody-negative result from any available commercial assay. Clinical data for the day after symptom onset and disease severity were collected retrospectively from electronic medical records. Disease course was classified as mild, severe, or critical, according to a previous definition [1]. The 10 seroconversion cases comprised six mild cases and four severe cases, including one critical case. All 75 samples used for seroconversion evaluation were subjected to all 12 assays.

This study was approved by the Institutional Review Board (IRB) of the respective institutions (XC20SIDI0069, Seoul and Eunpyeong St. Mary’s Hospitals; S-IRB-2020-007-05-15, Samkwang Medical Laboratories). The requirement for written informed consent was waived by the IRBs because of the retrospective study design.

SARS-CoV-2 antibody assays

All samples were assessed using 11 SARS-CoV-2 binding antibody assays and one sVNT (GenScript). Detailed descriptions of the assay kits are shown in Supplemental Data Table S1. All assays were performed at Seoul St. Mary’s Hospital, according to the manufacturers’ instructions. For the eight assays that present unit or index values (Boditech-IgM and -IgG, Vircell-IgM+IgA and -IgG, Euroimmun-IgA and -IgG, BioRad-Total Ig, Abbott-IgG, Siemens-Total IgG, Roche-Total IgG, and GenScript), we compared quantitative antibody responses of seroconversion panels in patients with a severe or mild disease course. The correlation between SARS-CoV-2 binding antibody assay and sVNT results was also analyzed.

Statistical analysis

Agreement between assays was calculated using the Cohen kappa agreement value. Kappa values were categorized as slight (0–0.20), fair (0.21–0.40), moderate (0.41–0.60), substantial (0.61–0.80), and excellent (0.81–1.00) [10]. Pearson correlation coefficients were calculated for correlations between SARS-CoV-2 binding antibody assay and sVNT results, which were defined as strong (0.7–1.0), moderate (0.5–0.7), and weak (0.3–0.5)[11]; Spearman correlation coefficients greater than 0.5 were deemed strong, those below 0.3 were deemed weak, and those between 0.3 and 0.5 were deemed moderate. Graphs were created with Graph Pad Prism 9.0 (GraphPad Software, Inc., San Diego, CA, USA) and Microsoft Excel 2016 (Microsoft Co., Santa Rosa, CA, USA). The positive percent agreement (PPA) for COVID-19 diagnosis was assessed based on days from symptom onset. To demonstrate PPAs, samples were divided into the following eight groups according to days from symptom onset: 2–5 days, 6–8 days, 9–10 days, 11–13 days, 14–16 days, 17–20 days, 21–27 days, and 28–40 days (Supplemental Data Fig. S1). In addition, PPA and NPA of kits were calculated in three groups according to days from symptom onset: 0–7, 8–14, and >14 days (Table 1). PPA, NPA, and correlation coefficients were calculated using MedCalc version 19.6 (MedCalc Software Ltd., Ostend, Belgium). P<0.05 was considered statistically significant.

Table 1 . Positive and negative percent agreement of 12 SARS-CoV-2 antibody assays

Days from symptom onsetCLIAEIALFIAsVNT




AbbottSiemensRocheEuroimmunVircellBioRadBoditechSD biosensorPCLSugentechRapigenGenScript












IgG (%)Total (%)Total (%)IgA (%)IgG (%)IgM+IgA (%)IgG (%)Total (%)IgM (%)IgG (%)IgM (%)IgG (%)IgM (%)IgG (%)IgM (%)IgG (%)IgM (%)IgG (%)IgG (%)
PPA< 8*40.024.040.021.115.847.442.147.440.032.044.040.040.024.056.032.036.036.040.0
8–1471.463.375.582.555.072.577.590.073.575.583.769.483.771.491.873.587.875.585.7
> 1492.387.789.290.090.094.084.092.086.296.996.992.392.393.898.590.893.889.298.5
NPANA§100.0100.0100.094.9100.097.4100.099.598.599.099.0100.099.098.596.4100.099.097.9NT

*Includes 25 samples from 22 patients for CLIAs, sVNTs, and LFIAs; 19 samples from 16 patients for EIAs. Includes 49 samples from 34 patients for CLIAs, sVNTs, and LFIAs; 40 samples from 25 patients for EIAs. Includes 65 samples from 25 patients for CLIAs, sVNTs, and LFIAs; 50 samples from 18 patients for EIAs. §N patients=195.

Abbreviations: PPA, positive percent agreement; NPA, negative percent agreement; CLIA, chemiluminescence immunoassay; EIA, enzyme immunoassay; LFIA, lateral flow immunoassay; sVNT, surrogate virus neutralization test; NA, not applicable; NT, not tested.


Positive and negative percent agreement

As shown in Supplemental Data Fig. S1, the two EIAs and five LFIAs detected IgM or IgA isotype antibodies separately from IgG. IgM or IgA antibody assays tended to have a higher detection rate than the IgG assays, especially in the early infection period (<14 days from symptom onset).

The serum samples were then subdivided into three groups according to days from symptom onset: 0–7, 8–14, and >14 days. The PPA of the 12 antibody assays for each group are shown in Table 1. For samples collected >14 days after symptom onset, the PPA ranged from 87.7% to 92.3% for the CLIAs, from 84.0% to 94.0% for the EIAs, from 86.2% to 98.5% for the five LFIAs, and 98.5% for sVNT.

The NPA was evaluated for the 11 SARS-CoV-2 binding antibody assays, except the sVNT, using the 195 COVID-19–negative sera. All the three CLIAs showed no false-positive results with NPAs of 100%. The NPA for the EIAs and LFIAs ranged from 94.9% to 100%. No sample exhibited false-positivity in the majority of assays.

Seroconversion positivity

To compare the time to seropositivity between assays, the numbers of positive bleeds per total number of serial bleeds were calculated (Table 2). Evaluation of the 10 seroconversion panels consisting of 75 serum samples showed that the ratio of positive bleeds was higher in IgM or IgA assays than in IgG assays except for the results from Vircell kits. Differences in the time to seropositivity were detected between assays for each patient. The five LFIA-IgM and -IgG assays detected 76.0%–88.0% and 64.0%–74.7% seropositivity, respectively. Of the 10 patients, eight showed seroconversion up to two weeks after symptom onset using all 12 assays. Patient 3, who had a critical disease course, showed seropositivity between 18–22 days after symptom onset, whereas patient 10, who had a mild disease course, showed no seropositivity until 25 days using all three CLIAs.

Table 2 . Comparison of SARS-CoV-2 antibody assays using 10 seroconversion panels

Seroconversion panelCLIAEIA


AbbottSiemensRocheEuroimmunVircellBioRad







PatientN(Days)IgGTotalTotalIgAIgGIgM+IgAIgGTotal
19(7–30)7/9 (11)*7/9 (11)7/9 (11)7/9 (11)7/9 (11)9/9 (7)7/9 (11)9/9 (7)
28(6–21)5/8 (10)5/8 (10)5/8 (10)6/8 (9)4/8 (12)5/8 (10)5/8 (10)7/8 (8)
311(9–30)7/11 (16)5/11 (18)5/11 (18)5/11 (18)5/11 (18)1/11 (28)5/11 (18)6/11 (17)
47(3–15)7/7 (3)2/7 (10)6/7 (5)1/7 (15)2/7 (10)7/7 (3)7/7 (3)7/7 (3)
58(12–32)6/8 (16)7/8 (14)7/8 (14)8/8 (12)7/8 (14)7/8 (14)7/8 (14)8/8 (12)
67(10–24)6/7 (11)2/7 (18)6/7 (11)7/7 (10)1/7 (24)6/7 (11)7/7 (10)7/7 (10)
77(9–23)7/7 (9)7/7 (9)7/7 (9)7/7 (9)5/7 (11)7/7 (9)7/7 (9)7/7 (9)
85(5–31)4/5 (11)4/5 (11)4/5 (11)4/5 (11)4/5 (11)4/5 (11)4/5 (11)4/5 (11)
95(5–33)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)
108(5–25)0/8 ( > 25)0/8 ( > 25)0/8 ( > 25)6/8 (9)4/8 (14)6/8 (9)4/8 (14)6/8 (9)
Total7553/7543/7551/7555/7543/7556/7557/7565/75
70.7%57.3%68.0%73.3%57.3%74.7%76.0%86.7%
Seroconversion panelLFIAsVNT


Boditech MedSD biosensorPCLSugentechRapigenGenScript







PatientN(Days)IgMIgGIgMIgGIgMIgGIgMIgGIgMIgGIgG
19(7–30)8/9 (9)7/9 (11)9/9 (7)6/9 (14)8/9 (9)7/9 (11)9/9 (7)6/9 (14)8/9 (9)7/9 (11)7/9 (11)
28(6–21)5/8 (10)5/8 (10)6/8 (9)6/8 (9)5/8 (10)5/8 (10)7/8 (8)6/8 (9)6/8 (9)6/8 (9)5/8 (10)
311(9–30)6/11 (17)6/11 (17)6/11 (17)6/11 (17)5/11 (18)4/11 (22)7/11 (16)4/11 (22)6/11 (17)4/11 (22)7/11 (16)
47(3–15)7/7 (3)6/7 (5)6/7 (5)6/7 (5)6/7 (5)1/7 (12)7/7 (3)6/7 (5)6/7 (5)6/7 (5)5/7 (6)
58(12–32)8/8 (12)8/8 (12)8/8 (12)6/8 (16)8/8 (12)7/8 (14)8/8 (12)6/8 (16)8/8 (12)6/8 (16)8/8 (12)
67(10–24)7/7 (10)6/7 (11)7/7 (10)6/7 (11)7/7 (10)5/7 (12)7/7 (10)6/7 (11)7/7 (10)7/7 (10)7/7 (10)
77(9–23)7/7 (9)7/7 (9)7/7 (9)7/7 (9)7/7 (9)7/7 (9)7/7 (9)7/7 (9)7/7 (9)7/7 (9)7/7 (9)
85(5–31)0/5 ( > 31)4/5 (11)4/5 (11)5/5 (5)4/5 (11)4/5 (11)4/5 (11)4/5 (11)4/5 (11)4/5 (11)4/5 (11)
95(5–33)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)4/5 (14)
108(5–25)5/8 (11)3/8 (18)5/8 (11)1/8 (25)5/8 (11)4/8 (14)6/8 (9)1/8 (25)5/8 (11)3/8 (25)4/8 (14)
Total7557/7556/7562/7553/7559/7548/7566/7550/7561/7554/7558/75
76.0%74.7%82.7%70.7%78.7%64.0%88.0%66.7%81.3%72.0%77.3%

*Data represent numbers of positive bleeds/number of serial bleeds tested (initial positive day from symptom onset).

Abbreviations: N, number of samples; CLIA, chemiluminescence immunoassay; EIA, enzyme immunoassay; LFIA, lateral flow immunoassay; sVNT, surrogate virus neutralization test.



Seroconversion responses related to disease severity

Seroconversion responses in association with disease severity were compared among eight assays (Abbott, Siemens, Roche, Boditech, Euroimmun, Vircell, BioRad, and GenScript) based on index values and percentage (Fig. 1). The antibody values varied depending on both the assay and the disease course. In patients with severe disease courses, Siemens, Euroimmun IgG, and GenScript assays targeting the S protein or RBD showed a tendency of early detection of seroconversion with higher values. However, Roche and Abbott assays targeting the N protein antibody showed a tendency of late seroconversion and lower values in patients with severe disease courses.

Figure 1. Seroconversion detected using eight antibody assays with corresponding index values. Serial serum samples from 10 patients hospitalized for confirmed SARS-CoV-2 infection were tested. The index values against days from symptom onset are plotted. The dotted horizontal line represents the assay cut-off for positivity. Patients with a severe (patients 1, 5, 9) and critical (patient 3) disease course are indicated in red and dark red, respectively. Patients with a mild disease course (patients 2, 4, 6, 7, 8, 10) are indicated in blue. (A) Abbott–IgG, (B) Siemens - Total Ig, (C) Roche–Total Ig, (D) Euroimmun–IgA, (E) Euroimmun–IgG, (F) Vircell–IgM+IgA, (G) Vircell–IgG, (H) Biorad–Total Ig. (I) Boditech–IgM, (J) Boditech–IgG, (K) Genscript –Neutralizing antibody.

Correlation between SARS-CoV-2 binding antibody values and neutralizing antibody results

Fig. 2 shows the correlations between values of seven SARS-CoV-2 binding antibody assays (three CLIAs, three EIAs, and one LFIA) and the neutralizing antibody results (%) of the sVNT. Index values from binding antibody assays showed moderate to strong correlations with neutralizing antibody results (r=0.517–0.874). The neutralizing antibody results by sVNT correlated strongly with the results of binding antibody assays targeting S protein (Euroimmun, r=0.874; Siemens, r=0.839). Stronger correlations were found for patients with severe disease than for patients with mild disease.

Figure 2. Correlations between antibody results by SARS-CoV-2 binding assays (three CLIAs, three EIAs, and one LFIA) and the neutralizing antibody results by sVNT. (A) Correlation between index values of SARS-CoV-2 IgG (Abbott; ratio, Siemens; index, Roche; log COI, Boditech; COI) and neutralizing antibody results (%) measured in 139 samples plotted according to disease severity. (B) Correlation between index values of SARS-CoV-2 IgG (Euroimmun; ratio, Vircell; index) or total antibody binding assays (BioRad; ratio) and neutralizing antibody results (%) measured in 109 samples plotted according to disease severity. The dotted line represents the assay cutoff for positivity. *P<0.001.
Abbreviations: COI, cut-off index; r, Pearson correlation coefficient.

Agreement rates among 12 IgG or total antibody assays

Agreement rates among the 12 IgG or total antibody assays were evaluated using 139 serum samples (except for the three EIAs for which only 109 serum samples were analyzed) (Table 3). Agreement rates among assays were 80.0% or greater except for those of BioRad vs. Siemens (74.3%, kappa=0.393) and BioRad vs. Euroimmun (77.1%, kappa=0.433). There was particularly high agreement in the Roche vs. Abbott comparison (95.7%, kappa=0.883) and in the Sugentech vs. Rapigen comparison (96.4%, kappa=0.905). Comparing each binding assay and the sVNT, the agreement rates ranged from 83.5% to 91.4%, with the Boditech, PCL, and Roche assays showing higher agreement rates (91.4%, 89.9%, and 89.2%, respectively).

Table 3 . Agreement rates between 12 SARS-CoV-2 antibody (total or IgG) assays using 139 samples from 49 COVID-19 patients

CLIAEIA*LFIAsVNT




AbbottSiemensRocheEuroimmunVircellBioradBoditechSD biosensorPCLSugentechRapigenGenScript
CLIAAbbott87.8%95.7%80.7%89.0%83.5%90.6%93.5%87.8%92.8%93.5%87.8%
0.7020.8830.5630.7140.5440.7390.8270.6790.8090.8270.628
Siemens90.6%89.9%83.5%74.3%85.6%87.1%89.9%86.3%85.6%84.2%
0.7720.7840.6210.3930.6420.6860.7590.6710.6510.586
Roche86.2%92.7%85.3%92.1%92.1%92.1%92.8%93.5%89.2%
0.6880.8090.5940.7790.7880.7920.8090.8270.672
EIA*Euroimmun86.2%77.1%86.2%79.8%91.7%81.7%80.7%83.5%
0.6730.4330.6770.5450.8150.5870.5630.600
Vircell87.2%92.7%86.2%90.8%88.1%89.0%88.1%
0.5890.7920.6470.7680.6940.7140.636
Biorad87.2%80.7%81.7%80.7%83.5%84.4%
0.6050.4760.5090.4760.5440.470
LFIABoditech89.9%91.4%92.1%89.9%91.4%
0.7220.7670.7840.7220.726
SD biosensor87.1%95.0%92.8%85.6%
0.6630.8680.8090.569
PCL90.6%89.9%89.9%
0.7590.7380.707
Sugentech96.4%86.3%
0.9050.596
Rapigen85.6%
0.569

*EIAs were tested using 109 samples from 36 patients. Indicates agreement rate. indicates Kappa values.

Abbreviations: CLIA, chemiluminescence immunoassay; EIA, enzyme immunoassay; LFIA, lateral flow immunoassay; sVNT. surrogate viral neutralization test.


Expanding the testing capacity with accurate, validated, and reliable assays is critical in the response to the ongoing COVID-19 pandemic and vaccine trials [1214]. We compared 12 commercially available assays with various platforms and method principles. More than 100 LFIAs are now commercially available. Although these LFIAs are convenient for testing and are useful in small or emergency laboratories with limited resources, their clinical performance remains limited with various sensitivities and specificities [15]. We evaluated five LFIAs authorized by the Korean Food and Drug Administration for export using serum samples instead of fingerstick whole blood.

For samples obtained more than 14 days after symptom onset, the overall PPA ranged from 84.0% to 98.5%. The three automated CLIAs showed similar sensitivities. Our PPA results were generally higher than those reported previously [16] and were comparable for all 12 assays. This might be related to the studied population, as we used serum samples only from symptomatic patients. Approximately 40% of the samples were from patients with severe disease courses, highlighting the importance of determining whether the performance of an antibody assay is affected by disease stage or severity. Overall, IgM or IgA isotype assays detected seroconversion earlier than IgG assays. This result is consistent with previous data showing early detection of acute patients using IgM-based assays [17, 18]. Patient 3 was an 83-year-old man who was suspected of having delayed seroconversion due to an age-related decrease in immunity. Patient 10, who had a mild disease course, showed early seroconversion with IgM assays (9–11 days), although this patient showed late seroconversion with IgG assays (14–25 days). Interestingly, the three automated CLIAs did not detect antibodies until day 25 after symptom onset in patient 10. This might be because CLIAs have defined thresholds to improve the negative likelihood ratio [19]. We determined the index values of eight assays and their correlation with disease severity. Assays targeting the S protein or RBD showed a tendency of early detection of seroconversion with higher index values, which supports previous reports demonstrating earlier seroconversion and higher titers in patients with severe disease using EIAs targeting the S protein or RBD [2022]. However, the Roche and Abbott assays targeting the N protein antibody showed a different tendency, demonstrating later seroconversion (>14 days) and lower antibody titers in patients with severe disease (Fig. 1). This finding is similar to a previous report demonstrating delayed detection of nucleocapsid antibody in severely ill patients [20]. Although the number of patients was small, these findings suggested that the antibody response might be different according to the targeting antibodies and assay method. Since ACE2 expression varies in different ethnic populations, further studies are needed to understand the factors contributing to SARS-CoV-2 antibody responses, including genetic variability, age-related variation, and comorbidities [15].

The antibody-mediated humoral immune response is critical to prevent viral infections. The most useful information is the correlation between antibody values and a metric of protective immunity such as the neutralizing capacity [23]. The current gold standard is the conventional VNT, which shows a good correlation with the neutralizing antibody titer [7, 24]. We observed good agreement rates (>83.0%) between the 11 IgG or total binding antibody assays and the sVNT and found moderate to strong correlations (r=0.517–0.874) between the index values of binding assays and neutralizing antibody results. Neutralizing antibodies are primarily against the S1 domain, S2 domain, and RBD of the SARS-CoV-2 S protein [25, 26], suggesting that antibody assays targeting these regions might be better at predicting neutralizing capacities. As expected, the Euroimmun (targeting S1) and Siemens (targeting S1 and the RBD) assays tended to show better correlations with the sVNT (r=0.874 and r=0.839, respectively) compared with the Roche and Abbott assays (r=

0.705 and r=0.650, respectively). These results are in contrast to previous reports showing similar performances across antibody assays targeting the N and S proteins [25]. We also found that patients with severe infection showed better correlations between antibody levels and sVNT results than those with mild infection. This result confirmed previous reports showing a wide range of SARS-CoV-2 neutralizing antibody titers depending on disease severity [22, 27, 28]. Due to the limitation of using the sVNT instead of the conventional VNT, further investigation is needed to verify the immune response dynamics. Antibody detection differences can be associated with patient and assay characteristics [46].

This study has several limitations. First, because of the emergency isolation of patients with a positive molecular testing result and mild COVID-19 in Korea, serum samples of asymptotic patients were not included, and only a small number of patient samples were tested. We were also not able to evaluate the waning antibody response in each assay because of the lack of follow-up samples of discharged or transferred patients.

In summary, different SARS-CoV-2 antibody assays showed reliable performance, demonstrating a PPA of 84.0% or greater for samples tested more than 14 days after symptom onset. All assays detected seroconversion within less than two weeks for most patients without immune complications. However, their positivity rates and seroconversion of SARS-CoV-2 antibodies varied depending on the assay kits, disease severity, and antigen target. Commercial antibody assays should be further evaluated using serial samples over time. This study contributes to gaining a better understanding of the antibody response using currently available assays in symptomatic COVID-19 patients.

Conceptualization, Oh EJ; Data curation, Yoo SH and Choi AR; Formal analysis, Yun S, Lee H, and Oh EJ; Investigation, Cho SY, Lee DG, Lee J, Kim SC, Park YJ, Jo SJ, Lim J, Lee J, and Ryu H; Methodology, Yun S, Ryu JH, Jang JH, and Bae H; Supervision, Oh EJ; Writing–original draft, Yun S and Oh EJ; Writing–review and editing, Yun S, Lee H, and Oh EJ. All authors have accepted responsibility for the entire content of this submitted manuscript and approved the submission.

The authors declare no conflicts of interest. The authors alone are responsible for the content and writing of the paper. The companies had no role in the design of this study, data collection, data analyses, data interpretation, writing of the manuscript, or the decision to publish the results.

This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korean Government (MSIP; NRF-2020R1A2B5B01001859).

  1. Wu Z and McGoogan JM. Characteristics of and important lessons from the coronavirus Disease 2019 (COVID-19) outbreak in China: summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention. JAMA 2020;323:1239-42.
    Pubmed CrossRef
  2. Fong CH, Cai JP, Dissanayake TK, Chen LL, Choi CY, Wong LH, et al. Improved detection of antibodies against SARS-CoV-2 by microsphere-based antibody assay. Int J Mol Sci 2020;21:6595.
    Pubmed KoreaMed CrossRef
  3. Tu YF, Chien CS, Yarmishyn AA, Lin YY, Luo YH, Lin YT, et al. A review of SARS-CoV-2 and the ongoing clinical trials. Int J Mol Sci 2020;21:2657.
    Pubmed KoreaMed CrossRef
  4. Trabaud MA, Icard V, Milon MP, Bal A, Lina B, Escuret V. Comparison of eight commercial, high-throughput, automated or ELISA assays detecting SARS-CoV-2 IgG or total antibody. J Clin Virol 2020;132:104613.
    Pubmed KoreaMed CrossRef
  5. Charlton CL, Kanji JN, Johal K, Bailey A, Plitt SS, MacDonald C, et al. Evaluation of six commercial mid- to high-volume antibody and six point-of-care lateral flow assays for detection of SARS-CoV-2 antibodies. J Clin Microbiol 2020;58:e01361-20.
    Pubmed KoreaMed CrossRef
  6. Kohmer N, Westhaus S, Rühl C, Ciesek S, Rabenau HF. Brief clinical evaluation of six high-throughput SARS-CoV-2 IgG antibody assays. J Clin Virol 2020;129:104480.
    Pubmed KoreaMed CrossRef
  7. Tan CW, Chia WN, Qin X, Liu P, Chen MI, Tiu C, et al. A SARS-CoV-2 surrogate virus neutralization test based on antibody-mediated blockage of ACE2-spike protein-protein interaction. Nat Biotechnol 2020;38:1073-8.
    Pubmed CrossRef
  8. To KK, Tsang OT, Leung WS, Tam AR, Wu TC, Lung DC, et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. Lancet Infect Dis 2020;20:565-74.
    Pubmed KoreaMed CrossRef
  9. Klimstra WB, Tilston-Lunel NL, Nambulli S, Boslett J, McMillen CM, Gilliland T, et al. SARS-CoV-2 growth, furin-cleavage-site adaptation and neutralization using serum from acutely infected hospitalized COVID-19 patients. J Gen Virol 2020;101:1156-69.
    Pubmed KoreaMed CrossRef
  10. Landis JR and Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
    Pubmed CrossRef
  11. Mukaka MM. Statistics corner: A guide to appropriate use of correlation coefficient in medical research. Malawi Med J 2012;24:69-71.
    Pubmed KoreaMed
  12. Kim YJ, Sung H, Ki CS, Hur M. COVID-19 Testing in South Korea: Current Status and the Need for Faster Diagnostics. Ann Lab Med 2020;40:349-50.
    Pubmed KoreaMed CrossRef
  13. Hong KH, Lee SW, Kim TS, Huh HJ, Lee J, Kim SY, et al. Guidelines for Laboratory Diagnosis of Coronavirus Disease 2019 (COVID-19) in Korea. Ann Lab Med 2020;40:351-60.
    Pubmed KoreaMed CrossRef
  14. Huh HJ, Hong KH, Kim TS, Song SH, Roh KH, Lee H, et al. Surveillance of coronavirus disease 2019 (COVID-19) testing in clinical laboratories in Korea. Ann Lab Med 2021;41:225-9.
    Pubmed KoreaMed CrossRef
  15. Choudhary S, Sreenivasulu K, Mitra P, Misra S, Sharma P. Role of genetic variants and gene expression in the susceptibility and severity of COVID-19. Ann Lab Med 2021;41:129-38.
    Pubmed KoreaMed CrossRef
  16. Cota G, Freire ML, de Souza CS, Pedras MJ, Saliba JW, Faria V, et al. Diagnostic performance of commercially available COVID-19 serology tests in Brazil. Int J Infect Dis 2020;101:382-90.
    Pubmed KoreaMed CrossRef
  17. Liu X, Wang J, Xu X, Liao G, Chen Y, Hu CH. Patterns of IgG and IgM antibody response in COVID-19 patients. Emerg Microbes Infect 2020;9:1269-74.
    Pubmed KoreaMed CrossRef
  18. Lee CY-P, Lin RTP, Renia L, Ng LFP. Serological approaches for COVID-19: epidemiologic perspective on surveillance and control. Front Immunol 2020;11:879.
    Pubmed KoreaMed CrossRef
  19. Plebani M, Padoan A, Negrini D, Carpinteri B, Sciacovelli L. Diagnostic performances and thresholds: the key to harmonization in serological SARS-CoV-2 assays? Clin Chim Acta 2020;509:1-7.
    Pubmed KoreaMed CrossRef
  20. Zilla M, Wheeler BJ, Keetch C, Mitchell G, McBreen J, Wells A, et al. Variable performance in 6 commercial SARS-CoV-2 antibody assays may affect convalescent plasma and seroprevalence screening. Am J Clin Pathol 2021;155:343-53.
    Pubmed KoreaMed CrossRef
  21. Zhao J, Yuan Q, Wang H, Liu W, Liao X, Su Y, et al. Antibody responses to SARS-CoV-2 in patients with novel coronavirus disease 2019. Clin Infect Dis 2020;71:2027-34.
    Pubmed KoreaMed CrossRef
  22. Okba NMA, Müller MA, Li W, Wang C, GeurtsvanKessel CH, Corman VM, et al. Severe acute respiratory syndrome coronavirus 2-specific antibody responses in coronavirus disease patients. Emerg Infect Dis 2020;26:1478-88.
    Pubmed KoreaMed CrossRef
  23. GeurtsvanKessel CH, Okba NMA, Igloi Z, Bogers S, Embregts CWE, Laksono BM, et al. An evaluation of COVID-19 serological assays informs future diagnostics and exposure assessment. Nat Commun 2020;11:3436.
    Pubmed KoreaMed CrossRef
  24. Bošnjak B, Stein SC, Willenzon S, Cordes AK, Puppe W, Bernhardt G, et al. Low serum neutralizing anti-SARS-CoV-2 S antibody levels in mildly affected COVID-19 convalescent patients revealed by two different detection methods. Cell Mol Immunol 2021;18:936-44.
    Pubmed KoreaMed CrossRef
  25. Tang MS, Case JB, Franks CE, Chen RE, Anderson NW, Henderson JP, et al. Association between SARS-CoV-2 neutralizing antibodies and commercial serological assays. Clin Chem 2020;66:1538-47.
    Pubmed KoreaMed CrossRef
  26. Brouwer PJM, Caniels TG, van der Straten K, Snitselaar JL, Aldon Y, Bangaru S, et al. Potent neutralizing antibodies from COVID-19 patients define multiple targets of vulnerability. Science 2020;369:643-50.
    Pubmed KoreaMed CrossRef
  27. Seow J, Graham C, Merrick B, Acors S, Pickering S, Steel KJA, et al. Longitudinal observation and decline of neutralizing antibody responses in the three months following SARS-CoV-2 infection in humans. Nat Microbiol 2020;5:1598-607.
    Pubmed KoreaMed CrossRef
  28. Luchsinger LL, Ransegnola BP, Jin DK, Muecksch F, Weisblum Y, Bao W, et al. Serological assays estimate highly variable SARS-CoV-2 neutralizing antibody activity in recovered COVID-19 patients. J Clin Microbiol 2020;58:e02005-20.
    Pubmed KoreaMed CrossRef