Ann Lab Med 2019; 39(1): 31-35  https://doi.org/10.3343/alm.2019.39.1.31
Evaluation of the SD Bioline Strep A Ultra Test in Relation With Number of Colony Forming Units and Color Intensity
Sang Hyuk Ma, M.D.1, Won-Hee Choi, Ph.D.2, Hyunwoong Park, M.D.3, and Sunjoo Kim, M.D.4,5*

1Department of Pediatrics, Changwon Fatima Hospital, Changwon, Korea.

2Department of Nursing Science, Kyungsung University, Busan, Korea.

3Department of Laboratory Medicine, Seoul National University Boramae Medical Center, Seoul, Korea.

4Department of Laboratory Medicine, Gyeongsang National University College of Medicine, Jinju, Korea.

5Gyeongsang Institute of Health Sciences, Jinju, Korea.

Corresponding author: Sunjoo Kim, M.D. Department of Laboratory Medicine, Gyeongsang National University College of Medicine, 79 Gangnam-ro, Jinju 52727, Korea. Tel: +82-55-214-3072, Fax: +82-55-214-3087, sjkim8239@hanmail.net
Received: December 27, 2017; Revised: June 14, 2018; Accepted: August 27, 2018; Published online: September 13, 2018.
© Korean Society for Laboratory Medicine. All rights reserved.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract

Background

The SD Bioline Strep A Ultra (SD, Yongin, Korea) is a recently developed rapid antigen detection test (RADT) for diagnosing bacterial pharyngitis caused by Group A Streptococcus, We evaluated the performance of SD Bioline Strep A Ultra, using the number of colony forming units and color intensity.

Methods

Three throat swabs each were taken from 343 children with pharyngitis who visited pediatric clinics. We evaluated the performance of SD Bioline Strep A Ultra and compared its positive rate with the number of colony forming units, using the Fisher exact test.

Results

The sensitivity, specificity, positive predictive value, and negative predictive value (95% confidence interval) were 97.4% (94.0–99.1%), 90.8% (85.0–94.9%), 93.0% (88.5–96.1%), and 96.5% (92.0–98.9%), respectively. Positive rate significantly differed by number of colony forming units (P=0.021). ROC plot for color intensity showed 0.938 of AUC (area under curve).

Conclusions

SD Bioline Strep A Ultra showed excellent performance, and its positive rate differed by the number of colony counts. This RADT could be used as a sensitive and semi-quantitative method detecting bacterial pharyngitis.

Keywords: Group A Streptococcus, Pharyngitis, Rapid antigen detection test, Evaluation
INTRODUCTION

Group A Streptococcus (GAS) is the most common cause of bacterial pharyngitis. Streptococcal pharyngitis is characterized by an acute onset, high fever, exudative tonsillar discharge, tenderness of enlarged cervical lymph nodes, pharyngeal injection, and the absence of common cold symptoms such as coughing, sneezing, and rhinorrhea [1, 2, 3]. Prevalence of bacterial pharyngitis ranges from 20% to 30% in children 5–15 years old during winter season [3, 4]. The modified Centor score is widely used to clinically analyze acute pharyngitis [1, 2, 4]. However, differentiation between bacterial and viral pharyngitis based solely on clinical manifestations is challenging [4, 5, 6].

Antibiotic treatment for GAS pharyngitis may relieve the symptoms, prevent transmission to family members and classmates, and prevent suppurative and non-suppurative complications [1, 4, 7]. To ensure proper antibiotic treatment and prevent antibiotic overuse or misuse, a throat culture or rapid antigen detection test (RADT) has been recommended for suspected bacterial pharyngitis [5, 6]. In particular, RADTs are recommended as a screening test for children with acute pharyngitis [7, 8]. RADTs have the advantage of rapid turnaround time and ease of use and do not require a bacterial culture facility. However, meta-analyses have shown that their sensitivity is approximately 86% [8, 9]; hence, a back-up throat culture might be needed [1, 3, 6, 10]. An existing RADT, SD Bioline Strep A (SD, Yongin, Korea), has a higher sensitivity of 95.9% [11], but there is some debate regarding the need for a back-up throat culture for children with suspected bacterial pharyngitis who show a negative RADT result [2, 9, 12].

Although throat culture is regarded as the gold standard for diagnosis of bacterial pharyngitis (sensitivity: 90–95% [13]), it requires microbiological expertise [14]. Culture yield is largely dependent on streaking on blood agar plates and colony isolation skill. Moreover, it takes at least one to two days to obtain the final result, which makes it difficult to prescribe antibiotics in time. Antibiotics are less appropriately prescribed when throat culture alone is used than when both throat culture and RADTs are used to diagnose bacterial pharyngitis [15].

A sensitive, accurate, and easy to use RADT is needed. While the currently available SD Bioline Strep A uses the antigen extraction solution and buffer separately [11], a recently developed RADT, SD Bioline Strep A Ultra (SD), contains these in the same tube, which facilitates its use in clinics and laboratories. In addition, SD Bioline Strep A is a strip-type test, while SD Bioline Strep A Ultra is a semi-quantitative device-type test that provides a color intensity chart representing the bacterial concentration in the pharynx. Thus, a more objective interpretation is possible in SD Bioline Strep A Ultra. We conducted a clinical evaluation of SD Bioline Strep A Ultra in children with acute pharyngitis.

METHODS

Study population

Throat swabs were taken from 349 pharyngitis patients from April through September 2017 at seven pediatric clinics in Changwon, Korea. Three hundred and forty-three children were included, and six adults were excluded. Of the children, 167 (48.7%) were boys, and the mean age was 5.4 years (standard deviation 2.6 years, range 1–17 years). This study was approved by the Institutional Review Board (no. 2016-10-013) of Gyeongsang National University Changwon Hospital (GNUCH). Written informed consent was obtained from the children's parents or guardians.

RADT and throat culture

Three throat swabs were collected from each child. For SD Bioline Strep A Ultra A, a flocked swab (FLOQSwabs, Copan Diagnostics Inc., Murrieta, CA, USA) was used. For SD Bioline Strep A and throat culture, two wooden cotton swabs were obtained and inserted into Amies transport medium (AM608-2S; Asan Pharmaceutical, Hwasung, Korea). Five clinics used the flocked swab first, while the other two clinics used the cotton swabs first. Transport media containing the two cotton swabs were stored at 4℃ until delivery to GNUCH (approximately 1–3 days). SD Bioline Strep A Ultra was performed by the laboratory technicians or pediatricians in the clinics, according to the manufacturer's instructions. The test results and the color intensity of the positive tests were recorded. The color intensity ranged from 1 to 20 and was read manually. A positive result was defined as a color intensity ≥1. The throat culture positive rate was evaluated according to four arbitrarily categorized color intensity ranges of SD Bioline Strep A Ultra: 1–5, 6–10, 11–15, and 16–20. SD Bioline Strep A (as described by Kim [11]) and throat culture were performed as soon as the transport tubes were delivered to GNUCH.

The swabs were inoculated on blood agar plates, and a bacitracin disk was placed on the primary streaking area. After the plates were incubated for 18–24 hours at 37℃, small, wide, β-hemolytic colonies were subjected to latex agglutination with a Seroiden Strepto kit (Eiken Co., Tokyo, Japan). Inhibition surrounding the bacitracin disk was recorded, and the number of colony forming units (CFUs) was classified into four categories: 1–10 CFU, 11–50 CFU, 51–100 CFU, and >100 CFU or pure culture. Positive rates of SD Bioline Strep A Ultra were compared with the number of CFUs. The SD Bioline Strep A Ultra results were unknown until the end of the study.

PCR amplification of speB

In cases of discrepancy between SD Bioline Strep A and throat culture results, the frozen-stored cotton swabs used for throat culture were tested for the speB gene to confirm GAS, using the AccuPower Taq PCR Premix (Bioneer, Daejeon, Korea). Unfortunately, not all samples with discrepant results had been stored. The speB gene was PCR amplified (forward primer, 5′-GGTTCTGCAGGTAGCTCTCG-3′; reverse primer, 5′-TGCCTACAACAGCACTTTGG-3′) with the following PCR cycling conditions: 5 minutes inactivation at 95℃, followed by 35 cycles of amplification at 95℃ for 30 seconds, 58℃ for 30 seconds, and 72℃ for 45 seconds, and a final extension at 72℃ for 7 minutes [16]. A clinical isolate of GAS was used as the positive control, and distilled water was used as the negative control.

Statistics

To determine the accuracy of SD Bioline Strep A Ultra and SD Bioline Strep A, we calculated their sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) with 95% confidence intervals (CIs). To estimate the diagnostic accuracy of SD Bioline Strep A Ultra, we generated an ROC curve and calculated the area under the ROC curve (AUC). The positive rate of the two RADTs was compared with the number of CFUs. In addition, the throat culture positive rates according to the four-color intensity categories (1–5, 6–10, 11–15, and 16–20) of SD Bioline Strep A Ultra were calculated, and their proportions were compared using the Fisher exact test. Statistical analyses were performed using SAS version 9.3 (SAS Institute Inc., Cary, NC, USA) and R version 3.4.2 (R Foundation for Statistical Computing, Vienna, Austria). P<0.05 (two-tailed) was considered statistically significant.

RESULTS

Positive rates

The SD Bioline Strep A Ultra, SD Bioline Strep A, and throat culture positive rates were 58.3% (N=200), 55.7% (N=191), and 55.7% (N=191), respectively (Table 1). Of the 200 children that tested positive with SD Bioline Strep A Ultra, 54 were four years old, 39 were five years old, 33 were six years old, and 22 were three years old. Only eight were over nine years old. All GAS isolates were susceptible to bacitracin. Other groups of β-hemolytic streptococci were not isolated.

Performance of the RADTs

Sensitivity, specificity, PPV, and NPV (95% CI) were 97.4% (94.0–99.1%), 90.8% (85.0–94.9%), 93.0% (88.5–96.1%), and 96.5% (92.0–98.9%), respectively, for SD Bioline Strep A Ultra. Sensitivity, specificity, PPV, and NPV (95% CI) were 95.8% (91.9–98.2%), 94.7% (88.9–97.7%), 95.8% (91.9–98.2%), and 94.7% (90.0–97.7%), respectively, for SD Bioline Strep A.

PCR

Seven samples showing discrepant results between SD Bioline Strep A Ultra and throat culture were confirmed by PCR. All three samples that were SD Bioline Strep A Ultra-positive and culture-negative were positive for PCR amplification of the speB gene. All four samples that were SD Bioline Strep A Ultra-negative and culture-positive were positive by PCR.

Number of CFUs and color intensity

When positive rate and the number of CFUs were compared, the positive rate of SD Bioline Strep A Ultra and SD Bioline Strep A ranged from 85.7 to 100% (P=0.021) and 78.6 to 98.3% (P=0.015), respectively (Table 2).

When color intensity and GAS positivity determined by throat culture were compared, the frequency of GAS positivity ranged from 84.1% to 100% (Table 3, P<0.001). The AUC based on color intensity was 0.938 (95% CI, 0.911–0.965; Fig. 1).

DISCUSSION

In this clinical evaluation of SD Bioline Strep A Ultra, the high prevalence (>50%) of GAS may have improved the accuracy of both RADTs. Their sensitivities were much higher than the average (86%) reported previously [8, 9].

Confirmation of the discrepant results with speB PCR indicated that SD Bioline Strep A Ultra-positive and culture-negative samples were true positive, not false positive. GAS may fail to be isolated by throat culture, which raises the question of whether throat culture should be regarded as the gold standard, in comparison with a more sensitive detection method [13]. An SD Bioline Strep A Ultra-positive and culture-negative sample had a color intensity of 1, suggesting misreading of the color. Although the pediatricians and technicians were trained prior to study initiation, optimal standardization of reading the weak color may be difficult.

Most previous RADT studies were qualitative and did not analyze the number of CFUs, which might have caused differences in their results [2, 12, 15]. In our study, RADT sensitivity was lower when the number of CFUs was smaller (Table 2). Similar results were observed when the inoculum effect of a single swab and two combined swabs were compared in a previous study [12].

Among samples with a color intensity of 1–10, 86.1% (99/115) were positive by throat culture. In contrast, among samples with a color intensity >10, 97.5% (79/81) were positive by throat culture. Color intensity seems strongly related to GAS positivity (Table 3); future studies should investigate the usefulness of this color intensity chart.

This study had several limitations. First, we used different types of swabs. As the two cotton swabs were inserted into the same transport tube, the agreement between SD Bioline Strep A and throat culture appears better. In general, flocked swabs collect a higher number of organisms than cotton swabs do [17, 18]. This might have caused a slight difference in performance between the tests. Another possible limitation is that different numbers of GAS could have been obtained between the first and second swab. The sampling order or throat swab technique might have affected the results because of spectrum size and GAS distribution [10, 12]. In addition, as the pediatric clinics did not have a facility for growing bacteria, transport media containing cotton swabs should be delivered to GNUCH. As we collected the samples from seven clinics, delivery was delayed at times, especially during weekends and holidays. Although GAS can survive several days in the transport medium at 4℃, decay may have occurred during the delayed delivery. This factor might have caused the lower yield observed for SD Bioline Strep A and throat culture.

In conclusion, SD Bioline Strep A Ultra exhibited excellent sensitivity and NPV and performance similar to the currently used SD Bioline Strep A, in comparison with throat culture. Three of the SD Bioline Strep A Ultra-positive and culture-negative samples were positive for speB gene amplification, suggesting that these cases may be not false positive. In addition, the positive rate of SD Bioline Strep A Ultra differed by the number of CFUs of GAS.

Authors' Disclosures of Potential Conflicts of Interest

No potential conflicts of interest relevant to this article were reported.

Acknowledgment

The authors sincerely thank the pediatricians who participated in this clinical study. In addition, we wish to thank the Green Cross LabCell team for transport of the samples, Jungin Heo, MT, for her dedicated work of bacterial isolation, and Rok-bum Kim, MD, Gyeongsang National University Hospital, for his excellent statistical analysis.

Figures
Fig. 1.

ROC plot for color intensity of SD Bioline Ultra test.

Abbreviation: CI, confidence interval.


Tables

Comparison of SD Bioline Strep A Ultra and SD Bioline Strep A results versus throat culture

Throat cultureRapid Antigen Detection Tests (N)
SD Bioline Strep A UltraSD Bioline Strep ATotal
PositiveNegativePositiveNegative
GAS positive18651838191
GAS negative141388144152
Total200143191152343

Abbreviation: GAS, group A Streptococcus.

Positive rate of SD Bioline Strep A Ultra and SD Bioline Strep A in comparison with the number of CFUs

CFUs (N)Samples tested (N)SD Bioline Strep A Ultra*SD Bioline Strep A
Positive%Positive%
1–10141285.71178.6
11–5021211002095.2
51–100403895.03895.0
≥10011611599.111498.3

*P=0.021 by the Fisher exact test; P=0.015 by the Fisher exact test.

Abbreviation: CFU, colony forming unit.

Positive rate of GAS from throat culture in comparison with SD Bioline Strep A Ultra color intensity

Color intensitySamples tested (N)Throat culture positive samples
N(%)
0*1185(4.2)
1–55546(88.5)
5–106353(84.1)
11–155149(96.1)
15–203030(100)

*Indicates “negative.”

P<0.001 by the Fisher exact test.

Abbreviation: GAS, group A Streptococcus.

References
  1. Choby, BA. Diagnosis and treatment of streptococcal pharyngitis. Am Fam Physician, 2009;79;383-390 2009;79.
    Pubmed
  2. Edmonson, MB, Farwell, KR. Relationship between the clinical likelihood of group A streptococcal pharyngitis and the sensitivity of a rapid antigen-detection test in a pediatric practice. Pediatrics, 2005;115;280-285 2005;115.
    Pubmed
  3. Kalra, MG, Higgins, KE, Perez, ED. Common questions about streptococcal pharyngitis. Am Fam Phys, 2016;94;24-31 2016;94.
  4. Wessels, MR. Clinical practice. Streptococcal pharyngitis. N Engl J Med, 2011;364;648-655 2011;364.
    Pubmed
  5. Gerber, MA. Diagnosis and treatment of pharyngitis in children. Pediatr Clin North Am, 2005;52;729-747 2005;52vi
    Pubmed
  6. Shulman, ST, Bisno, AL, Clegg, HW, Gerber, MA, Kaplan, EL, Lee, G, et al. Clinical practice guideline for the diagnosis and management of group A streptococcal pharyngitis: 2012 update by the Infectious Diseases Society of America. Clin Infect Dis, 2012;55;1279-1282 2012;55.
    Pubmed
  7. Webb, KH, Needham, CA, Kurtz, SR. Use of a high-sensitivity rapid strep test without culture confirmation of negative results: 2 years’ experience. J Fam Pract, 2000;49;34-38 2000;49.
    Pubmed
  8. Cohen, JF, Bertille, N, Cohen, R, Chalumeau, M. Rapid antigen detection test for group A streptococcus in children with pharyngitis. Cochrane Database Syst Rev 2016;7:CD010502.
    Pubmed
  9. Lean, WL, Arnup, S, Danchin, M, Steer, AC. Rapid diagnostic tests for group A streptococcal pharyngitis: a meta-analysis. Pediatrics, 2014;134;771-781 2014;134.
    Pubmed
  10. Hall, MC, Kieke, B, Gonzales, R, Belongia, EA. Spectrum bias of a rapid antigen detection test for group A β-hemolytic streptococcal pharyngitis in a pediatric population. Pediatrics, 2004;114;182-186 2004;114.
    Pubmed
  11. Kim, S. The evaluation of SD Bioline Strep A rapid antigen test in acute pharyngitis in pediatric clinics. Korean J Lab Med, 2009;29;320-323 2009;29.
    Pubmed
  12. Kurtz, B, Kurtz, M, Roe, M, Todd, J. Importance of inoculum size and sampling effect in rapid antigen detection for diagnosis of Streptococcus pyogenes pharyngitis. J Clin Microbiol, 2000;38;279-281 2000;38.
    Pubmed
  13. Gieseker, KE, Mackenzie, T, Roe, MH, Todd, JK. Comparison of two rapid Streptococcus pyogenes diagnostic tests with a rigorous culture standard. Pediatr Infect Dis J, 2002;21;922-927 2002;21.
    Pubmed
  14. Bisno, AL. Acute pharyngitis. N Engl J Med, 2001;344;205-211 2001;344.
    Pubmed
  15. Lieu, TA, Fleisher, GR, Schwartz, JS. Clinical evaluation of a latex agglutination test for streptococcal pharyngitis: performance and impact on treatment rates. Pediatr Infect Dis J, 1988;7;847-854 1988;7.
    Pubmed
  16. Dunne, EM, Marshall, JL, Baker, CA, Manning, J, Gonis, G, Danchin, MH, et al. Detection of group A streptococcal pharyngitis by quantitative PCR. BMC Infect Dis, 2013;13;312 2013;13.
    Pubmed
  17. Hernes, SS, Quarsten, H, Hagen, E, Lyngroth, AL, Pripp, AH, Bjorvatn, B, et al. Swabbing for respiratory viral infections in older patients: a comparison of rayon and nylon flocked swabs. Eur J Clin Microbiol Infect Dis, 2011;30;159-165 2011;30.
    Pubmed
  18. Dube, FS, Kaba, M, Whittaker, E, Zar, HJ, Nicol, MP. Detection of Streptococcus pneumoniae from different types of nasopharyngeal swabs in children. PLoS One 2013;8:e68097.
    Pubmed



This Article

e-submission

Archives

Indexed/Covered by