Article

Brief Communication

Ann Lab Med 2020; 40(1): 72-75

Published online January 1, 2020 https://doi.org/10.3343/alm.2020.40.1.72

Copyright © Korean Society for Laboratory Medicine.

Performance Evaluation of the QXDx BCR-ABL %IS Droplet Digital PCR Assay

Hee-Jung Chung , M.D.1, Mina Hur , M.D., Ph.D.1, Sumi Yoon , M.D.1, Keumrock Hwang , M.D., Ph.D.2*, Hwan-Sub Lim , M.D., Ph.D.2, Hanah Kim , M.D., Ph.D.1, Hee-Won Moon , M.D., Ph.D.1, and Yeo-Min Yun, M.D., Ph.D.1

1Department of Laboratory Medicine, Konkuk University School of Medicine, Seoul, Korea; 2Department of Laboratory Medicine, Seoul Clinical Laboratories, Yongin, Korea

Correspondence to: Mina Hur, M.D., Ph.D.
Department of Laboratory Medicine, Konkuk University School of Medicine, Konkuk University Medical Center, 120-1 Neungdong-ro, Gwangjin-gu, Seoul 05030, Korea
Tel: +82-2-2030-5581 Fax: +82-2-2636-6764 E-mail: dearmina@hanmail.net

* Current affiliation is Samkwang Medical Laboratories, Seoul, Korea.

Received: July 10, 2019; Revised: August 1, 2019; Accepted: August 16, 2019

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Accurate detection of BCR-ABL fusion transcripts at and below molecular response (MR) 4 (0.01% International Scale [IS]) is required for disease monitoring in patients with chronic myeloid leukemia (CML). We evaluated the analytical performance of the QXDx BCR-ABL %IS (Bio-Rad, Hercules, CA, USA) droplet digital PCR (ddPCR) assay, which is the first commercially available ddPCR-based in vitro diagnostics product. In precision analysis, the %CV was 9.3% and 3.0%, with mean values of 0.031% IS and 9.4% IS, respectively. The assay was linear in the first order, ranging from 0.032% IS to 20% IS. The manufacturer-claimed limit of blank, limit of detection, and limit of quantification were verified successfully. There was a very strong correlation between the results of the QXDx BCR-ABL %IS ddPCR assay and the ipsogen BCR-ABL1 Mbcr IS-MMR (Qiagen, Hilden, Germany) real-time quantitative PCR assay (r=0.996). In conclusion, the QXDx BCR-ABL %IS ddPCR assay can provide reliable results for CML patients.

Keywords: BCR-ABL, Droplet digital PCR, Performance, Evaluation, Chronic myeloid leukemia

Recent practice guidelines from the European LeukemiaNet and National Comprehensive Cancer Network for the management of patients with chronic myeloid leukemia (CML) call for the use of sensitive PCR assays, like real-time quantitative PCR (RQ-PCR) assays, for detecting BCR-ABL fusion transcripts during treatment, monitoring minimal residual disease (MRD), and identifying patients at risk of relapse [1,2]. It is recommended that patients are tested every three months and the results are reported in International Scale (% IS) units for standardized reporting of the molecular response (MR) [3]. However, RQ-PCR assays are limited in terms of limit of detection (LOD) and limit of quantification (LOQ) [4]. Undetectable BCR-ABL fusion transcripts using RQ-PCR assays, especially at the LOD and LOQ, affect clinical decisions and may lead to inappropriate or premature cessation of treatment [4,5]; adequate sensitivity levels should be achieved to detect MRD down to MR4 (0.01% IS) or MR4.5 (0.0032% IS) [6].

Droplet digital PCR (ddPCR) assay can quantify the total copy number of targets present in a sample without standards [7]. Although its underlying chemistry is similar to that of the RQ-PCR assay, the ddPCR assay has an additional step, which separates each sample into 20,000 nanoliter-sized droplets, in which the PCR occurs, improving assay precision and reproducibility [7,8,9]. The QXDx BCR-ABL %IS (Bio-Rad, Hercules, CA, USA) is the first ddPCR-based in vitro diagnostics (IVD) product with the US Food and Drug Administration clearance and European Conformity (CE) mark; however, its analytical performance has not been evaluated to date [10]. We evaluated the precision, linearity, and detection capability (limit of blank [LOB], LOD, and LOQ) of the QXDx BCR-ABL %IS ddPCR assay. We also evaluated its correlation with the CE-IVD-marked ipsogen BCR-ABL1 Mbcr IS-MMR DX (Qiagen, Hilden, Germany) RQ-PCR assay, which has been designed according to the “Europe Against Cancer” studies and is compliant with the updated international recommendations [11,12,13].

This study was conducted between May and June 2019 at Konkuk University Medical Center (KUMC), Seoul, Korea, after obtaining exemption from approval by the Institutional Review Board of KUMC (KUH1200100). Venous whole blood (3 mL) was collected in K3 EDTA vacutainer (Greiner Bio-one, Kremsmünster, Austria), the BCR-ABL mRNA was extracted using the QIAamp RNA Blood Mini Kit (Qiagen, Valencia, CA, USA), and the mRNA samples were stored at −70℃ until use. Both the QXDx BCR-ABL %IS ddPCR assay and BCR-ABL Mbcr IS-MMR DX RQ-PCR assay were performed following the manufacturers' instructions. For the ddPCR assay, an Automated Droplet Generator (Bio-Rad), CFX96 thermal cycler (Bio-Rad), and QX200 Droplet Reader (Bio-Rad) were used; the raw data were analyzed and interpreted using the QuantaSoft software 1.7.4 (Bio-Rad).

Precision of the QXDx BCR-ABL %IS ddPCR assay was determined using a low positive control (MR3.0–5.0) and ~10% IS calibrator (MR1.0), which were included in the kit, according to the CLSI guidelines EP15-A3, using manufacturer-claimed within laboratory imprecision [14]. We replicated the assay three times in a single run, on three separate days. The %CVs were 9.3% and 3.0% with mean values of 0.031% IS and 9.4% IS, respectively; the maximal %CV of 9.3% was used to define allowable errors in the linearity assessment [14].

Linearity was determined at five levels (20, 10, 1.0, 0.1, and 0.032% IS) using a certified reference material (CRM) for BCR-ABL1, ERM-AD623f (European Commission's Joint Research Centre, EU); the CRM was diluted using CML-negative human blood samples, according to the CLSI guidelines EP06-A [15]. Quantification using the QXDx BCR-ABL %IS ddPCR assay showed a linear shape in the first order (y=0.9981x+0.0305) in log scale, ranging from 0.032% IS to 20% IS. No outliers were detected by visual examination of the scatter plot. The observed data were within the allowable error (<9.3%) with a CV of 2.6%, 1.4%, 3.9%, 7.6%, and 4.8% at the levels of 20, 10, 1.0, 0.1, and 0.032% IS, respectively.

Detection capability was estimated according to the CLSI guidelines EP17-A2 [16]. The total number of measurements was 24 each for LOB, LOD, and LOQ. To verify the LOB claim, two blank samples were measured with four replicates per sample on three separate days using one reagent lot; all 24 (100%) replicates showed the result “not detected.” To verify the LOD and LOQ claims (0.002% IS [MR4.7] for both), the lowest linearity material was diluted using CML-negative human blood samples to 0.0033% IS (MR4.5) and 0.0023% IS (MR4.6), respectively. Each sample was measured with four replicates on three separate days using one reagent lot. For LOD verification, 23 (95.8%) of the 24 replicates showed the result “analyte detected” and only one replicate was lower than the LOD (<0.002% IS). For LOQ verification, 21 (87.5%) of the 24 replicates were within the allowable error window (accuracy goal of ±15% total error at a level of 0.0028–0.0038% IS for Q1 and 0.0020–0.0027% IS for Q2; Table 1). The observed LOD and LOQ proportions (95.8% and 87.5%) all exceeded the minimum percentage of 85% (95% confidence interval) with a sample size of 24 [16], verifying the manufacturer's LOB, LOD, and LOQ claims.

The quantitative results of the QXDx BCR-ABL %IS ddPCR assay and BCR-ABL Mbcr IS-MMR DX RQ-PCR assay were compared using Passing-Bablok regression analysis according to the CLSI guidelines EP09-A3 [17]. Using a total of 20 clinical samples (ranging from 0.002% IS [MR4.7] to 20% IS [MR0.7]), the results of the two assays demonstrated a very strong correlation (r=0.996; Fig. 1).

One limitation of the QXDx BCR-ABL %IS ddPCR assay was that it was designed to detect only the e13a2 and e14a2 fusion transcripts, but not e1a2, e19a2, or other rare transcripts. Other potential limitations or disadvantages are its longer turnaround time due to the additional time required for droplet generation (60–70 min/plate) and droplet reading (120–140 min/plate) and the possibility of false positivity, although we observed no false positives [7,18]. Owing to the limited number of available assay kits, LOD and LOQ were verified at the levels of 0.0023% IS (MR4.64) and 0.0033% IS (MR4.49), and we could not test levels <0.002% IS (MR4.7). Further studies are needed to verify the clinical and laboratory utility of the QXDx BCR-ABL %IS ddPCR assay.

In conclusion, this is the first study to evaluate the analytical performance of the novel QXDx BCR-ABL %IS ddPCR assay. With its acceptable analytical performance, the QXDx BCR-ABL %IS ddPCR assay can be a reliable and promising tool for MRD monitoring in CML patients.

Conflicts of Interest: No potential conflicts of interest relevant to this article were reported.
Fig. 1.

Passing-Bablok regression of the correlation between the QXDx BCR-ABL %IS ddPCR assay and the BCR-ABL Mbcr IS-MMR DX RQ-PCR assay (N=20). Regression line with a 95% CI is shown.

Abbreviations: ddPCR, droplet digital PCR; RQ-PCR, real-time quantitative PCR; MR, molecular response; CI, confidence interval.


Verification of the detection capability claims of the QXDx BCR-ABL %IS ddPCR assay

Manufacturer claimed value (% IS)Level of measurand (% IS)SampleDay 1Day 2Day 3Observed proportion (%)*
#1#2#3#4#1#2#3#4#1#2#3#4
LOBBlankBlankB1NDNDNDNDNDNDNDNDNDNDNDND100.0
B2NDNDNDNDNDNDNDNDNDNDNDND
LOD0.00200.0033D1ADADADADADADADADADADADAD95.8
0.0023D2ADADADADADADADAD< LODADADAD
LOQ0.00200.0033Q10.00350.00300.00370.00290.00350.00300.00370.00350.00310.00330.0037< AEL87.5
0.0023Q20.00270.00230.00210.00210.00250.00220.00250.0020< AEL> AEL0.00210.0022

  1. Baccarani M, Castagnetti F, Gugliotta G, Rosti G. A review of the European LeukemiaNet recommendations for the management of CML. Ann Hematol 2015;94:S141-S147.
    Pubmed
  2. Radich JP, Deininger M, Abboud CN, Altman JK, Berman E, Bhatia R, et al. Chronic myeloid leukemia, version 1.2019, NCCN clinical practice guidelines in oncology. J Natl Compr Canc Netw 2018;16:1108-1135.
    Pubmed
  3. Branford S, Cross NC, Hochhaus A, Radich J, Saglio G, Kaeda J, et al. Rationale for the recommendations for harmonizing current methodology for detecting BCR-ABL transcripts in patients with chronic myeloid leukaemia. Leukemia 2006;20:1925-1930.
    Pubmed
  4. Jennings LJ, George D, Czech J, Yu M, Joseph L. Detection and quantification of BCR-ABL1 fusion transcripts by droplet digital PCR. J Mol Diagn 2014;16:174-179.
    Pubmed
  5. Kong JH, Winton EF, Heffner LT, Chen Z, Langston AA, Hill B, et al. Does the frequency of molecular monitoring after tyrosine kinase inhibitor discontinuation affect outcomes of patients with chronic myeloid leukemia?. Cancer 2017;123:2482-2488.
    Pubmed
  6. Cross NC, White HE, Colomer D, Ehrencrona H, Foroni L, Gottardi E, et al. Laboratory recommendations for scoring deep molecular responses following treatment for chronic myeloid leukemia. Leukemia 2015;29:999-1003.
    Pubmed
  7. Alikian M, Whale AS, Akiki S, Piechocki K, Torrado C, Myint T, et al. RT-qPCR and RT-digital PCR: a comparison of different platforms for the evaluation of residual disease in chronic myeloid leukemia. Clin Chem 2017;63:525-531.
    Pubmed
  8. Wang WJ, Zheng CF, Liu Z, Tan YH, Chen XH, Zhao BL, et al. Droplet digital PCR for BCR/ABL (P210) detection of chronic myeloid leukemia: a high sensitive method of the minimal residual disease and disease progression. Eur J Haematol 2018;101:291-296.
    Pubmed
  9. Maier J, Lange T, Cross M, Wildenberger K, Niederwieser D, Franke GN. Optimized digital droplet PCR for BCR-ABL. J Mol Diagn 2019;21:27-37.
    Pubmed
  10. Bio-Rad. QXDx BCR-ABL %IS Kit. Instructions for use http://www.bio-rad.com/webroot/web/pdf/lsr/literature/12006672.pdf. (Updated on June 2019).
  11. QIAGEN ipsogen BCR-ABL1 Mbcr IS-MMR DX Kit Handbook https://www.qiagen.com/np/resources/resourcedetail?id=ce61c6fb-dc8d-4cae-8b37-3d3422dbd38e&lang=en. (Updated on June 2019).
  12. Gabert J, Beillard E, van der Velden VH, Bi W, Grimwade D, Pallisgaard N, et al. Standardization and quality control studies of ‘real-time’ quantitative reverse transcriptase polymerase chain reaction of fusion gene transcripts for residual disease detection in leukemia–a Europe against cancer program. Leukemia 2003;17:2318-2357.
    Pubmed
  13. Beillard E, Pallisgaard N, van der Velden VH, Bi W, Dee R, van der Schoot E, et al. Evaluation of candidate control genes for diagnosis and residual disease detection in leukemic patients using ‘real-time’ quantitative reverse-transcriptase polymerase chain reaction (RQ-PCR)–a Europe against cancer program. Leukemia 2003;17:2474-2486.
    Pubmed
  14. CLSI, User verification of precision and estimation of bias; approved guideline. 3rd ed. CLSI EP15-A3. Wayne, PA: Clinical and Laboratory Standards Institute, 2014.
  15. CLSI, Evaluation of the linearity of quantitative measurement procedures: a statistical approach; approved guideline. CLSI EP06-A. Wayne, PA: Clinical and Laboratory Standards Institute, 2003.
  16. CLSI, Evaluation of detection capability for clinical laboratory measurement procedures; approved guideline. 2nd ed. CLSI EP17-A2. Wayne, PA: Clinical and Laboratory Standards Institute, 2012.
  17. CLSI, Measurement procedure comparison and bias estimation using patients; approved guideline. 3rd ed. CLSI EP09-A3. Wayne, PA: Clinical and Laboratory Standards Institute, 2013.
  18. Huggett JF, Cowen S, Foy CA. Considerations for digital PCR as an accurate molecular diagnostic tool. Clin Chem 2015;61:79-88.
    Pubmed