Interlaboratory comparison scheme
Based on the results of a previous survey of members of the Korean Society of Clinical Chemistry [14], 10 clinical laboratories performing immunosuppressive drug TDM by LC-MS/MS were asked to participate in this study. After enrollment, the test samples were prepared in Asan Medical Center, Seoul, Korea, dispatched to the participating laboratories on dry ice in a Styrofoam box on 23 July 2018, and reached the laboratories within two days. Participating laboratories were asked to perform the test within three days of receiving the test samples. For each test sample, participating laboratories were asked to make duplicate aliquots for testing before the sample preparation step. Test results and method information, including the dates of reception and test, calibrator, internal standard, LC manufacturer, MS manufacturer and model, and extraction method, were collected in a formatted Excel file. Additional surveys regarding calibrator reconstitution protocols were conducted by e-mail. The data was compiled and analyzed at Asan Medical Center. The Institutional Review Board of Asan Medical Center exempted the approval for this study (reference number: 2018-1070).
Preparation of test samples
Surplus samples from patients undergoing routine TDM were pooled to achieve three different concentrations of test samples for each drug. The samples included EDTA whole blood for TAC, SIR, EVE, and CSA and EDTA plasma for MPA. The samples were collected for seven days and stored at 4°C up to seven days before pooling. The samples were pooled based on their reported concentrations to achieve concentrations below, within, and above the therapeutic range of each drug. Each 1 mL pooled sample was distributed in a glass vial after mixing on a roller mixer for 1 hour. The minimum number of vials for each test sample was 10; for TAC concentration 2 (TAC-2), 30 vials were prepared to evaluate homogeneity and short-term stability. The test samples were stored at -70°C before delivery. Thus, the samples underwent only one freeze-thaw cycle before being tested at the participating laboratories. For TAC-2, 10 vials were tested in triplicate on the day of production to evaluate homogeneity. To evaluate short-term stability, two vials were stored at 5°C for five days and then tested for TAC in duplicate. These four results were compared with the homogeneity values. In the homogeneity assessment, a between-sample standard deviation < 0.3Sx- was considered acceptable. In the stability assessment, a difference from the homogeneity mean < 0.3Sx- was considered acceptable.
Details of participating laboratories
All test samples were in a frozen state on arrival at each laboratory. Details of the methods used in each laboratory are shown in Table 1. All laboratories conducted simultaneous detection with the following combinations: TAC+SIR+EVE+CSA (six laboratories) and TAC+SIR+EVE (three laboratories); one laboratory (Lab F) that was supposed to perform a CSA test with a TAC+SIR+EVE+CSA combination did not receive the CSA test samples due to a communication error. In total, TAC detection was performed in 10 laboratories, SIR detection in nine laboratories, EVE detection in nine laboratories, CSA detection in eight laboratories, and MPA detection in three laboratories. All participating laboratories used commercial calibrator sets from Chromsystems Instruments & Chemicals GmbH (Gräfelfing, Germany).
-
Table 1 . Drug measurement methods used in participating laboratories
Laboratory code | Test drugs | Internal standard | LC manufacturer* | MS instrument manufacturer* | MS instrument model |
---|
A | TAC+SIR+EVE | Ascomycin+SIR-d3+EVE-d4 | Shimadzu | SCIEX | Triple Quad 4500 |
| CSA | CSD | Agilent | Agilent | 6460 Triple Quadrupole |
| MPA | Indomethacin | Waters | Waters | Quattro Micro |
B | TAC+SIR+EVE+CSA | Ascomycin | Waters | Waters | Quattro Premier |
C | TAC+SIR+EVE | Ascomycin+SIR-d3+EVE-d4 | Waters | Waters | Xevo TQ-S |
D | TAC+CSA | Ascomycin+CSD | Waters | Waters | Xevo TQD |
| MPA | Indomethacin | Waters | Waters | Xevo TQD |
E | TAC+SIR+EVE | Ascomycin | Waters | Waters | Xevo TQD |
| CSA | CSD | Waters | Waters | Xevo TQD |
F | TAC+SIR+EVE+CSA | Ascomycin+EVE-d4+CSD | Agilent | Agilent | 6490 Triple Quadrupole |
G | TAC+SIR+EVE+CSA | Ascomycin+SIR-d3+EVE-d4+CSD | Agilent | SCIEX | API 4000 |
H | TAC+SIR+EVE+CSA | TAC-13C,d2+SIR-d3+EVE-d4+CSA-d4 | Agilent | SCIEX | API 3200 |
I | TAC+SIR+EVE+CSA | Ascomycin | Agilent | SCIEX | QTRAP 5500 |
| MPA | MPA-d3 | Agilent | SCIEX | QTRAP 5500 |
J | TAC+SIR+EVE+CSA | Ascomycin+CSD | Agilent | SCIEX | Triple Quad 3500 |
Most laboratories used precipitation with organic solvent mixture followed by centrifugation for extraction, except Lab I, which used liquid/liquid extraction. All the participating laboratories used the commercial calibrator from Chromsystems Instruments & Chemicals GmbH (Gräfelfing, Germany).
*The manufacturer names are indicated using their short names: Agilent, Agilent Technologies (Santa Clara, CA, USA); SCIEX, AB SCIEX (Foster City, CA,USA); Shimadzu, Shimadzu Corporation (Kyoto, Japan); Waters, Waters Corporation (Milford, MA, USA).
Abbreviations: CSA, cyclosporine; CSD, cyclosporine D; EVE, everolimus; LC, liquid chromatography; MPA, mycophenolic acid; MS, mass spectrometry;TAC, tacrolimus; SIR, sirolimus.
Evaluation of calibrator reconstitution method and storage as calibration bias factors
Based on the survey results of the calibrator reconstitution methods of participating laboratories, we conducted an experiment on calibrator reconstitution and storage conditions. To evaluate the impact of the calibrator reconstitution process and prolonged storage after reconstitution, we used the lyophilized calibrator 6PLUS1 Multilevel Whole Blood Calibrator Set (Lot no. 4917; Chromsystems Instruments & Chemicals GmbH) with six different concentrations plus one blank value. The calibrator contained TAC, SIR, EVE, and CSA; however, CSA could not be measured in the experimental test system.
The calibrators were stored at -70°C until use and then thawed at room temperature (20–25°C) for 30 minutes before adding 2.0 mL of distilled water to each vial. The contents of the vials were then mixed under two different conditions: static incubation (sitting) for 30 minutes at room temperature (20–25°C) after the addition of water followed by mixing on a roller for 60 minutes (Condition A0) or mixing on a roller for 20 minutes without static incubation (Condition B0). Aliquots from these vials were tested in four replicates. Aliquots from Condition A0 vials were initially frozen at -20°C and then thawed on different days, resulting in four storage conditions: 42 days at -20°C (Condition A1), 35 days at -20°C and seven days at 5°C (Condition A2), 28 days at -20°C and 14 days at 5°C (Condition A3), and 14 days at -20°C and 28 days at 5°C (Condition A4). These aliquots were tested in duplicate on the same day.
Simultaneous quantification of TAC, SIR, and EVE was performed for the calibrators in the same manner as for patient samples at Asan Medical Center. Briefly, 40 µL samples were prepared by protein precipitation using 80 µL of aqueous 0.1 M zinc sulfate and 200 µL of acetonitrile containing the internal standards. The internal standard solution consisted of ascomycin (Cerilliant, Round Rock, TX, USA), SIR-d3 (IsoSciences, Ambler, PA, USA), and EVE-d4 (Cerilliant). HPLC was conducted using an ACQUITY UPLC I-Class system (Waters Corporation, Milford, MA, USA) equipped with an ACQUITY UPLC HSS SB C18 column (30 mm × 2.1 mm, 4 µm; Waters Corporation). The system was operated at a flow rate of 0.2 mL/min with a column temperature of 55°C. The mobile phase for isocratic elution consisted of 50% methanol (HPLC grade; Merck, Darmstadt, Germany) and 50% ammonium acetate buffer (2 mM, pH 2.7, with ≥ 98% acetate ammonium; Sigma-Aldrich, St. Louis, MO, USA). MS was detected on a Xevo TQ-S LC-MS/MS system (Waters Corporation) using positive electrospray ionization and argon as the collision gas. Peak areas were obtained by multiple reaction monitoring of the following mass transitions for quantification: TAC (m/z 821.5 > 768.5), SIR (m/z 931.6 > 864.6), EVE (m/z 975.7 > 908.6), ascomycin (m/z 809.5 > 756.5), SIR-d3 (m/z 934.6 > 864.6), and EVE-d4 (m/z 979.7 > 912.6). Response values were calculated using the resultant peak areas (area of analyte/area of internal standard). LC-MS/MS analysis and data acquisition were managed using Masslynx software version 4.1 (Waters Corporation). TargetLynx software version 4.1 (Waters Corporation) was used for chromatographic peak detection and baseline determination.
Statistical analysis
Data from the participating laboratories were used to estimate test reproducibility. The repeatability standard deviation (Sr) is the root mean square value of all differences in wi, where wi is the difference between the duplicate measurement results in the ith laboratory and the number of participating laboratories is p:
Sr=∑ i=1pwi2 p
The standard deviation of the sample averages The standard deviation of the sample averages (Sx-) is:
Sx-=∑ i=1pdi2/(p−1)
where di=x-i-x= and the average of the duplicate measurement results in the ith laboratory is x-i and the average of the x- for one test sample is x=.
When (Sx-)2>(Sr)
2/2, the reproducibility standard deviation (SR) is :
SR=(Sx-)2+(Sr)2/2
The reproducibility coefficient of variation (CVR) is :
CVR=100SR/x=
Robust statistical methods based on the medians were also used to describe the result distribution. The robust repeatability standard deviation (Sr*) was calculated using Algorithm S (ISO13528:2015) [15, 16]. The robust standard deviation of the sample averages (Sx-*) is :
Sx-*=1.483med(|Di|)
which is the scaled median absolute deviation (MADe), where Di=x-i-med(x-). The percent difference (D%) was used to describe the deviation in the individual laboratory results, calculated as %Di=100Di/med(x-). The robust reproducibility standard deviation (SR*) and the robust reproducibility CV (CVR*) were calculated as SR*=(Sx-)2+(Sr*)2/2 and %RSDR*=100SR*/med(x-), respectively. Spearman’s rank correlation coefficient (rho, ρ) was calculated to determine the relationship between the D% values of different test drugs paired with similar drug concentration measurements.
For the result analysis, a multiple linear regression model was used to compare the slopes of the calibration curves (non-weighted):
Y=β0+β1X+β2XDC+ε
where the response value is Y, the assigned value of calibrator is X, and the dummy variable of the conditions is DC. The t-test on coefficient β2 was performed to determine whether the slopes obtained from the reconstitution or the storage conditions were different from those at the baseline onditions (A0 or A1), with P ≤ 0.05. Data integration, analysis, and visualization were performed using R version 3.6.3 (R Foundation for Statistical Computing, Vienna, Austria).