Article

Original Article

Ann Lab Med 2023; 43(6): 554-564

Published online June 30, 2023 https://doi.org/10.3343/alm.2023.43.6.554

Copyright © Korean Society for Laboratory Medicine.

Evaluation of Vancomycin Area Under the Concentration–Time Curve Predictive Performance Using Bayesian Modeling Software With and Without Peak Concentration: An Academic Hospital Experience for Adult Patients Without Renal Impairment

Hyun-Ki Kim , M.D.1 and Tae-Dong Jeong, M.D., Ph.D.2

1Department of Laboratory Medicine, University of Ulsan College of Medicine, Ulsan University Hospital, Ulsan, Korea; 2Department of Laboratory Medicine, Ewha Womans University College of Medicine, Seoul, Korea

Correspondence to: Tae-Dong Jeong, M.D., Ph.D.
Department of Laboratory Medicine, Ewha Womans University College of Medicine, 260 Gonghang-daero, Gangseo-gu, Seoul 07804, Korea
Tel: +82-2-6986-3386
Fax: +82-2-6986-3389
E-mail: tdjeong@ewha.ac.kr

Received: January 15, 2023; Revised: April 4, 2023; Accepted: May 31, 2023

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Background: The revised U.S. consensus guidelines on vancomycin therapeutic drug monitoring (TDM) recommend obtaining trough and peak samples to estimate the area under the concentration–time curve (AUC) using the Bayesian approach; however, the benefit of such two-point measurements has not been demonstrated in a clinical setting. We evaluated Bayesian predictive performance with and without peak concentration data using clinical TDM data.
Methods: We retrospectively analyzed 54 adult patients without renal impairment who had two serial peak and trough concentration measurements in a ≤1-week interval. The concentration and AUC values were estimated and predicted using Bayesian software (MwPharm++; Mediware, Prague, Czech Republic). The median prediction error (MDPE) for bias and median absolute prediction error (MDAPE) for imprecision were calculated based on the estimated AUC and measured trough concentration.
Results: AUC predictions using the trough concentration had an MDPE of –1.6% and an MDAPE of 12.4%, whereas those using both peak and trough concentrations had an MDPE of –6.2% and an MDAPE of 16.9%. Trough concentration predictions using the trough concentration had an MDPE of –8.7% and an MDAPE of 18.0%, whereas those using peak and trough concentrations had an MDPE of –13.2% and an MDAPE of 21.0%.
Conclusions: The usefulness of the peak concentration for predicting the AUC on the next occasion by Bayesian modeling was not demonstrated; therefore, the practical value of peak sampling for AUC-guided dosing can be questioned. As this study was conducted in a specific setting and generalization is limited, results should be interpreted cautiously.

Keywords: Vancomycin, Therapeutic drug monitoring, Area under the curve, Peak, Trough

Vancomycin is the first-line treatment for methicillin-resistant Staphylococcus aureus (MRSA) infections, which cause diseases, such as bacteremia, endocarditis, pneumonia, and osteomyelitis [1]. However, vancomycin dosing can be challenging because of large inter- and intra-individual variability in pharmacokinetic (PK) parameters and efficacy, resistance, and nephrotoxicity issues, which justify therapeutic drug monitoring (TDM) [2, 3]. Historically, the trough vancomycin concentration has been recommended as the target index; however, more recently, increasing evidence supporting area under the concentration–-time curve (AUC)-guided TDM has led the American Society of Health-System Pharmacists, Infectious Diseases Society of America, and Pediatric Infectious Diseases Society to recommend using the AUC as the target PK index in their recently revised U.S. consensus guidelines [4].

As a methodology for AUC-guided TDM, the revised U.S. guidelines recommend a Bayesian approach using “Bayesian software programs embedded with a PK model based on richly sampled vancomycin data as the Bayesian prior” [4]. To accurately estimate and predict the AUC using the Bayesian method, along with the proper selection of a priori PK parameters of the population model, it is essential to collect observational data on drug concentrations [5, 6]. As the blood sampling strategy for vancomycin TDM, two PK samples are recommended by the revised U.S. guidelines (i.e., 1–2 hours post-infusion and at the end of the dosing interval) for estimating the AUC using the Bayesian approach [4]. The recent Japanese vancomycin TDM guidelines also recommend two-point measurements [7]. These recommendations are mainly based on evidence from simulation studies that compared estimated AUC values from limited concentration data with reference AUC data from rich concentration data mainly acquired from published vancomycin PK studies [8-10]. However, the methodology for estimating AUC in the clinical setting remains controversial and is being actively researched [11].

Since January 2020, Ewha Womans University Seoul Hospital (Seoul, Korea) has implemented an internal TDM policy recommending that a post-distributional peak concentration be measured in addition to the trough concentration when requesting clinical PK consultation service (CPCS) for vancomycin to better predict concentration and AUC values by the Bayesian method. However, it remained unknown whether peak concentration data would be helpful in an actual clinical setting with more error factors than in PK study settings. We evaluated the performance of concentration and AUC prediction using Bayesian software based on two types of input concentration data (i.e., trough concentration alone vs. both trough and peak concentrations).

Patients and TDM data

This was a retrospective study of patients for whom CPCS for vancomycin was requested between January 2020 and March 2021 in Ewha Womans University Seoul Hospital, an academic hospital in Seoul, Korea. Patient clinical data, including age, sex, weight, height, vancomycin administration history, renal replacement therapy history, vancomycin TDM data (concentration and sampling time), serum creatinine concentrations, and timing of creatinine measurement, were collected from hospital electronic health records and CPCS request forms. The following inclusion criteria for patient and TDM data were applied to evaluate the predictive performance in adult patients without renal impairment: (1) adult patients (≥18 years); (2) no renal replacement therapy during vancomycin dosing; (3) estimated glomerular filtration rate (eGFR) ≥60 mL/min/1.73 m2 as calculated using the Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) equation [12] at each TDM occasion; (4) TDM data within the acceptable time interval (0–1 hour before the start of infusion for the trough concentration; 1–3 hours after the end of infusion for the peak concentration); (5) patients with TDM data on two occasions in a ≤1-week interval. If a patient had TDM data on multiple occasions, data from the first two occasions were used. This study was approved by the Institutional Review Board of Ewha Womans University Seoul Hospital (approval No.: SEUMC 2020-06-018). The requirement for patient consent was waived due to because of the retrospective design of the study design.

Hospital setting and TDM practice during the period for study data

The hospital has 653 beds. When requesting CPCS for vancomycin, the internal TDM recommendation was using both trough (0–30 minutes before infusion) and peak (1–2 hours after the end of infusion) samples to better estimate the PK parameters. The request form included vancomycin dosing history, blood draw times (year, month, day, hour, and minute) for trough and peak concentrations, and dialysis information. The clinical laboratory provided information on the recommended blood collection times for trough and peak concentrations in the CPCS request form. If the blood draw time was suspected to be recorded incorrectly, the laboratory staff or pharmacist contacted the ward nurses by phone to obtain accurate sampling information. The recommended dosing regimen targeted a minimum concentration (Cmin) of 15.0–20.0 mg/L for severe MRSA infection cases (10.0–15.0 mg/L for other cases) and 24-hour AUC (AUC24)>400 mg∙hr/L for all cases. Vancomycin concentrations were measured using the Architect iVancomycin assay (Abbott, Wiesbaden, Germany) on an Architect i1000SR analyzer (Abbott). Serum creatinine concentrations were measured using CREA reagent (Beckman Coulter, Brea, CA, USA) on an AU5822 Automated Clinical Chemistry Analyzer (Beckman Coulter) based on the Jaffe method. Cmin and AUC24 were predicted based on simulations using the commercial Bayesian software, MwPharm++ v.1.9.0.338 (Mediware, Prague, Czech Republic).

AUC estimation by first-order PK analytic equations

For the collected data, first-order PK analytic equations were used to estimate the AUC when it was considered that the corresponding concentrations were drawn at the steady state (after at least three regular vancomycin doses). Three cases on the 1st occasion were excluded from the analysis. We used the two equations reported by Pai, et al. [13]:

AUCEq.(4)=(Cetrough+Ceoi)×0.5×tinfusion+(CeoiCetrough)/KeAUCEq.(5)=(Csoi'Cetrough)/Ke

where Ke is the elimination rate constant calculated using peak and trough concentrations, Cetrough is the forward-extrapolated concentration at the end of the dosing interval, Ceoi is the back-extrapolated concentration at the end of infusion, and Csoi’ is the back-extrapolated concentration at the start of infusion assuming an infusion duration of zero. Although the peak and trough concentrations were obtained around a single dose (rather than in the same dose cycle), the measured trough concentration was used as a substitute for the trough concentration in the next cycle (the same cycle as the peak concentration). The equations were named Eq. (4) and Eq. (5), as in the referenced paper.

AUC and concentration prediction using the Bayesian software

Bayesian individual PK parameter estimation and time–-concentration curve simulations were conducted using MwPharm++, which is used in routine practice. We used the built-in two-compartment model with the population PK parameters for adults based on the Dutch Association of Hospital Pharmacists monograph [14]. Briefly, the population PK parameters (mean±SD) as Bayesian priors were V1=0.21±0.04 L/kg, kelr=0.00327± 0.00109 hr–1/(mL/min/1.73 m2), k12=1.12±0.28 hr–1, and k21=0.48±0.12 hr–1, where V1 is the volume of distribution of the central compartment, kelr is the rate constant for renal elimination from the central compartment, k12 is the rate constant for elimination from the 1st (central) to the 2nd (peripheral) compartment, and k21 is rate constant for elimination from the 2nd to the 1st compartment. The metabolic elimination rate constant from the central compartment (kelm) was fixed at 0.0143 hr–1. The relationship between kelr and renal clearance (CLr) is CLr (L/h/kg)=kelr [h–1/(mL/min/1.73 m2)]×CLcr (mL/min/1.73 m2)×V1 (L/kg), where CLcr is creatinine clearance calculated using the Cockcroft–Gault equation and is normalized to the body surface area [15]. The individual PK parameters were estimated using two types of input concentration data (i.e., trough concentration alone vs. both trough and peak concentrations) for each TDM occasion.

Concentration-time curves were obtained using estimated individual PK parameters, and the AUC value over the dose cycle corresponding to each TDM occasion was calculated. The AUC value estimated using the TDM data at the corresponding dose cycle is represented as AUCestimated. AUCestimated was normalized to 24 hours for agreement evaluation by dividing the AUCestimated for the dose cycle by the dosing interval and multiplying by 24 and is represented as AUC24estimated. The AUC value predicted for the 2nd occasion using the TDM data from the 1st occasion is represented as AUCpredicted. The input concentration data type for individual PK parameter estimation is indicated, for example, AUCestimated[T&P] (AUC value estimated by fitting the trough and peak concentrations on the corresponding occasions) and AUCpredicted[T] (AUC value on the 2nd occasion predicted by fitting the trough concentration on the 1st occasion). Predicted concentration values on the 2nd TDM occasion using the data from the 1st TDM occasion are represented as Cpredicted. The measured concentration is expressed as Cmeasured.

Evaluation of predictive performance and statistical analysis

The median difference, median percentage difference, and Pearson’s correlation coefficient (r) were calculated to investigate the relationships among AUC24estimated[T], AUC24estimated[T&P], AUC24Eq.(4), and AUC24Eq.(5). The AUC24estimated results were divided into three groups (subtherapeutic, <400 mg∙hr/L; therapeutic, 400–600 mg∙hr/L; and toxic, >600 mg∙hr/L) based on the target range (assuming a minimum inhibitory concentration of 1 mg/L) suggested by the U.S. consensus guidelines [4]. Agreements were compared using the weighted Cohen’s kappa.

The ability of Bayesian modeling for predicting concentration or AUC values on the 2nd TDM occasion using the data from the 1st TDM occasion was evaluated in terms of bias and imprecision. The prediction error (PE) was defined as PEi(%)=(ValuePredicted(i)ValueReference(i))ValueReference(i)×100, where ValuePredicted is the concentration or AUC value of the vancomycin dose cycle on the 2nd TDM occasion predicted by estimated individual PK parameters using the previous concentration data and ValueReference is the value of Cmeasured, AUC estimated using the first-order PK analytic equations, or Bayesian AUCestimated using TDM data from the 2nd TDM occasion. The median PE (MDPE) for bias and median absolute PE (MDAPE) for imprecision were calculated as predictive performance parameters: MDPE=median (of PE) and MDAPE=median (of |PE|). To evaluate the relative bias or imprecision of predictors from the two input concentration data types, the median of paired differences was calculated: ΔPEi=PEi (trough) - PEi (trough and peak) and ΔAPEi=|PEi (trough)| - |PEi (trough and peak)|. The 95% confidence interval (CI) for the performance parameters was calculated using the bootstrap percentile method (5,000 bootstraps). The 95% CIs for the medians of ΔPE and ΔAPE were also calculated, and an interval not including zero was considered a significant difference.

Multiple variable graphs with dots and lines were drawn to show trends in estimated AUC24 according to the TDM occasion and dosage. Scatterplots with locally estimated scatterplot smoothing curves were used to show the relationships between predicted and reference values. Bland–Altman plots were used to visually explore the differences between estimated AUC24 values. R version 4.0.4. (R Foundation for Statistical Computing, Vienna, Austria) was used for statistical analysis and to calculate the performance metrics.

Characteristics of patients and TDM data

Among 963 vancomycin TDM occasions for 405 patients, two-point concentration data were available for 589 occasions; 108 TDM occasions for 54 patients met the inclusion criteria. All patients were Korean and received intravenous vancomycin via intermittent infusion. A detailed flow diagram of study patient and TDM data inclusion is shown in Fig. 1. The median (Q1 to Q3) age was 71.5 (range, 59–81) years, and 26 (48.1%) patients were male. Thirty-eight patients had complicated infections: 24 bacteremias and eight CNS infections, including two meningitis, two osteomyelitis, and four pneumonia cases. Others had intra-abdominal infections (N=10), skin and soft-tissue infections (N =4), or urinary tract infections (N=2). The median (Q1 to Q3) difference in serum creatinine concentrations between 1st and 2nd occasions was –0.04 (–0.10–0.06) mg/dL. The median (Q1 to Q3) difference in eGFR between 1st and 2nd occasions was 2 (–4–7) mL/min/1.73 m2. No case had a change in creatinine concentration at the acute kidney injury level (a ≥50% or ≥0.3 mg/dL increase in the serum creatinine concentration) [16]. The median (Q1 to Q3) time between trough samplings on the 1st and 2nd TDM occasions (TDM interval) was 105.3 (73.5–168.0) hours. Detailed characteristics of the patients are shown in Table 1. Estimated AUCs at all TDM occasions over time along with information on the vancomycin dosage are shown in Fig. 2. Sampling and infusion time data were recorded at limited time points (Supplemental Data Fig. S1). The modes of trough sampling, infusion end, and peak sampling time relative to the infusion start time were 0, 60, and 120 minutes, respectively.

Characteristics of the patients and TDM data

CharacteristicValue*
N54
Male sex, N (%)26 (48.1)
Age, yr71.5 (59, 81)
≥ 65 yr, N (%)34 (63.0)
Body weight, kg56.7 (48.8, 65.0)
Height, cm160.5 (154.9, 170.0)
BSA, m21.58 (1.46, 1.71)
BMI, kg/m221.8 (19.6, 24.2)
Albumin, g/L29 (27, 33)
Complicated infections, N (%)34 (63.0)
MRSA infections, N (%)9 (16.7)
Complicated MRSA infections, N (%)8 (14.8)
Serum creatinine, mg/dL
1st TDM occasion0.53 (0.45, 0.66)
2nd TDM occasion0.52 (0.45, 0.67)
eCLcr, mL/min
1st TDM occasion100 (62, 145)
2nd TDM occasion97 (69, 137)
eGFR§, mL/min/1.73 m2
1st TDM occasion104 (86, 119)
2nd TDM occasion106 (89, 119)
Daily vancomycin dose per weight, mg/kg
1st TDM occasion30.8 (25.8, 37.7)
2nd TDM occasion38.0 (24.5, 53.5)
Single vancomycin dose, mg
1st TDM occasion800 (662.5, 1000)
2nd TDM occasion650 (600, 800)
Vancomycin dosing interval, N (1st/2nd)
4 hr1/7
6 hr2/13
8 hr7/15
12 hr41/17
24 hr3/2
N doses before 1st trough sampling5 (3.3, 7.8)
Time gap from 1st dose to trough sampling, hr
1st trough sampling60.0 (47.6, 72.0)
2nd trough sampling167.8 (132.5, 228.0)
Measured vancomycin trough concentration, mg/L
1st TDM set11.6 (6.8, 16.8)
2nd TDM set18.1 (15.1, 20.7)
Measured vancomycin peak concentration, mg/L
1st TDM set25.9 (21.1, 33.3)
2nd TDM set26.7 (22.8, 34.6)

*Number (%) or median (Q1, Q3); Complicated infections such as bacteremia, endocarditis, osteomyelitis, and CNS infections including meningitis and pneumonia; Calculated using the Cockcroft–Gault equation; §Calculated using the CKD-EPI equation.

Abbreviations: BMI, body mass index; BSA, body surface area; CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; CNS, central nervous system; eCLcr, estimated creatinine clearance; eGFR, estimated glomerular filtration rate; MRSA, methicillin-resistant Staphylococcus aureus; Q1, 25th percentile; Q3, 75th percentile; TDM, therapeutic drug monitoring.



Figure 1. Flow diagram of patient and TDM data inclusion.
Abbreviation: TDM, therapeutic drug monitoring.

Figure 2. Plot depicting the estimated AUCs at all TDM occasions over time. The AUCs were estimated using (A) the trough concentration alone and (B) both trough and peak concentration data by the Bayesian program. The gray lines connect AUCs from 1st and 2nd occasions of the same patient. The points are colored according to the daily dose and shaped according to the dose changes between 1st and 2nd occasion. The points are jittered (adding a small amount of random variation to the location on the X-axis) to avoid overplotting.
Abbreviations: AUC, area under the concentration–-time curve (mg∙hr/L); TDM, therapeutic drug monitoring.

Agreement between AUC24estimated[T] and AUC24estimated[T&P]

AUC24estimated[T] strongly correlated with AUC24estimated[T&P], with r=0.956 (P<0.001). The median (Q1 to Q3) difference between AUC24estimated[T] and AUC24estimated[T&P] was 27.7 (–10.9–50.5) mg∙hr/L in total, 27.7 (–12.6–48.6) mg∙hr/L on the 1st occasion, and 24.6 (–5.7–50.4) mg∙hr/L on the 2nd occasion. The median (Q1 to Q3) percentage difference between AUC24estimated[T] and AUC24estimated[T&P] was 2.4% (–1.0%–4.7%) in total, 5.2% (–2.8%–10.0%) on the 1st occasion, and 3.6% (–1.1%–9.2%) on the 2nd occasion. The differences are depicted in Bland–Altman plots in Supplemental Data Fig. S2. In analysis of the agreement based on clinical categories, AUC24estimated[T] and AUC24estimated[T&P] showed 84.3% agreement (85.2% on the 1st occasion and 83.3% on the 2nd occasion), with a weighted kappa value of 0.80 (Table 2).

Agreement between AUC24estimated[T] and AUC24estimated[T&P] based on clinical categories (N=108)

AUC24estimated[T]AUC24estimated[T&P]Weighted kappa (95% CI)

<400400–600>600
< 40016200.80 (0.72, 0.89)
400–6006310
> 6000944

Abbreviations: AUC24, area under the concentration–time curve normalized to 24 hours (mg∙hr/L); AUC24estimated[T&P], AUC24 estimated by fitting trough and peak concentrations on the corresponding occasion; AUC24estimated[T], AUC24 estimated by fitting the trough concentration on the corresponding occasion; CI, confidence interval.



Agreement between AUC24 estimated using Bayesian modeling and using first-order PK analytic equations

AUC24estimated[T] strongly correlated with AUC24Eq.(4) and AUC24Eq.(5), with r=0.902 (P<0.001) and 0.879 (P<0.001), respectively. The median (Q1 to Q3) difference between AUC24estimated[T] and AUC24Eq.(4) and AUC24Eq.(5) was 59.8 (14.8–104.3) mg∙hr/L and 38.1 (–15.0–83.6) mg∙hr/L, respectively. AUC24estimated[T&P] strongly correlated with AUC24Eq.(4) and AUC24Eq.(5), with r=0.985 (P<0.001) and 0.977 (P<0.001), respectively. The median (Q1 to Q3) difference between AUC24estimated[T&P] and AUC24Eq.(4) and AUC24Eq.(5) was 36.7 (14.1–48.1) mg∙hr/L and 12.1 (–8.5–21.1) mg∙hr/L, respectively. The differences are shown in Bland–Altman plots in Supplemental Data Fig. S3. In analysis of the agreement based on clinical categories, AUC24estimated[T] showed 71.4% agreement (weighted kappa=0.65) with both AUC24Eq.(4) and AUC24Eq.(5), whereas AUC24estimated[T&P] showed 86.7% agreement (weighted kappa=0.83) with both AUC24Eq.(4) and AUC24Eq.(5).

Predictive performance of Bayesian modeling for AUC or concentration values on the next occasion

The performance of Bayesian modeling using TDM data from the 1st occasion in predicting AUCs or measured concentrations on the 2nd occasion is summarized in Table 3. When evaluated based on AUCestimated[T&P], AUCestimated[T], AUCEq.(5), and trough Cmeasured, the predicted values using the trough concentration alone were less biased and less imprecise. When evaluated based on peak Cmeasured, the predicted values using both trough and peak concentrations were less biased, but slightly more imprecise. The PEs using the trough concentration alone were significantly positively biased compared with those using both trough and peak concentrations. The absolute PE using the trough concentration alone was significantly smaller when evaluated based on AUCestimated[T]. The relationships between the predicted and reference values are depicted in scatter plots in Fig. 3.

Predictive performance of Bayesian prediction depending on whether or not peak concentration data are used when using 1st occasion data to predict the 2nd occasion AUC or concentration (N=54)

Reference value (2nd occasion data)Used data (1st occasion) for predictionMDPE, % (95% CI)MDAPE, % (95% CI)Median ΔPE, % (95% CI)Median ΔAPE, % (95% CI)
AUCestimated[T&P]Trough–1.6 (–7.8, 4.1)12.4 (8.0, 22.2)4.5 (2.4, 7.0)–2.4 (–4.8, 1.6)
Peak, trough–6.2 (–12.6, 0.6)16.9 (11.1, 24.7)
AUCestimated[T]Trough–5.2 (–10.5, –1.8)11.4 (8.3, 17.6)4.4 (2.6, 6.9)–3.6 (–6.9, –0.4)
Peak, trough–9.6 (–15.4, –3.5)18.2 (12.5, 23.0)
AUCEq.(4)Trough4.7 (–2.1, 15.1)21.7 (15.1, 26.5)4.6 (2.3, 7.7)1.7 (–2.4, 4.1)
Peak, trough0.4 (–5.9, 11.1)16.2 (12.4, 25.2)
AUCEq.(5)Trough3.0 (–9.1, 11.4)18.3 (15.0, 23.1)4.3 (2.2, 7.1)1.1 (–3.8, 3.0)
Peak, trough–3.3 (–9.2, 5.5)18.5 (10.1, 26.6)
Trough CmeasuredTrough–8.7 (–18.5, –5.3)18.0 (13.7, 22.9)2.5 (0.5, 4.4)–1.7 (–3.3, 0.6)
Peak, trough–13.2 (–19.7, –6.6)21.0 (14.6, 26.6)
Peak CmeasuredTrough8.3 (–5.4, 15.0)17.8 (14.8, 29.4)5.9 (3.2, 9.3)2.6 (–4.1, 5.1)
Peak, trough2.0 (–9.3, 8.5)18.3 (13.5, 26.2)

Abbreviations: AUC, area under the concentration–-time curve (mg∙hr/L); AUCestimated[T], AUC estimated by fitting the trough concentration on the corresponding occasion; AUCestimated[T&P], AUC estimated by fitting trough and peak concentrations on the corresponding occasion; Cmeasured, measured concentration; CI, confidence interval; MDPE, median prediction error; MDAPE, median absolute prediction error; ΔPE, paired difference of prediction error; ΔAPE, paired difference of absolute prediction error.



Figure 3. Scatter plots depicting the predicted AUC24 or concentration (using 1st TDM occasion data) versus reference AUC24 (estimated using 2nd TDM occasion data) or measured concentration (N=54), respectively. The predicted values were obtained using trough (left; A, C, E, G, I, K) or both trough and peak (right; B, D, F, H, J, L) concentration data. Reference values are AUCestimated[T&P] for (A) and (B); AUCestimated[T] for (C) and (D); AUCEq.(4) for (E) and (F); AUCEq.(5) for (G) and (H); trough Cmeasured for (I) and (J); and peak Cmeasured for (K) and (L). The dashed lines are the identity lines. The gray lines represent locally estimated scatterplot smoothing curves to assist visual exploration of trends.
Abbreviations: AUC24, area under the concentration-–time curve normalized to 24 hours (mg∙hr/L); TDM, therapeutic drug monitoring.

We evaluated the concentration- and AUC-predictive performance of Bayesian modeling using retrospective TDM data from routine hospital practice. We found that using both trough and peak concentrations did not improve the predictive performance and consider three main reasons for this result. First, the increase in predictability when using peak concentration data may have been so small that it was difficult to observe in the small study cohort. Second, the population PK model used may not be appropriate for the study population and TDM data. The difference in AUC estimation accuracy according to the combination of input data may be affected by the population PK model [9]. This issue will be further discussed in the limitations section. Third, there may have been errors in the clinical data. Clinical data, including the drug concentration and sampling and dose administration times, are prone to errors that may significantly affect the Bayesian estimation of individual PK parameters [6, 17, 18]. Inaccuracies in time recordings were suspected to be a significant cause of invalidity of peak concentration data because peak concentrations may be more dependent on the actual infusion end time and may show more significant changes over time than trough concentrations.

Our results contradict those of previous studies using richly sampled PK study data supporting two-point measurements [8-10]. These previous studies calculated reference AUC values using five to eight vancomycin concentration data points in a dose cycle. They compared estimated AUCs with the reference AUC, and all showed a more considerable variability in errors from AUCs estimated using the trough concentration alone than in those estimated using trough and peak concentrations. However, these studies evaluated a small number of subjects, including healthy individuals, and may not represent the clinical patient population. In addition, they used time–-concentration data from a strictly monitored PK study with an accuracy that may be difficult to achieve in a real clinical setting. Along with the evaluation of richly sampled PK data, Oda, et al. [10] evaluated 28 adult clinical patients with peak and trough concentrations, showing that the AUC estimated using the trough concentration alone was unbiased against estimates using both trough and peak concentrations. However, they concluded that AUC estimation using the trough concentration alone should be avoided when treating invasive MRSA infections in critically ill patients with large variability in PK due to decreased accuracy.

Olney, et al. [19] compared AUCs estimated by the Bayesian method using the trough concentration alone with those estimated using a first-order equation and the Bayesian method using trough and peak concentrations. While there was a strong correlation and agreement between the AUCs estimated by the two-concentration Bayesian method and first-order equation (r=0.963), with 87.4% agreement across clinical categories, the trough concentration Bayesian method demonstrated a weaker correlation (r=0.823) and 76.8% agreement. The correlation between the trough and two-concentration Bayesian method was strong (r=0.931), with 88.5% agreement. Although our and their results on these metrics cannot be directly compared because they are largely affected by the AUC range and distribution, our results are very similar to theirs, with the degree of correlation and agreement being in the order of two-concentration Bayesian method and first-order equations (r=0.985 and 0.977; 86.7% agreement) >trough and two-concentration Bayesian methods (r=0.956; 84.3% agreement) >trough concentration Bayesian method and first-order equations (r=0.902 and 0.879; 71.4% agreement).

Along with a comparison between estimated AUCs, we evaluated the prediction performance for AUCs and concentrations on the next TDM occasion. Prediction performance metrics for subsequent concentrations after incorporating the patient’s vancomycin concentrations have been used to evaluate Bayesian models and/or the usefulness of incorporated concentration data [20-22]. To our knowledge, this was the first study to evaluate the performance of Bayesian modeling in vancomycin AUC prediction for the next occasion. The predicted AUC using the trough concentration alone showed a higher value than that using both trough and peak concentrations, showing a bias (MDPE) that is measured differently according to the reference AUC. Their ΔAPEs were not significant, except in AUCestimated[T], and even MDAPEs using trough concentrations alone were better than those for reference values such as AUCestimated[T&P], AUCestimated[T], and AUCEq.(5). Therefore, we tentatively concluded that using both trough and peak concentrations did not improve the AUC-predictive performance. We suspect that inaccuracies in the time records in the clinic are a major explanation for this result.

Although the importance of time recording has been steadily highlighted in routine practice, time data recorded by general medical staff still need to be more accurate. The time data in our study were limited to specific times and were unrealistic. Given that planned rather than actual sampling times are often recorded in a clinical setting, discrepancies between actual and documented antimicrobial infusion administration times would not be surprising [23]. Compliance with the recommended blood sampling time was also insufficient. Approximately 27.5% (136 out of 494) of TDM data were excluded for being outside the defined acceptable time range. Previous studies have also reported such non-compliance [24, 25]. Although AUC estimation by the Bayesian approach could be less susceptible to concentration errors than PK analytic equations [26], for proper application of AUC-guided TDM, TDM data accuracy should be ensured first [5]. However, without practical, well-resourced support, including tools, education, and staffing, it may not be easy to improve or audit the accuracy of TDM data. The role of the laboratory is also crucial in increasing the clinical usefulness of TDM [27, 28].

Our study had a significant limitation in that the population PK model used may not be ideal for the Korean population. We utilized used the built-in population PK model of MwPharm++, which was developed based on a population of a different race. Moreover, our study population had a high proportion of elderly patients, who may have different PK properties [29]. In addition, the information on how the default PK parameters were generated is unclear, making it difficult to evaluate their appropriateness for our study population. However, using the built-in population PK model of MwPharm++ is not exceptional in Korea [30], and our study reflects the real-world situation where TDM analysts in the clinic often have to rely on readily available models.

Several Korean-specific population PK models for vancomycin, which may have been more appropriate for our study population, have been published [31-33]. Differences between the built-in MwPharm++ model and the Korean-specific models include variability in the structural model, covariates, and PK parameter values. For example, when compared with the PK parameters from a recent study ausing a two-compartment model assuming a typical patient with a weight of 60 kg and a CLcr of 72 mL/min, the built-in MwPharm++ model has a larger clearance (2.82 vs. 3.15 L/h), a smaller central compartment volume (31.8 vs. 12.6 L), larger intercompartmental clearance (11.7 vs. 14.1 L/h), and smaller peripheral compartment volume (75.4 vs. 29.4 L) [33]. These differences in population PK parameters can result in a significant difference in the Bayesian AUC estimate [22]. However, these Korean-specific population models have not been validated as a priori information for Bayesian AUC estimation. Additionally, the use of customized population PK models in a Bayesian software program may not be feasible in most clinics. Considering this situation, further development of a relevant population model or validation of AUC estimation using published models is required to implement proper AUC-guided dosing using the Bayesian approach in Korea, and the dissemination of a software tool with a validated population PK model is required to facilitate the use of AUC-guided dosing in clinical practice. Similar work has been carried out by a Japanese expert group [10].

This study had several other limitations. First, the reference AUC value was not measured based on rich sample data. However, it is nearly impossible to acquire rich and accurate sample data in the clinical setting. The AUC estimated by the Bayesian approach using the two concentration data points from the next TDM occasion may be the best reference value that is practically feasible in a clinical setting. We also evaluated the predictive performance with other reference values to provide a balanced perspective. Second, we did not assess performance in comparison with other population PK models; therefore, generalization may be limited. Third, inaccuracies in time recordings were presumed to have caused the non-superiority of using peak and trough data; however, we did not measure this directly. Fourth, as this was a retrospective study, the patients were selected according to data availability, and sampling bias from the intended population (general hospitalized patients treated with vancomycin) may have occurred. Finally, we should have evaluated cost implications, which may be critical in determining the TDM strategy. A recent study in the U.S. showed significant institutional cost benefits of the Bayesian method over trough-guided dosing [34]. Similar research is needed in Korea.

In conclusion, while there was a significant difference between AUC24 values estimated using trough alone and both trough and peak concentration data, the usefulness of peak concentration data for predicting the AUC on the next occasion by the Bayesian program was not demonstrated. These results bring into question the practicality of peak sampling for AUC-guided dosing. However, as the study was conducted in a specific setting, different results may be obtained depending on the patient population, population PK model suitability, and data accuracy; therefore, caution should be exercised in result interpretation. Detailed operation protocols should be researched and suggested to allow proper implementation of AUC-guided TDM.

Kim HK aided in study design, performed the analysis, and drafted the manuscript. Jeong TD conceptualized and designed the study, acquired the data, and reviewed and edited the manuscript. All authors read and approved the final manuscript.

  1. Turner NA, Sharma-Kuinkel BK, Maskarinec SA, Eichenberger EM, Shah PP, Carugati M, et al. Methicillin-resistant Staphylococcus aureus: an overview of basic and clinical research. Nat Rev Microbiol 2019;17:203-18.
    Pubmed KoreaMed CrossRef
  2. Rybak M, Lomaestro B, Rotschafer JC, Moellering R Jr, Craig W, Billeter M, et al. Therapeutic monitoring of vancomycin in adult patients: a consensus review of the American Society of Health-System Pharmacists, the Infectious Diseases Society of America, and the Society of Infectious Diseases Pharmacists. Am J Health Syst Pharm 2009;66:82-98.
    Pubmed CrossRef
  3. Revilla N, Martín-Suárez A, Pérez MP, González Gonzalez FM, Fernández de Gatta MM. Vancomycin dosing assessment in intensive care unit patients based on a population pharmacokinetic/pharmacodynamic simulation. Br J Clin Pharmacol 2010;70:201-12.
    Pubmed KoreaMed CrossRef
  4. Rybak MJ, Le J, Lodise TP, Levine DP, Bradley JS, Liu C, et al. Therapeutic monitoring of vancomycin for serious methicillin-resistant Staphylococcus aureus infections: a revised consensus guideline and review by the American Society of Health-System Pharmacists, the Infectious Diseases Society of America, the Pediatric Infectious Diseases Society, and the Society of Infectious Diseases Pharmacists. Am J Health Syst Pharm 2020;77:835-64.
    Pubmed CrossRef
  5. Reuter SE, Stocker SL, Alffenaar JC, Baldelli S, Cattaneo D, Jones G, et al. Optimal practice for vancomycin therapeutic drug monitoring: position statement from the Anti-Infectives Committee of the International Association of Therapeutic Drug Monitoring and Clinical Toxicology. Ther Drug Monit 2022;44:121-32.
    Pubmed CrossRef
  6. van der Meer AF, Touw DJ, Marcus MA, Neef C, Proost JH. Influence of erroneous patient records on population pharmacokinetic modeling and individual bayesian estimation. Ther Drug Monit 2012;34:526-34.
    Pubmed CrossRef
  7. Matsumoto K, Oda K, Shoji K, Hanai Y, Takahashi Y, Fujii S, et al. Clinical practice guidelines for therapeutic drug monitoring of vancomycin in the framework of model-informed precision dosing: a consensus review by the Japanese society of chemotherapy and the Japanese society of therapeutic drug monitoring. Pharmaceutics 2022;14:489.
    Pubmed KoreaMed CrossRef
  8. Neely MN, Youn G, Jones B, Jelliffe RW, Drusano GL, Rodvold KA, et al. Are vancomycin trough concentrations adequate for optimal dosing? Antimicrob Agents Chemother 2014;58:309-16.
    Pubmed KoreaMed CrossRef
  9. Turner RB, Kojiro K, Shephard EA, Won R, Chang E, Chan D, et al. Review and validation of bayesian dose-optimizing software and equations for calculation of the vancomycin area under the curve in critically ill patients. Pharmacotherapy 2018;38:1174-83.
    Pubmed CrossRef
  10. Oda K, Hashiguchi Y, Kimura T, Tsuji Y, Shoji K, Takahashi Y, et al. Performance of area under the concentration-time curve estimations of vancomycin with limited sampling by a newly developed web application. Pharm Res 2021;38:637-46.
    Pubmed CrossRef
  11. Alsowaida YS, Kubiak DW, Dionne B, Kovacevic MP, Pearson JC. Vancomycin area under the concentration-time curve estimation using bayesian modeling versus first-order pharmacokinetic equations: a quasi-experimental study. Antibiotics (Basel) 2022;11:1239.
    Pubmed KoreaMed CrossRef
  12. Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF 3rd, Feldman HI, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med 2009;150:604-12.
    Pubmed KoreaMed CrossRef
  13. Pai MP, Neely M, Rodvold KA, Lodise TP. Innovative approaches to optimizing the delivery of vancomycin in individual patients. Adv Drug Deliv Rev 2014;77:50-7.
    Pubmed CrossRef
  14. Neef C, Touw DJ, Harteveld AR, Eerland JJ, Uges DR. Pitfalls in TDM of antibiotic drugs: analytical and modelling issues. Ther Drug Monit 2006;28:686-9.
    Pubmed CrossRef
  15. Cockcroft DW and Gault MH. Prediction of creatinine clearance from serum creatinine. Nephron 1976;16:31-41.
    Pubmed CrossRef
  16. Waikar SS and Bonventre JV. Creatinine kinetics and the definition of acute kidney injury. J Am Soc Nephrol 2009;20:672-9.
    Pubmed KoreaMed CrossRef
  17. Jelliffe RW, Schumitzky A, Guilder M. Nonpharmacokinetic clinical factors affecting aminoglycoside therapeutic precision. Drug Invest 1992;4:20-9.
    CrossRef
  18. Alihodzic D, Broeker A, Baehr M, Kluge S, Langebrake C, Wicha SG. Impact of inaccurate documentation of sampling and infusion time in model-informed precision dosing. Front Pharmacol 2020;11:172.
    Pubmed KoreaMed CrossRef
  19. Olney KB, Wallace KL, Mynatt RP, Burgess DS, Grieves K, Willett A, et al. Comparison of Bayesian-derived and first-order analytic equations for calculation of vancomycin area under the curve. Pharmacotherapy 2022;42:284-91.
    Pubmed KoreaMed CrossRef
  20. Narayan SW, Thoma Y, Drennan PG, Yejin Kim H, Alffenaar JW, Van Hal S, et al. Predictive performance of bayesian vancomycin monitoring in the critically Ill. Crit Care Med 2021;49:e952-e60.
    Pubmed CrossRef
  21. Cunio CB, Uster DW, Carland JE, Buscher H, Liu Z, Brett J, et al. Towards precision dosing of vancomycin in critically ill patients: an evaluation of the predictive performance of pharmacometric models in ICU patients. Clin Microbiol Infect 2020;27:S1198-743X(20)30388-8783e7-e14.
    Pubmed CrossRef
  22. Broeker A, Nardecchia M, Klinker KP, Derendorf H, Day RO, Marriott DJ, et al. Towards precision dosing of vancomycin: a systematic evaluation of pharmacometric models for Bayesian forecasting. Clin Microbiol Infect 2019;25:1286.e1-e7.
    Pubmed CrossRef
  23. Roydhouse SA, Carland JE, Debono DS, Baysari MT, Reuter SE, Staciwa AJ, et al. Accuracy of documented administration times for intravenous antimicrobial drugs and impact on dosing decisions. Br J Clin Pharmacol 2021;87:4273-82.
    Pubmed CrossRef
  24. Melanson SEF, Mijailovic AS, Wright APM, Szumita PM, Bates DW, Tanasijevic MJ. An intervention to improve the timing of vancomycin levels. Am J Clin Pathol 2013;140:801-6.
    Pubmed CrossRef
  25. Neely MN, Kato L, Youn G, Kraler L, Bayard D, van Guilder M, et al. Prospective trial on the use of trough concentration versus area under the curve to determine therapeutic vancomycin dosing. Antimicrob Agents Chemother 2018;62:e02042-17.
    Pubmed KoreaMed CrossRef
  26. Brocks DR and Hamdy DA. Bayesian estimation of pharmacokinetic parameters: an important component to include in the teaching of clinical pharmacokinetics and therapeutic drug monitoring. Res Pharm Sci 2020;15:503-14.
    Pubmed KoreaMed CrossRef
  27. Kim HK, Park HD, Lee SG, Chae H, Song SH, Lee YW, et al. Immunosuppressive drug measurement by liquid chromatography coupled to tandem mass spectrometry: interlaboratory comparison in the Korean clinical laboratories. Ann Lab Med 2021;41:268-76.
    Pubmed KoreaMed CrossRef
  28. Choi R, Chun MR, Park J, Lee JW, Ju HY, Cho HW, et al. Quantification of thioguanine in DNA using liquid chromatography-tandem mass spectrometry for routine thiopurine drug monitoring in patients with pediatric acute lymphoblastic leukemia. Ann Lab Med 2021;41:145-54.
    Pubmed KoreaMed CrossRef
  29. Sonoda A, Iwashita Y, Takada Y, Hamazono R, Ishida K, Imamura H. Prediction accuracy of area under the concentration-time curve of vancomycin by Bayesian approach using creatinine-based equations of estimated kidney function in bedridden elderly Japanese patients. Biol Pharm Bull 2022;45:763-9.
    Pubmed CrossRef
  30. Choi R, Woo HI, Park HD, Lee SY. A nationwide utilization survey of therapeutic drug monitoring for five antibiotics in South Korea. Infect Drug Resist 2019;12:2163-73.
    Pubmed KoreaMed CrossRef
  31. Lim HS, Chong YP, Noh YH, Jung JA, Kim YS. Exploration of optimal dosing regimens of vancomycin in patients infected with methicillin-resistant Staphylococcus aureus by modeling and simulation. J Clin Pharm Ther 2014;39:196-203.
    Pubmed CrossRef
  32. Kim DJ, Lee DH, Ahn S, Jung J, Kiem S, Kim SW, et al. A new population pharmacokinetic model for vancomycin in patients with variable renal function: therapeutic drug monitoring based on extended covariate model using CKD-EPI estimation. J Clin Pharm Ther 2019;44:750-9.
    Pubmed CrossRef
  33. Bae SH, Yim DS, Lee H, Park AR, Kwon JE, Sumiko H, et al. Application of pharmacometrics in pharmacotherapy: open-source software for vancomycin therapeutic drug management. Pharmaceutics 2019;11.
    Pubmed KoreaMed CrossRef
  34. Lee BV, Fong G, Bolaris M, Neely M, Minejima E, Kang A, et al. Cost-benefit analysis comparing trough, two-level AUC and Bayesian AUC dosing for vancomycin. Clin Microbiol Infect 2021;27:1346.e1-e7.
    Pubmed CrossRef