Skip to main content
Download PDF

Development of biomarker combinations for postoperative acute kidney injury via Bayesian model selection in a multicenter cohort study

Biomarker Research volume 6, Article number: 3 (2018) Cite this article

Abstract

Background

Acute kidney injury (AKI) is a frequent complication of cardiac surgery. We sought prognostic combinations of postoperative biomarkers measured within 6 h of surgery, potentially in combination with cardiopulmonary bypass time (to account for the degree of insult to the kidney). We used data from a large cohort of patients and adapted methods for developing biomarker combinations to account for the multicenter design of the study.

Methods

The primary endpoint was sustained mild AKI, defined as an increase of 50% or more in serum creatinine over preoperative levels lasting at least 2 days during the hospital stay. Severe AKI (secondary endpoint) was defined as a serum creatinine increase of 100% or more or dialysis during hospitalization. Data were from a cohort of 1219 adults undergoing cardiac surgery at 6 medical centers; among these, 117 developed sustained mild AKI and 60 developed severe AKI. We considered cardiopulmonary bypass time and 22 biomarkers as candidate predictors. We adapted Bayesian model averaging methods to develop center-adjusted combinations for sustained mild AKI by (1) maximizing the posterior model probability and (2) retaining predictors with posterior variable probabilities above 0.5. We used resampling-based methods to avoid optimistic bias in evaluating the biomarker combinations.

Results

The maximum posterior model probability combination included plasma N-terminal-pro-B-type natriuretic peptide, plasma heart-type fatty acid binding protein, and change in serum creatinine from before to 0–6 h after surgery; the median probability combination additionally included plasma interleukin-6. The center-adjusted, optimism-corrected AUCs for these combinations were 0.80 (95% CI: 0.78, 0.87) and 0.81 (0.78, 0.87), respectively, for predicting sustained mild AKI, and 0.81 (0.76, 0.90) and 0.83 (0.76, 0.90), respectively, for predicting severe AKI. For these data, the Bayesian model averaging methods yielded combinations with prognostic capacity comparable to that achieved by standard frequentist methods but with more parsimonious models.

Conclusions

Pending external validation, the identified combinations could be used to identify individuals at high risk of AKI immediately after cardiac surgery and could facilitate clinical trials of renoprotective agents.

Background

Acute kidney injury (AKI) is a frequent complication of cardiac surgery (prevalence: 17–49%) and has serious implications for long-term health [1]. AKI is typically diagnosed on the basis of an increase in serum creatinine over preoperative levels, which often does not occur until several days after the initial injury. Identifying individuals at high risk for AKI immediately following surgery could lead to improved patient outcomes and the development of novel treatment strategies, and is cited as an important step in preventing AKI after cardiac surgery [1].

One strategy for identifying individuals at high risk of AKI after cardiac surgery is to develop a multivariable prognostic model. With that overarching aim in mind, our goal was to identify combinations of variables with strong evidence of prognostic capacity. A first step in developing such combinations is selecting candidate predictors. In the setting of cardiac surgery, most clinical risk factors have modest associations with AKI [2]. One exception is cardiopulmonary bypass (CPB) time, which is strongly associated with AKI after cardiac surgery and has a clear biological relationship with the development of AKI [3, 4]. In addition to CPB time, several biomarkers of kidney injury, inflammation, and cardiac function have been shown to have strong associations with AKI [5,6,7,8]. These biomarkers offer the potential to identify patients at high risk of AKI after cardiac surgery, and their application has been encouraged by several consensus conferences [9].

Although CPB time and several biomarkers are strongly associated with risk of AKI, their individual prognostic capacity is modest [5, 6]. However, it may be possible to construct combinations of these variables with higher prognostic capacity. Pursuing such a combination is also biologically motivated since CPB time can be considered to be a measure of the degree of insult to the kidney while the postoperative biomarkers may reflect the response to this insult. Thus, we used Bayesian model averaging (BMA) methods to identify prognostic combinations of postoperative biomarkers (Table 1) and CPB time in a large, multicenter cohort of cardiac surgery patients.

Table 1 Candidate biomarkers (measured 0–6 h after surgery)
Full size table

Methods

Study population

This is a secondary analysis of the Translational Research Investigating Biomarker Endpoints in AKI (TRIBE-AKI) study. This study enrolled adults undergoing coronary artery bypass graft (CABG) and/or valve surgery at six academic medical centers in North America between July 2007 and December 2009. Enrollment criteria included increased risk for AKI by any of the following criteria: emergency surgery, preoperative serum creatinine >2 mg/dL, ejection fraction <35% or grade 3 or 4 left ventricular dysfunction, age > 70 years, diabetes mellitus, concomitant CABG and valve surgery, or repeat revascularization surgery. In addition, individuals with evidence of AKI before surgery, prior kidney transplantation, preoperative serum creatinine level > 4.5 mg/dL, or end-stage renal disease were excluded. All participants provided written informed consent and each institution’s research ethics board approved the study.

Sample collection

Urine and EDTA plasma specimens were collected preoperatively and daily for up to five postoperative days. The first postoperative samples were collected soon after admission to the intensive care unit (0–6 h after surgery). The present investigation considers biomarkers measured at this time point.

Fresh urine samples were obtained from the urimeter of the Foley catheter system and were centrifuged to remove cellular debris. Blood was collected in EDTA tubes and centrifuged to separate plasma. Urine supernatant and plasma were aliquoted into bar-coded cryovials and stored at −80 °C until biomarker measurement. No additives or protease inhibitors were added. Additional details regarding sample collection and storage were provided in earlier reports [5].

Biomarkers

We included 15 blood and 7 urine biomarkers in this study (Table 1), including three variations of serum creatinine: first postoperative (measured 0–6 h after surgery), absolute difference between preoperative and first postoperative, and average of preoperative and first postoperative. Biomarker measurements were detailed in prior publications [5, 7, 10,11,12,13,14,15,16,17].

Outcome definitions

The primary outcome was sustained mild AKI, defined as an increase of 50% or more in serum creatinine over preoperative levels lasting at least 2 days during the hospital stay. We chose the sustained mild AKI definition to identify patients most likely to have true kidney injury and to limit misclassification of controls with isolated elevations in serum creatinine due to laboratory variation in creatinine assay, volume disturbances, or hemodynamic derangements [18]. We also considered severe AKI, defined as an increase in serum creatinine of 100% or more or dialysis during hospitalization, as a secondary outcome. Preoperative serum creatinine, collected within 2 months prior to surgery, served as baseline. Pre- and postoperative serum creatinine were measured by the same laboratory for each patient at all centers.

As a secondary analysis, we considered the outcomes of death from all causes at 1 year and 3 years after surgery, which were observed without censoring. We obtained vital status after discharge through various mechanisms. For participants living in the United States, we performed phone calls to patients’ homes, searched the National Death Index, and reviewed hospital records. For Canadian participants, we used phone calls, as well as data held at the Institute for Clinical Evaluative Sciences (ICES) to acquire vital status. The death status and date of death were recorded. These datasets were linked using unique, encoded identifiers and analyzed at ICES.

Statistical methods

Primary analysis

We used BMA methods to identify combinations of biomarkers and CPB time. All biomarkers were log-transformed and CPB time was included as a linear term. Urine biomarkers were not normalized to urine creatinine, though urine creatinine was included as a candidate predictor.

BMA involves assigning each variable a prior probability of being useful for prediction; these prior variable probabilities induce a prior probability for each combination, where the combinations are defined by allowing CPB time and each biomarker to either be included or excluded. The method combines these prior probabilities and the data via Bayes’ theorem to calculate a posterior probability for each combination (“posterior model probability”) and a posterior probability for each variable (“posterior variable probability”) [19,20,21]. The posterior model probability is a measure of the degree to which the model is supported by the data [22]. Similarly, the posterior variable probability reflects the support in the data for the variable as a predictor of the outcome [23]. The BMA framework can be used for variable selection on the basis of posterior model probabilities or posterior variable probabilities. The BMA approach considers all possible combinations and applies a “leaps and bounds” algorithm to identify the most promising combinations for further consideration; this process provides computational feasibility for searching the large space of candidate models (8,388,608 candidate models given 23 candidate predictors) [19].

In our implementation of BMA, we assigned each biomarker and CPB time a prior probability of ½, meaning that each predictor was a priori as likely to be in the model as not. It is possible to incorporate prior information into these probabilities, but we elected to treat all of the candidate predictors equally. These prior probabilities yield a prior probability for each combination of (0.5)23 = 1.19 × 10−7, as there are 23 candidate variables. To account for possible center differences, we considered center-adjusted combinations by forcing center to be included in each combination evaluated by BMA. We pre-specified to select two combinations on the basis of the BMA analysis: (1) the maximum posterior model probability combination (the combination with the highest posterior model probability) and (2) the median probability combination (the combination consisting of all predictors with posterior variable probability exceeding 50%) [21].

We applied BMA to our data to develop combinations for predicting sustained mild AKI. After identifying the maximum posterior model probability combination and the median probability combination, we fit a center-adjusted logistic regression to the biomarkers included in these combinations, with sustained mild AKI as the outcome. Using the estimates from these regressions, we estimated the center-adjusted and optimism-corrected area under the receiver operating characteristic curve (AUC) of each combination for sustained mild AKI and for our secondary outcome, severe AKI. First, we estimated the apparent center-adjusted AUC for each combination and each outcome [24]. Then, we estimated the optimism in the center-adjusted AUC for each combination and each outcome using a bootstrapping procedure with 1000 replications [25]. In each bootstrap sample we repeated the entire model selection process. We subtracted the average optimism across bootstrap datasets from the apparent center-adjusted AUC to estimate the center-adjusted and optimism-corrected AUC. Figure 1 describes the analysis in detail. Importantly, this approach addresses model selection bias, resubstitution bias, and potential bias due to center differences [26]. We emphasize that without optimism correction, estimated AUCs will tend to be overestimated due to both resubstitution bias (i.e., using the same data to develop and evaluate a combination) and model selection bias (i.e., using the data to select the model). By accounting for these sources of optimistic bias, we have a more realistic assessment of how the combinations may perform in independent data. This procedure does not supplant external validation. Rather, this is a form of internal validation where the full dataset is used to fit the combination and estimate its apparent performance, followed by bootstrapping to quantify the optimistic bias in the apparent performance. Confidence intervals (CIs) were estimated for the center-adjusted and optimism-corrected AUC by bootstrapping the BMA procedure and obtaining a 95% CI for the apparent center-adjusted AUC, and then shifting the confidence interval by the average optimism.

Fig. 1
figure 1

Analysis flow. Legend: Abbreviations: AKI = acute kidney injury; BMA = Bayesian model averaging; AUC = area under the receiver operating characteristic curve

Full size image

Our primary measure of model performance was the AUC, which measures how well a combination discriminates cases from controls. We acknowledge the limitations of the AUC and that it represents an incomplete assessment. Our goal was to propose combinations with high prognostic capacity and the potential to be developed into useful risk prediction models, and we were particularly concerned with avoiding common sources of bias in identifying prognostic combinations, including possible center differences [27]. The adjustment for center does not allow for individual predicted risks. Therefore, we do not assess model calibration in this work, as we do not propose risk prediction models. However, if these combinations are later developed into risk prediction models, an assessment of calibration will be required.

We considered several model diagnostics, including the posterior model probability of the selected combinations across bootstrap samples, the posterior variable probability of each predictor across bootstrap samples, the posterior variable probability of each predictor omitting each observation in turn, and the performance of the estimated selected combinations across bootstrap samples.

Exploratory analysis

In an exploratory analysis, we compared the performance of the BMA procedure to two common variable selection methods: forward selection and univariate selection. The following algorithm was used to compare the three methods. We randomly split the data into training and test datasets of equal size with equal numbers of sustained mild AKI cases. We then applied each of the three model selection methods to the training data. First, we applied BMA and identified the maximum posterior model probability combination and the median probability combination. Second, we applied forward selection with a p-value threshold of 0.1. Third, we applied univariate selection, forming a combination of all variables with a p-value less than 0.1. All methods used center-adjustment. In each iteration we applied the resulting combinations to the test data and estimated the center-adjusted AUC for the combination using the test data only; thus, we performed internal validation whereby the training dataset was used for fitting while the test dataset was held out for evaluation. We repeated this procedure 1000 times, independently randomly splitting the data into training and test datasets each time. We calculated 95% intervals as the 2.5th and 97.5th percentiles of the AUC across these 1000 replications.

Secondary analysis

As a secondary analysis, we evaluated the association of the biomarker combinations identified by the BMA methods with death at 1 year and 3 years after surgery. For each biomarker combination and each time point (1 year and 3 years), we fit a logistic regression model with the fixed estimated biomarker combination, adjusting for center. We used the full dataset to estimate the odds ratio describing the association between the combination and death. We can consider the two estimated combinations, M 1 and M 2 , where M 1 has p variables (denoted by X), combined via the parameters β1, …, β2, and M 2 has q variables (denoted by Y), combined via the parameters α1, …, α q :

$$ {M}_1={\beta}_1{X}_1+\dots +{\beta}_p{X}_p $$
$$ {M}_2={\alpha}_1{Y}_1+\dots +{\alpha}_q{Y}_q. $$

The odds ratio for the association between the combination and death was estimated by fitting two logistic regressions for each time point (1 year and 3 years):

$$ logit\ P\left( Death| Center,{M}_1\right)={\delta}_0^C+{\delta}_1{M}_1 $$
$$ logit\ P\left( Death| Center,{M}_2\right)={\theta}_0^C+{\theta}_1{M}_2, $$

where \( {\delta}_0^C \) and \( {\theta}_0^C \) are center-specific intercepts.

All analyses were completed using R 3.1.2. The BMA package in R was used for the BMA analyses [28]. The R code for the primary analysis is provided in (Additional file 1: Item S1) and at https://github.com/allisonmeisner/BMAbiomarkers.

Results

Table 2 characterizes the study population. There were 1219 patients in the full dataset, including 117 sustained mild AKI cases and 60 severe AKI cases (55 patients had both outcomes). Approximately 300 individuals were missing one or more candidate variable measurements and were excluded from the BMA analysis, leaving 899 observations, including 84 sustained mild AKI cases and 42 severe AKI cases (Fig. 1). The prevalence of sustained mild AKI and severe AKI were similar among the individuals with and without missing data.

Table 2 Demographics and clinical variables by sustained mild AKI status
Full size table

Primary analysis

Table 3 gives the results from the primary BMA analyses. The maximum posterior model probability combination included plasma N-terminal-pro-B-type natriuretic peptide (NT-proBNP), plasma heart-type fatty acid binding protein (h-FABP), and absolute change in serum creatinine from before to 0–6 h after surgery. The center-adjusted, optimism-corrected AUC for this combination was 0.80 (95% CI: 0.78, 0.87) for sustained mild AKI and 0.81 (0.76, 0.90) for severe AKI. The median probability combination model included plasma interleukin-6 (IL-6), plasma NT-proBNP, plasma h-FABP, and change in serum creatinine. The center-adjusted, optimism-corrected AUC for this combination was 0.81 (0.78, 0.87) for sustained mild AKI and 0.83 (0.76, 0.90) for severe AKI. Recall that these AUCs are estimated by first using the full dataset to fit the combinations and estimate their apparent performance, then applying the bootstrap to estimate the optimistic bias in this apparent performance. For comparison, the biomarker with the highest individual center-adjusted AUC for sustained mild AKI was change in serum creatinine; the center-adjusted AUC for this biomarker alone was 0.76, outside of the 95% CI for the two BMA combinations. The posterior model probability (a measure on the probability scale of the support for the model in the data) for the two combinations was 0.20. (Additional file 1: Figures S1 and S2) illustrate the distribution of the biomarker combinations. (Additional file 1: Figure S3) includes the distributions of three biomarkers among sustained mild AKI controls, stratified by center. These distributions vary by center, providing evidence that center should be taken into account when interpreting the biomarkers. The posterior variable probabilities for each candidate predictors are given in Additional file 1: Table S1.

Table 3 Combinations selected by BMA methods and their estimated performance
Full size table

The model diagnostics considered for BMA (Additional file 1: Figures S4-S7) indicated variability in the posterior model probabilities and posterior variable probabilities across bootstrap samples, as well as some potentially influential observations. Importantly, however, the AUCs of the estimated selected combinations were reasonably stable across bootstrap samples. Finally, in order to explore the impact of deleting observations with missing data, we compared the results of a multiple imputation analysis to the results of our complete-case analysis (Additional file 1: Item S2). We found similar results in terms of the combinations selected and the performance of the selected combinations.

Exploratory analysis

Figure 2 summarizes the results of the analysis comparing BMA, forward selection and univariate selection. For all three methods, incomplete observations were removed, leaving 899 observations. Univariate selection had the highest average AUC by a small margin, although all methods performed comparably. The mean center-adjusted AUC across sample splits (where the combinations were fitted in the training dataset and evaluated in the held out test dataset) was 0.81 (95% interval: 0.75, 0.86), 0.80 (0.74, 0.87), 0.81 (0.75, 0.86) and 0.81 (0.75, 0.87) for the BMA maximum posterior model probability combination, the BMA median probability combination, forward selection, and univariate selection, respectively. The advantage of BMA in these data appears to be parsimony; the median number of predictors included in the selected combinations was three for both BMA combinations, five for forward selection, and 17 for univariate selection.

Fig. 2
figure 2

Distribution of AUC estimates by selection approach. Legend: Abbreviations: BMA = Bayesian model averaging; AUC = area under the receiver operating characteristic curve.The mean AUC (point) and 2.5th and 97.5th quantiles of AUC (line) across 1000 sample splits are given. The median (interquartile range) combination size for each approach is given in square brackets in the horizontal axis labels

Full size image

Secondary analysis

For the secondary analysis of mortality, individuals missing any of the biomarkers in the selected combinations were excluded, leaving 934 participants. At 1 year after surgery, 41 individuals had died; by 3 years, 89 participants had died. For the outcome of death at 1 year, the maximum posterior model probability combination (plasma NT-proBNP, plasma h-FABP, and change in serum creatinine) had a center-adjusted odds ratio per standard deviation of 1.61 (95% CI: 1.21, 2.15) while the median probability combination (plasma IL-6, plasma NT-proBNP, plasma h-FABP, and change in serum creatinine) had a center-adjusted odds ratio per standard deviation of 1.72 (1.28, 2.31). For death at 3 years, the maximum posterior model probability combination had a center-adjusted odds ratio per standard deviation of 1.61 (1.29, 1.99) while the median probability combination had a center-adjusted odds ratio per standard deviation of 1.72 (1.37, 2.15).

Discussion

We used BMA methods to develop two biomarker combinations with the potential to identify individuals at high risk of AKI after cardiac surgery. The combinations demonstrated good discriminatory performance as measured by the AUC, even after addressing several sources of bias common in the evaluation of risk prediction models [26]. Furthermore, the combinations performed well not only in identifying individuals at high risk of sustained mild AKI, for which they were constructed, but also the more commonly used outcome of severe AKI. Using the outcome of sustained mild AKI provided a larger sample size than severe AKI, and we believe it limited the number of controls misclassified as cases compared to transient mild AKI. We also provided evidence that the combinations developed to predict sustained mild AKI are associated with mortality. Prior to their adoption, these combinations must be validated externally.

The three novel biomarkers included in the combinations identified in our analysis were plasma NT-proBNP, plasma IL-6, and plasma h-FABP, all of which were positively associated with sustained mild AKI in our data. Plasma NT-proBNP has been previously shown to be positively associated with mortality and cardiovascular disease in patients with stable coronary heart disease [29], with AKI in critically ill patients [30], and with AKI and AKI-associated mortality in patients with acute heart failure [31]. Likewise, plasma IL-6 has been shown to be positively associated with mortality in acute heart failure [32] and with AKI in patients with sepsis [33]. Plasma h-FABP has previously been shown to be positively associated with AKI in patients undergoing cardiac surgery [34].

A limitation of this study is that we developed prognostic biomarker combinations, not risk prediction models. These combinations (if validated) can be used to identify high-risk participants, but, in their current form, they cannot be used to estimate risk of AKI. This is a consequence of accounting for center in our analysis in order to avoid possible bias resulting from differences among centers. Several important steps are required to develop either of the proposed combinations into a risk prediction model: (1) validation of the prognostic capacity of the combination on independent data; (2) standardization of biomarker measurements across centers and laboratories; and (3) transformation of the “combination score” to the risk scale and establishing risk model calibration. Thus, the identification of prognostic combinations represents an intermediate step on the path to a risk prediction model.

This study had several strengths, including its sample size, the number of biomarkers measured, and the use of rigorous statistical methods to assess performance. All statistical analyses were pre-specified, including pre-specification of the summaries to be reported. Our analyses indicate that in these data, the BMA methods yielded combinations with prognostic capacity comparable to that achieved by forward and univariate selection but with smaller models. In other words, the BMA methods offered combinations with similar performance at reduced cost. Such parsimony may be desirable as using a smaller combination may be more affordable and practical. This was achieved without sacrificing computational efficiency: it took 3.2 s to apply BMA to our data using a personal Windows laptop. In addition, there is evidence in our data that the combinations identified by the BMA methods are associated with postoperative mortality. Further research is needed to determine whether these biomarker combinations can be used to identify individuals at high risk of death following cardiac surgery.

If these combinations are found to perform well in independent data, they could be used to enrich clinical trial enrollment, thereby increasing the likelihood of identifying new AKI therapies. For illustrative purposes, we present examples of this strategy, termed “prognostic enrichment” [35], in Table 4. For instance, if a researcher were interested in developing a treatment for severe AKI, he could use the biomarker combinations developed here to calculate a biomarker “score” for prospective trial participants (using each individual’s biomarker values and the estimated coefficients for each biomarker) and enroll individuals above some threshold. If the 75th percentile of the median probability combination was used as a threshold, the sample size required to achieve 90% power (alpha = 0.05) for a treatment that decreases AKI risk by 30% could be reduced from nearly 8200 to 2286 (note that such a strategy would require screening four individuals to identify one eligible for the study).

Table 4 Clinical trial enrichment for severe AKI
Full size table

Conclusions

Using BMA methods with data from a large, multicenter study, we have developed biomarker combinations and provided strong evidence that they are able to identify patients at high risk of AKI after cardiac surgery in our data. These combinations could be used in the development of treatments for AKI, potentially reducing the associated morbidity and mortality and improving long-term health after cardiac surgery.

Abbreviations

AKI:

Acute kidney injury

AUC:

Area under the receiver operating characteristic curve

BMA:

Bayesian model averaging

CABG:

Coronary artery bypass graft

CI:

Confidence interval

CPB:

Cardiopulmonary bypass

h-FABP:

Heart-type fatty acid binding protein

ICES:

Institute for Clinical Evaluative Sciences

IL-6:

Interleukin-6

NT-proBNP:

N-terminal-pro-B-type natriuretic peptide

TRIBE-AKI:

Translational Research Investigating Biomarker Endpoints in Acute Kidney Injury

References

  1. Thiele RH, Isbell JM, Rosner MH. AKI associated with cardiac surgery. Clin J Am Soc Nephrol. 2015;10(3):500–14.

    Article  PubMed  Google Scholar 

  2. Huen SC, Parikh CR. Predicting acute kidney injury after cardiac surgery: a systematic review. Ann Thorac Surg. 2012;93(1):337–47.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Kuitunen A, Vento A, Suojaranta-Ylinen R, Pettila V. Acute renal failure after cardiac surgery: evaluation of the RIFLE classification. Ann Thorac Surg. 2006;81(2):542–6.

    Article  PubMed  Google Scholar 

  4. Fischer UM, Weissenberger WK, Warters RD, Geissler HJ, Allen SJ, Mehlhorn U. Impact of cardiopulmonary bypass management on postcardiac surgery renal function. Perfusion. 2002;17(6):401–6.

    Article  PubMed  Google Scholar 

  5. Parikh CR, Coca SG, Thiessen-Philbrook H, Shlipak MG, Koyner JL, Wang Z, et al. Postoperative biomarkers predict acute kidney injury and poor outcomes after adult cardiac surgery. J Am Soc Nephrol. 2011;22(9):1748–57.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Parikh CR, Devarajan P, Zappitelli M, Sint K, Thiessen-Philbrook H, Li S, et al. Postoperative biomarkers predict acute kidney injury and poor outcomes after pediatric cardiac surgery. J Am Soc Nephrol. 2011;22(9):1737–47.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Zhang WR, Garg AX, Coca SG, Devereaux PJ, Eikelboom J, Kavsak P, et al. Plasma IL-6 and IL-10 concentrations predict AKI and long-term mortality in adults after cardiac surgery. J Am Soc Nephrol. 2015;26(12):3123–32.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Patel UD, Garg AX, Krumholz HM, Shlipak MG, Coca SG, Sint K, et al. Preoperative serum brain natriuretic peptide and risk of acute kidney injury after cardiac surgery. Circulation. 2012;125(11):1347–55.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Murray PT, Mehta RL, Shaw A, Ronco C, Endre Z, Kellum JA, et al. Potential use of biomarkers in acute kidney injury: report and summary of recommendations from the 10th Acute Dialysis Quality Initiative consensus conference. Kidney Int. 2014;85(3):513–21.

  10. Molnar AO, Parikh CR, Sint K, Coca SG, Koyner J, Patel UD, et al. Association of postoperative proteinuria with AKI after cardiac surgery among patients at high risk. Clin J Am Soc Nephrol. 2012;7(11):1749–60.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Parikh CR, Thiessen-Philbrook H, Garg AX, Kadiyala D, Shlipak MG, Koyner JL, et al. Performance of kidney injury molecule-1 and liver fatty acid-binding protein and combined biomarkers of AKI after cardiac surgery. Clin J Am Soc Nephrol. 2013;8(7):1079–88.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Koyner JL, Garg AX, Shlipak MG, Patel UD, Sint K, Hong K, et al. Urinary cystatin C and acute kidney injury after cardiac surgery. Am J Kidney Dis. 2013;61(5):730–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Koyner JL, Garg AX, Thiessen-Philbrook H, Coca SG, Cantley LG, Peixoto A, et al. Adjudication of etiology of acute kidney injury: experience from the TRIBE-AKI multi-center study. BMC Nephrol. 2014;15:105.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Spahillari A, Parikh CR, Sint K, Koyner JL, Patel UD, Edelstein CL, et al. Serum cystatin C- versus creatinine-based definitions of acute kidney injury following cardiac surgery: a prospective cohort study. Am J Kidney Dis. 2012;60(6):922–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Schaub JA, Garg AX, Coca SG, Testani JM, Shlipak MG, Eikelboom J, et al. Perioperative heart-type fatty acid binding protein is associated with acute kidney injury after cardiac surgery. Kidney Int. 2015;88(3):576–83.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Bucholz EM, Whitlock RP, Zappitelli M, Devarajan P, Eikelboom J, Garg AX, et al. Cardiac biomarkers and acute kidney injury after cardiac surgery. Pediatrics. 2015;135(4):e945–56.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Kavsak PA, Newman AM, Ko DT, Macrae AR, Jaffe AS. The use of a cytokine panel to define the long-term risk stratification of heart failure/death in patients presenting with chest pain to the emergency department. Clin Biochem. 2010;43(4–5):505–7.

    Article  CAS  PubMed  Google Scholar 

  18. Lin J, Fernandez H, Shashaty M, Negoianu D, Testani J, Berns J, et al. False-positive rate of AKI using consensus creatinine–based criteria. Clin J Am Soc Nephrol. 2015;10(10):1723–31.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Hoeting J, Madigan D, Raftery A, Volinsky C. Bayesian model averaging: a tutorial. Stat Sci. 1999;14(4):382–417.

    Article  Google Scholar 

  20. Raftery AE, Madigan D, Hoeting JA. Bayesian model averaging for linear regression models. JASA. 1997;92(437):179–91.

    Article  Google Scholar 

  21. Barbieri MM, Berger JO. Optimal predictive model selection. Ann Stat. 2004;32(3):870–97.

    Article  Google Scholar 

  22. Clyde MA. Bayesian model averaging and model search strategies. In: Bernardo JM, Berger JO, Dawid AP, Smith AFM, editors. Bayesian Statistics 6: Oxford University Press; 1999. p. 157–85.

  23. Viallefont V, Raftery AE, Richardson S. Variable selection and Bayesian model averaging in case-control studies. Stat Med. 2001;20(21):3215–30.

    Article  CAS  PubMed  Google Scholar 

  24. Janes H, Longton G, Pepe M. Accommodating covariates in ROC analysis. Stata J. 2009;9(1):17–39.

    PubMed  PubMed Central  Google Scholar 

  25. Harrell FE, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.

    Article  PubMed  Google Scholar 

  26. Kerr KF, Meisner A, Thiessen-Philbrook H, Coca SG, Parikh CR. RiGoR: reporting guidelines to address common sources of bias in risk model development. Biomark Res. 2015;3(1):2.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Meisner A, Kerr K, Thiessen-Philbrook H, Coca S, Parikh C. Methodological issues in current practice may lead to bias in the development of biomarker combinations for predicting acute kidney injury. Kidney Int. 2016;89(2):429–38.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Raftery AE, Painter I, Volinsky CT. BMA: an R package for Bayesian model averaging. R News. 2005;5(2):2–8.

    Google Scholar 

  29. Bibbins-Domingo K, Gupta R, Na B, Wu AH, Schiller NB, Whooley MA. N-terminal fragment of the prohormone brain-type natriuretic peptide (NT-proBNP), cardiovascular events, and mortality in patients with stable coronary heart disease. JAMA. 2007;297(2):169–76.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Determann RM, Royakkers AA, Schaefers J, de Boer AM, Binnekade JM, van Straalen JP, et al. Serum levels of N-terminal proB-type natriuretic peptide in mechanically ventilated critically ill patients--relation to tidal volume size and development of acute respiratory distress syndrome. BMC Pulm Med. 2013;13:42.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Lassus JP, Nieminen MS, Peuhkurinen K, Pulkki K, Siirila-Waris K, Sund R, et al. Markers of renal function and acute kidney injury in acute heart failure: definitions and impact on outcomes of the cardiorenal syndrome. Eur Heart J. 2010;31(22):2791–8.

    Article  CAS  PubMed  Google Scholar 

  32. Lassus JP, Harjola VP, Peuhkurinen K, Sund R, Mebazaa A, Siirila-Waris K, et al. Cystatin C, NT-proBNP, and inflammatory markers in acute heart failure: insights into the cardiorenal syndrome. Biomarkers. 2011;16(4):302–10.

    Article  CAS  PubMed  Google Scholar 

  33. Chawla LS, Seneff MG, Nelson DR, Williams M, Levy H, Kimmel PL, et al. Elevated plasma concentrations of IL-6 and elevated APACHE II score predict acute kidney injury in patients with severe sepsis. Clin J Am Soc Nephrol. 2007;2(1):22–30.

    Article  CAS  PubMed  Google Scholar 

  34. Oezkur M, Gorski A, Peltz J, Wagner M, Lazariotou M, Schimmer C, et al. Preoperative serum h-FABP concentration is associated with postoperative incidence of acute kidney injury in patients undergoing cardiac surgery. BMC Cardiovasc Disord. 2014;14:117.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Temple R. Enrichment of clinical study populations. Clin Pharmacol Ther. 2010;88(6):774–8.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The biomarker tests were provided (in kind) by Beckman Coulter, Randox Laboratories, and Roche Diagnostics.

Funding

The research was supported by the NIH grant R01HL085757 (CRP) to fund the Translational Research Investigating Biomarker Endpoints in AKI (TRIBE-AKI) Consortium to study novel biomarkers of acute kidney injury in cardiac surgery. AM is supported by the NIH grant F31DK108356. CRP is also supported by NIH grant K24DK090203. SGC is supported by National Institutes of Health Grants K23DK080132 and R01DK096549. SGC and CRP are also members of the NIH-sponsored ASsess, Serial Evaluation, and Subsequent Sequelae in Acute Kidney Injury (ASSESS-AKI) Consortium (U01DK082185). This study was supported by the Institute for Clinical Evaluative Sciences (ICES), which is funded by an annual grant from the Ontario Ministry of Health and Long-Term Care. No endorsement by ICES or the Ontario Ministry of Health and Long-Term Care is intended or should be inferred. The opinions, results, and conclusions reported in this article are those of the authors and are independent of the funding sources.

Availability of data and materials

The dataset analyzed in this work is not publicly available as such widespread sharing of TRIBE-AKI study data was not stipulated in the ethics approval for the study. The TRIBE-AKI principal investigator (CRP) may be contacted.

Author information

Authors and Affiliations

  1. Department of Biostatistics, University of Washington, Box 357232, Seattle, WA, 98195, USA

    Allison Meisner & Kathleen F. Kerr

  2. Program of Applied Translational Research, Yale University School of Medicine and VA Medical Center, 60 Temple Street, Suite 6C, New Haven, CT, 06510, USA

    Heather Thiessen-Philbrook, Francis Perry Wilson & Chirag R. Parikh

  3. Veterans Affairs Medical Center, West Haven, CT, 06516, USA

    Francis Perry Wilson & Chirag R. Parikh

  4. Division of Nephrology, Department of Medicine and Department of Epidemiology and Biostatistics, Western University, London, Canada

    Amit X. Garg

  5. Institute for Clinical Evaluative Services (ICES) Western, Room ELL-220, Westminster Tower, London Health Sciences Centre, 800 Commissioners Road East, London, ON, N6C 6B5, Canada

    Amit X. Garg

  6. Kidney Health Research Collaborative, San Francisco VA Medical Center and University of California at San Francisco School of Medicine, 4150 Clement Street, San Francisco, CA, 94121, USA

    Michael G. Shlipak

  7. Department of Pathology and Molecular Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada

    Peter Kavsak

  8. Department of Surgery, McMaster University, Hamilton, ON, Canada

    Richard P. Whitlock

  9. Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, Box 1243, New York, NY, 10029, USA

    Steven G. Coca

  10. Section of Nephrology, Yale University School of Medicine, 60 Temple Street, Suite 6C, New Haven, CT, 06510, USA

    Chirag R. Parikh

Authors
  1. Allison Meisner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kathleen F. Kerr
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Heather Thiessen-Philbrook
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Francis Perry Wilson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Amit X. Garg
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michael G. Shlipak
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Peter Kavsak
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Richard P. Whitlock
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Steven G. Coca
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Chirag R. Parikh
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CRP, MGS, AXG, SGC, PK, RPW, HTP and FPW designed and conducted the study. AM, KFK, HTP, SGC and CRP conceived and designed the analysis. AM and HTP performed the analysis, and AM, KFK, HTP, CRP and SGC interpreted the results. AM drafted the manuscript, with substantial revision by KFK, HTP, SGC and CRP and additional revision by FPW, AXG, MGS, PK and RPW. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Chirag R. Parikh.

Ethics declarations

Ethics approval and consent to participate

All participants provided written informed consent and each institution’s research ethics board approved the study.

Consent for publication

Not applicable.

Competing interests

PK has received grants/honorarium/consultancies from Abbott Laboratories, Beckman Coulter, Ortho Clinical Diagnostics, Randox Laboratories, Roche Diagnostics, and Siemens Healthcare Diagnostics for laboratory/biomarker testing.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1: Item S1.

R code for the primary analysis. Figure S1. Distribution of biomarker combinations in the largest center, stratified by sustained mild AKI case status (scaled). Figure S2. Distribution of biomarker combinations in the largest center, stratified by sustained mild AKI case status. Figure S3. Distribution of three biomarkers (log plasma NT-proBNP, change in sCr, and log plasma h-FABP) among controls (individuals without sustained mild AKI), stratified by center. Table S1. Posterior variable probabilities for each candidate predictor. Figure S4. Posterior model probability of the combinations selected by the BMA methods across the 1000 bootstrap samples. The first plot corresponds to the maximum posterior probability combination and the second plot corresponds to the median probability combination. “Truncated” means the combination was not considered by the BMA algorithm in that particular bootstrap sample; the truncated value is the minimum posterior model probability in that sample. “Index” indicates the bootstrap sample number. Figure S5. Posterior variable probabilities for each of the candidate predictors across 1000 bootstrap samples. “Index” indicates the bootstrap sample number. Figure S6. Posterior variable probabilities for each of the candidate predictors when each patient was left out in turn (only observations non-missing on all candidate predictors were included). “Index” indicates the (arbitrary) rank order of the patient in the analysis dataset. Figure S7. Performance (in terms of the center-adjusted AUC) of the estimated selected combinations across 1000 bootstrap samples. The first plot corresponds to the AUC for the outcome of sustained mild AKI; the second plot corresponds to the AUC for the outcome of severe AKI. “Index” indicates the bootstrap sample number. Item S2. Multiple imputation analysis. (PDF 2793 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Meisner, A., Kerr, K.F., Thiessen-Philbrook, H. et al. Development of biomarker combinations for postoperative acute kidney injury via Bayesian model selection in a multicenter cohort study. Biomark Res 6, 3 (2018). https://doi.org/10.1186/s40364-018-0117-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40364-018-0117-z

Keywords

Biomarker Research

ISSN: 2050-7771

Contact us