Netharland Journal of Critical Care
2011,
Volume 15,
Issue 3
: 118-130
Article
Validation of six mortality prediction systems for ICU surgical populations
Abstract
Introduction: This study investigates the prognostic quality of six prediction models (APACHE II Score, SAPS II, SAPS II(Expanded), SAPS 3, MPM II0 and MPM III) for assessment in an adult surgical intensive care unit in the Netherlands. Further, we tested the capability of the APACHE II model to identify patients at risk of dying during the first five years after ICU discharge. Patients/ Methods: From all single admissions to the surgical ICU of the St. Elisabeth Hospital between 1995 and 2000, data to calculate the results of six prediction models were prospectively documented. To evaluate discrimination and calibration, receiver operating characteristic (ROC) curves, area under the characteristic (AUC) curve and the Hosmer-Lemeshow goodness-of-fit test were performed. Results: The data from 1821 patients were applied to all six models. Accurate overall mortality prediction was found for the APACHE II, SAPS II, SAPS 3 and MPM models. Discrimination was best for the SAPS 3 and MPM III models and worst for the APACHE II model with AUC of 0.81, 0.77 and 0.77, respectively. Calibration was poor for the six prediction systems, varying between 23 (SAPS 3) to 233 (SAPS II (Expanded)). There was a significant improvement in calibration for the APACHE II, SAPS II, SAPS II (Exp) and MPM II models after adjusting the baseline risks (intercepts) for each model. The SAPS 3 and MPM III systems did not show a great deal of improved calibration, as they were already good in the lower probability groups. Conclusion: The newer SAPS 3 prediction mortality model is the best validated model for a surgical ICU population of the six models tested. The other general prognostic models underestimate the risk of dying. The APACHE II model could also be helpful for identifying patients at risk of dying during the five years after ICU discharge. Copyright © 2011, Nederlandse Vereniging voor Intensive Care.
Keywords
ICU outcome
ICU prediction mortality model validation
Long-term survival
Outcome prediction intensive care
Prediction mortality models
License
Copyright (c) Netharland Journal of Critical Care
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
Neth. J. Crit. Care open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
Recommended Articles
How to externally validate prognostic models in surgery