Developing Augmented Pro-SOFA and Pro-SAPS Models by Integrating Biomarkers PCT, NLR, and CRP with SOFA and SAPS-III Scores
Anandakrishnan Nandakumar, Shashank Sudeep, Aryalakshmi Chakkalamparambath Sreemohan, Sreedhar Vijayakumar, Gayathri Jayasree Sudhakaran, Georg Gutjahr, Rahul K Pathinaruporthi, Sabarish Balachandran, Subash Chandra, Shyam Sundar Purushothaman, Zubair U Mohamed, Sashi N Nair, Merlin Moni, Dipu T Sathyapalan
Keywords :
Augmented models, Biomarkers, C-reactive protein, Intensive care unit, Neutrophil-to-lymphocyte ratio, Procalcitonin, Simplified acute physiology score III, Sequential organ failure assessment
Citation Information :
Nandakumar A, Sudeep S, Sreemohan AC, Vijayakumar S, Sudhakaran GJ, Gutjahr G, Pathinaruporthi RK, Balachandran S, Chandra S, Purushothaman SS, Mohamed ZU, Nair SN, Moni M, Sathyapalan DT. Developing Augmented Pro-SOFA and Pro-SAPS Models by Integrating Biomarkers PCT, NLR, and CRP with SOFA and SAPS-III Scores. Indian J Crit Care Med 2024; 28 (10):935-941.
Background: Sepsis, a life-threatening condition characterized by a dysregulated immune response to infection, remains a significant clinical challenge globally. This study aims to enhance the predictive accuracy of existing sepsis severity scores by developing augmented versions of the SOFA and SAPS-III models, termed Pro-SOFA and Pro-SAPS, through the integration of biomarkers procalcitonin (PCT), neutrophil-to-lymphocyte ratio (NLR), and C-reactive protein (CRP).
Methods: This prospective observational study was conducted in the medical ICU of a tertiary care hospital in southern India from August 2022 to December 2023. A total of 301 adult patients suspected or confirmed to have sepsis were assessed for eligibility, with 171 patients completing the study. Demographic and clinical data were collected; SOFA and SAPS-III scores were calculated and augmented with PCT, NLR, and CRP to develop Pro-SOFA and Pro-SAPS models. The performance of these models was evaluated using Brier scores, AUC, and net reclassification index (NRI).
Results: The augmented Pro-SOFA and Pro-SAPS models demonstrated superior predictive accuracy compared to their original counterparts. The Brier scores for Pro-SOFA and Pro-SAPS were 0.181 and 0.165, respectively, indicating better calibration than the original scores. The Pro-SAPS showed significant improvement over the original SAPS-III score (NRI = 0.50, SE = 0.14, p < 0.01). Similarly, Pro-SOFA outperformed the original SOFA (NRI = 0.49, SE = 0.13, p < 0.01).
Conclusion and clinical significance: Integrating PCT, CRP, and NLR with SOFA and SAPS-III scores to develop Pro-SOFA and Pro-SAPS significantly improves the predictive accuracy for sepsis mortality and can thus potentially improve sepsis outcomes.
Machado FR, Nsutebu E, AbDulaziz S, Daniels R, Finfer S, Kissoon N, et al. Sepsis 3 from the perspective of clinicians and quality improvement initiatives. J Crit Care 2017;40(4):315–317. DOI: 10.1016/j.jcrc.2017.04.037.
Jones AE, Trzeciak S, Kline JA. The Sequential Organ Failure Assessment score for predicting outcome in patients with severe sepsis and evidence of hypoperfusion at the time of emergency department presentation. Crit Care Med 2009;37(5):1649–1654. DOI: 10.1097/CCM.0b013e31819def97.
Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, et al. SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005;31(10):1345–1355. DOI: 10.1007/s00134-005-2762-6.
Shinde VV, Jha A, Natarajan MS, Vijayakumari V, Govindaswamy G, Sivaasubramani S, et al. Serum PCT vs SOFA score in predicting outcome in sepsis patients in medical intensive care unit. Indian J Crit Care Med 2023;27(5):348. DOI: 10.5005/jp-journals-10071-24462.
Bagliani A, Fasolino A, Quilico F, Gentile FR, Ambrosini E, Baldi E, et al. Performance of APACHE, SOFA and SAPS-2 score in predicting good neurological outcome at discharge from ICU in patient admitted after an out-of-hospital cardiac arrest. Eur Heart J 2023;12(Supplement_1):zuad036-017. DOI: 10.1093/ehjacc/zuad036.017.
Zhu Y, Zhang R, Ye X, Liu H, Wei J. SAPS III is superior to SOFA for predicting 28-day mortality in sepsis patients based on Sepsis 3.0 criteria. Int J Infectious Dis 2022;114:135–141. DOI: 10.1016/j.ijid.2021.11.015.
Hegazy MA, Omar AS, Samir N, Moharram A, Weber S, Radwan WA. Amalgamation of PCT, C-reactive protein, and sequential organ failure scoring system in predicting sepsis survival. Anesth Essays Res 2014;8(3):296–301. DOI: 10.4103/0259-1162.143115.
Vincent JL, Donadello K, Schmit X. Biomarkers in the critically ill patient: C-reactive protein. Crit Care Clin 2011;27(2):241–251. DOI: 10.1016/j.ccc.2010.12.010.
Meisner M, Tschaikowsky K, Palmaers T, Schmidt J. Comparison of procalcitonin (PCT) and C-reactive protein (CRP) plasma concentrations at different SOFA scores during the course of sepsis and MODS. Crit Care 1999;3(1):45–50. DOI: 10.1186/cc306.
Song M, Graubard BI, Rabkin CS, Engels EA. Neutrophil-to-lymphocyte ratio and mortality in the United States general population. Sci Rep 2021;11(1):464. DOI: 10.1038/s41598-020-79431-7.
Meyer ZC, Schreinemakers JM, Mulder PG, de Waal RA, Ermens AA, van der Laan L. The role of C-reactive protein and the SOFA score as parameter for clinical decision making in surgical patients during the intensive care unit course. PLoS One 2013;8(2):e55964. DOI: 10.1371/journal.pone.0055964.
Song J, Moon S, Park DW, Cho HJ, Kim JY, Park J, et al. Biomarker combination and SOFA score for the prediction of mortality in sepsis and septic shock: A prospective observational study according to the Sepsis-3 definitions. Medicine 2020;99(22):e20495. DOI: 10.1097/MD.0000000000020495.
Rijhwani P, Jain SS, Goel P. Prediction of mortality in sepsis with biomarkers and qSOFA score combination: An observational study in a tertiary care centre of western India. J Res Clin Med 2023;11(1):21. DOI: 10.34172/jrcm.2023.33404.
Cortiñas Abrahantes J, Sotto C, Molenberghs G, Vromman G, Bierinckx B. A comparison of various software tools for dealing with missing data via imputation. Stat Comput Simul 2011;81(11):1653–1675. DOI: 10.1080/00949655.2010.498788.
Bertolini R, Finch SJ, Nehm RH. Quantifying variability in predictions of student performance: Examining the impact of bootstrap resampling in data pipelines. Comp Educ: Artif Intell 2022;3:100067. DOI: 10.1016/j.caeai.2022.100067.
Brier GW. Verification of forecasts expressed in terms of probability. Monthly Weather Rev 1950;78(1):1–3. Corpus ID:122906757.
Cohen J, Cohen P, West SG, Aiken LS. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.). Routledge, 2002. p. 502. ISBN 978-0-8058-2223-6.
Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15(4):361–387. DOI: 10.1002/(SICI)1097-0258.
Kobayashi H, Abe M, Soma M, Takeda Y, Kurihara I, Itoh H, et al. Development and validation of subtype prediction scores for the workup of primary aldosteronism. J Hypertens 2018;36(11): 2269–2276. DOI: 10.1097/HJH.0000000000001855.
Farhan A, Ali SM, Bin V, Mansoor RC, Rehman HU. Comparison of SAPS III and SOFA score for the prediction of mortality among ICU patients. Int J Endorsing Health Sci Res 2021;9(4):437–442. DOI: 10.29052/IJEHSR.v9.i4.2021.
Mbongo CL, Monedero P, Guillen-Grima F, Yepes MJ, Vives M, Echarri G. Performance of SAPS3, compared with APACHE II and SOFA, to predict hospital mortality in a general ICU in Southern Europe. Eur J Anaesthesiol 2009;26(11):940–945. DOI: 10.1097/EJA.0b013e32832edadf.
Roepke RM, Besen BA, Daltro-Oliveira R, Guazzelli RM, Bassi E, Salluh JI, et al. Predictive performance for hospital mortality of SAPS 3, SOFA, ISS, and new ISS in critically ill trauma patients: A validation cohort study. J Intensive Care Med 2024;(1):44–51. DOI: 10.1177/08850666231188051.
Schuetz P, Birkhahn R, Sherwin R, Jones AE, Singer A, Kline JA, et al. Serial procalcitonin predicts mortality in severe sepsis patients: Results from the multicenter procalcitonin MOnitoring SEpsis (MOSES). Crit Care Med 2017;45(5):781–789. DOI: 10.1128/JCM.01851-19.
Mohan A, Shrestha P, Guleria R, Pandey RM, Wig N. Development of a mortality prediction formula due to sepsis/severe sepsis in a medical intensive care unit. Lung India 2015;32(4):313–319. DOI: 10.4103/0970-2113.159533.
Baldirà J, Ruiz-Rodríguez JC, Wilson DC, Ruiz-Sanmartin A, Cortes A, Chiscano L, et al. Biomarkers and clinical scores to aid the identification of disease severity and intensive care requirement following activation of an in-hospital sepsis code. Ann Intensive Care. 2020;10(1):7. DOI: 10.1186/s13613-020-0625-5.
Martins EC, Silveira LD, Viegas K, Beck AD, Fioravantti G, Cremonese RV, et al. Neutrophil-lymphocyte ratio in the early diagnosis of sepsis in an intensive care unit: A case-control study. Rev Bras Ter Intensiva 2019;31(1):64–70. DOI: 10.5935/0103-507X.20190010.
Davoudian S, Piovani D, Desai A, Mapelli SN, Leone R, Sironi M, et al. A cytokine/PTX3 prognostic index as a predictor of mortality in sepsis. Front Immunol 2022;13:979232. DOI: 10.3389/fimmu.2022.979232.
Streimish I, Bizzarro M, Northrup V, Wang C, Renna S, Koval N, et al. Neutrophil CD64 as a diagnostic marker in neonatal sepsis. Pediatr Infect Dis J 2012;31(7):777–781. DOI: 10.1097/INF.0b013e318256fb07.
Wu X, Luo Q, Su Z, Li Y, Wang H, Liu Q, et al. Neutrophil-to-lymphocyte ratio as a predictor of mortality in intensive care unit patients: A retrospective analysis of the Medical Information Mart for Intensive Care III Database. BMJ Open 2021;11(11):e053548.
Miro M, del Valle GS, Agámez G, García PP, Martínez HE, Olivas E. Correlation between SOFA score and procalcitonin blood levels in peritonitis patients: 12AP3-4. Eur J Anaesthesiol 2011;28:173. DOI: 10.1097/00003643-201106001-00556.