Reliability and validity of the checklist for early recognition and treatment of acute illness and injury as a charting tool in the medical intensive care unit
Saraschandra Vallabhajosyula, Alexander Kogan, Kelly Pennington, Mikhail Dziadzko, Courtney Bennett, Jeffrey Jensen, Ognjen Gajic, John O\'Horo
Checklist for early recognition and treatment of acute illness and injury, checklists, critical care, reliability, resuscitation
Citation Information :
Vallabhajosyula S, Kogan A, Pennington K, Dziadzko M, Bennett C, Jensen J, Gajic O, O\'Horo J. Reliability and validity of the checklist for early recognition and treatment of acute illness and injury as a charting tool in the medical intensive care unit. Indian J Crit Care Med 2017; 21 (11):746-750.
Background: Resuscitation of critically ill patients is complex and potentially prone to diagnostic errors and therapeutic harm. The Checklist for early recognition and treatment of acute illness and injury (CERTAIN) is an electronic tool that aims to provide decision-support, charting, and prompting for standardization. This study sought to evaluate the validity and reliability of CERTAIN in a real-time Intensive Care Unit (ICU).
Materials and Methods: This was a prospective pilot study in the medical ICU of a tertiary care medical center. A total of thirty patient encounters over 2 months period were charted independently by two CERTAIN investigators. The inter-observer recordings and comparison to the electronic medical records (EMR) were used to evaluate reliability and validity, respectively. The primary outcome was reliability and validity measured using Cohen\'s Kappa statistic. Secondary outcomes included time to completion, user satisfaction, and learning curve.
Results: A total of 30 patients with a median age of 59 (42–78) years and median acute physiology and chronic health evaluation III score of 38 (23–50) were included in this study. Inter-observer agreement was very good (κ = 0.79) in this study and agreement between CERTAIN and the EMR was good (κ = 0.5). CERTAIN charting was completed in real-time that was 121 (92–150) min before completion of EMR charting. The subjective learning curve was 3.5 patients without differences in providers with different levels of training.
Conclusions: CERTAIN provides a reliable and valid method to evaluate resuscitation events in real time. CERTAIN provided the ability to complete data in real-time.
Halpern NA, Pastores SM. Critical care medicine in the United States 2000-2005: An analysis of bed numbers, occupancy rates, payer mix, and costs. Crit Care Med 2010;38:65-71.
Vincent JL, Marshall JC, Namendys-Silva SA, François B, Martin-Loeches I, Lipman J, et al. Assessment of the worldwide burden of critical illness: The intensive care over nations (ICON) audit. Lancet Respir Med 2014;2:380-6.
Vukoja M, Kashyap R, Gavrilovic S, Dong Y, Kilickaya O, Gajic O, et al. Checklist for early recognition and treatment of acute illness: International collaboration to improve critical care practice. World J Crit Care Med 2015;4:55-61.
Muscedere J, Sinuff T, Heyland DK, Dodek PM, Keenan SP, Wood G, et al. The clinical impact and preventability of ventilator-associated conditions in critically ill patients who are mechanically ventilated. Chest 2013;144:1453-60.
Yadav H, Thompson BT, Gajic O. Fifty years of research in ARDS. Is acute respiratory distress syndrome a preventable disease? Am J Respir Crit Care Med 2017;195:725-36.
Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med 2001;345:1368-77.
Khullar D, Jha AK, Jena AB. Reducing diagnostic errors – Why now? N Engl J Med 2015;373:2491-3.
Jayaprakash N, Ali R, Kashyap R, Bennett C, Kogan A, Gajic O, et al. The incorporation of focused history in checklist for early recognition and treatment of acute illness and injury. BMC Emerg Med 2016;16:35.
Halpern NA, Pastores SM, Oropello JM, Kvetan V. Critical care medicine in the United States: Addressing the intensivist shortage and image of the specialty. Crit Care Med 2013;41:2754-61.
Kelleher DC, Carter EA, Waterhouse LJ, Parsons SE, Fritzeen JL, Burd RS, et al. Effect of a checklist on advanced trauma life support task performance during pediatric trauma resuscitation. Acad Emerg Med 2014;21:1129-34.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, et al. Asurgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med 2009;360:491-9.
McEvoy MD, Field LC, Moore HE, Smalley JC, Nietert PJ, Scarbrough SH, et al. The effect of adherence to ACLS protocols on survival of event in the setting of in-hospital cardiac arrest. Resuscitation 2014;85:82-7.
Pickering BW, Dong Y, Ahmed A, Giri J, Kilickaya O, Gupta A, et al. The implementation of clinician designed, human-centered electronic medical record viewer in the Intensive Care Unit: A pilot step-wedge cluster randomized trial. Int J Med Inform 2015;84:299-307.
Pickering BW, Herasevich V, Ahmed A, Gajic O. Novel representation of clinical information in the ICU: Developing user interfaces which reduce information overload. Appl Clin Inform 2010;1:116-31.
Thongprayoon C, Harrison AM, O'Horo JC, Berrios RA, Pickering BW, Herasevich V, et al. The effect of an electronic checklist on critical care provider workload, errors, and performance. J Intensive Care Med 2016;31:205-12.
Barwise A, Garcia-Arguello L, Dong Y, Hulyalkar M, Vukoja M, Schultz MJ, et al. Checklist for early recognition and treatment of acute illness (CERTAIN): Evolution of a content management system for point-of-care clinical decision support. BMC Med Inform Decis Mak 2016;16:127.
Berrios RS, O'Horo J, Schmickl C, Erdogan A, Chen X, Arguello LG, et al. Prompting with electronic checklist improves clinician performance in medical emergencies: High fide. Crit Care Med 2014;42:1424.
Berrios RS, O'Horo J, Schmickl C, Erdogan A, Chen X, Arguello LG. Prompting with electronic checklist improves clinician performance in medical emergencies. Crit Care Med 2014;42(12_S):A1424.
Fitzgerald M, Cameron P, Mackenzie C, Farrow N, Scicluna P, Gocentas R, et al. Trauma resuscitation errors and computer-assisted decision support. Arch Surg 2011;146:218-25.
Bowman S. Impact of electronic health record systems on information integrity: Quality and safety implications. Perspect Health Inf Manag 2013;10:1c.
Wurster LA, Groner JI, Hoffman J. Electronic documentation of trauma resuscitations at a level 1 pediatric trauma center. J Trauma Nurs 2012;19:76-9.
Coffey C, Wurster LA, Groner J, Hoffman J, Hendren V, Nuss K, et al. Acomparison of paper documentation to electronic documentation for trauma resuscitations at a level I pediatric trauma center. J Emerg Nurs 2015;41:52-6.