Concordance between the National Healthcare Safety Network (NHSN) Surveillance Criteria and Clinical Pulmonary Infection Score (CPIS) Criteria for Diagnosis of Ventilator-associated Pneumonia (VAP)
1–3Department of Microbiology, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India
4Department of Medicine, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India
Corresponding Author: Sujatha Sistla, Department of Microbiology, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India, Phone: +91 4132272033, e-mail: email@example.com
How to cite this article: Gunalan A, Sistla S, Sastry AS, Venkateswaran R. Concordance between the National Healthcare Safety Network (NHSN) Surveillance Criteria and Clinical Pulmonary Infection Score (CPIS) Criteria for Diagnosis of Ventilator-associated Pneumonia (VAP). Indian J Crit Care Med 2021;25(3):296–298.
Source of support: Nil
Conflict of interest: None
Background: Ventilator-associated pneumonia (VAP) is one of the most common hospital-acquired infections among mechanically ventilated patients and the incidence rates are widely used as an index of quality of care given in an ICU. Since there is no gold standard method available to diagnose VAP, the incidence rate varies based on different criteria used for calculation. Therefore, we conducted a study to determine the concordance between the National Healthcare Safety Network (NHSN) surveillance criteria and clinical pulmonary infection score (CPIS) criteria for the diagnosis of VAP.
Materials and methods: This was a prospective study that evaluated patients in the medical intensive care units (MICUs) of a tertiary care hospital, India, who were intubated for >48 hours between October 2018 and September 2019. All the patients (n = 273) were followed up daily and assessed using both CPIS and NHSN surveillance criteria for diagnosing VAP.
Results: Of these 273 patients, 93 patients (34.1%) had VAP according to CPIS criteria as compared with 33 patients (12.1%) using the NHSN criteria. The corresponding rates of VAP were 39.59 vs 11.53 cases per 1,000 ventilator days, respectively. The agreement of the two sets of criteria was fairly good (kappa statistics, 0.42)
Conclusion: The NHSN surveillance criteria have a lower sensitivity in detecting VAP cases and have to be modified to achieve better results.
Keywords: Anesthesia and intensive care, Clinical pulmonary infection score, Ventilator-associated pneumonia, National Healthcare Safety Network.
Ventilator-associated pneumonia (VAP) is a frequent complication of mechanical ventilation (MV). The incidence of VAP is not known precisely and ranges from 13–51 per 1,000 ventilator days.1,2 It varies among different studies because of the lack of uniformity in the diagnostic criteria and it also depends on the type of ICU and the population studied. Following VAP at the national level is challenging, because of the absence of substantial and solid definitions. To overcome this, the Centers for Disease Control and Prevention (CDC) held a meeting to help build up another way to deal with observation in mechanically ventilated patients. This new methodology, called “ventilator-associated event” (VAE) surveillance, was executed in CDC's National Healthcare Safety Network (NHSN), in January 2013.3 These surveillance criteria were created to expand the reliability and to upgrade the utility of these surveillance data for improving patient security.4 Despite these efforts, several studies have shown that NHSN surveillance criteria have a very low sensitivity in detecting VAP cases leading to underestimation of actual VAP rate and there was low agreement between the clinical criteria and the surveillance criteria used for diagnosis of VAP.5,6
In this context, the present study aimed to determine the concordance between NHSN surveillance criteria and clinical pulmonary infection score (CPIS) criteria for the diagnosis of VAP.
MATERIALS AND METHODS
All hospitalized adult patients on MV > 48 hours in the medical intensive care unit (MICU) for one year from October 2018 to September 2019 were included while those admitted to MICU with pneumonia or with a diagnosis of VAP from other hospitals were excluded from this study. The estimated sample size was 273 using Open Epi software, with a 95% confidence interval, assuming alpha error of 5%, and absolute precision of 5%. All patients who were mechanically ventilated >48 hours, were followed up daily and the different criteria (CPIS and surveillance criteria) (Tables 1 and 2) needed for diagnosing VAP were employed. When there was a clinical suspicion of VAP, endotracheal aspirates (EA) were collected and subjected to Gram's stain and semi-quantitative culture.
|Temperature (°C)||36.5–38.4 °C||0|
|≤36 or ≥39 °C||2|
|Leukocytes in blood (cells/mm3)||4,000–11,000/mm3||0|
|<4,000 or > 11,000/mm3||1|
|≥ 500 band cells||2|
|Tracheal secretions (subjective visual scale)||None||0|
|Radiographic findings (on chest radiography, excluding CHF and ARDS)||No infiltrate||0|
|Culture results (endotracheal aspirate)||No or mild growth|
|Moderate or florid growth||0|
|Moderate or florid growth||1|
|and pathogen consistent with Gram stain||2|
|Oxygenation status (defined by PaO2:FiO2)||> 240 or ARDS||0|
|≤ 240 and absence of ARDS||2|
|MV criteria||Patient has MV in place for 2 days or more or if removed, MV was in place on the day of sample collection or the day before|
|Baseline period||Patient should have a baseline period of stability which is defined as ≥2 days of stable or decreasing daily minimum FiO2 or PEEP (positive end-expiratory pressure)|
|Ventilator-associated condition (VAC)||After a baseline period, the patient should have at least one of the following criteria of worsening of oxygenation|
|• Increase in daily minimum FiO2 of ≥0.20 sustained for ≥2 days or|
|• Increase in daily minimum PEEP values ≥ 3 cm H2O sustained for ≥2 days|
|Infection-related ventilator-associated complications (IVAC)||During the infection window period of VAC, patient should have both|
|• Temperature > 100.4 °F or WBC count ≥ 12,000 or ≤4,000 cells/mm3 and|
|• A new antimicrobial agent is started and continued for ≥4 days|
|Possible ventilator-associated pneumonia (PVAP)||Criterion 1 Positive quantitative/semi-quantitative culture|
|ET aspirate ≥ 105 CFU/mL; BAL (bronchoalveolar lavage) ≥ 104 CFU/mL; lung tissue ≥ 105 CFU/g; protected specimen brushing ≥ 103 CFU/mL|
|Criterion 2 Qualitative culture plus Gram stain:|
|Gram stain shows purulent respiratory secretions plus a positive culture of any growth (Criterion-1 specimens and sputum)|
|Criterion 3 One of the following positive tests:|
|• Organism identified from pleural fluid|
|• Lung histopathology|
|• Diagnostic test for Legionella species|
|• Diagnostic test for respiratory viruses|
The data were entered into Epicollect software. Continuous variables like age, duration of MV, the onset of VAP were expressed as mean with standard deviation. Incidence of VAP was expressed as incidence proportion with a 95% confidence interval and also as incidence density of VAP per ventilator days. The etiology was summarized as percentages. Kappa statistics were calculated to assess the concordance between NHSN surveillance criteria and CPIS for diagnosis of VAP.
Out of 273 patients who met inclusion criteria, 93 (34.1%) patients developed VAP using CPIS criteria, and 33 (12.1%) developed VAP according to NHSN surveillance criteria resulting in a VAP rate of 39.5 per 1000 ventilator days and 11.5 per 1000 ventilator days, respectively. In our study, 16 (5.9%) patients met VAC criteria, 1 (0.4%) patient met IVAC criteria, and 16 (5.9%) met PVAP criteria using NHSN surveillance criteria. All the patients who were diagnosed to have VAP by NHSN surveillance criteria had CPIS > 6. The demographic details of patients developing VAP are shown in Table 3. Using CPIS as a gold standard, the sensitivity and specificity of NHSN surveillance criteria for detecting VAP were found to be 35.5% and 100%, respectively (Table 4). There was a fairly good agreement between CPIS and NHSN criteria with a kappa factor of 0.42 with a p-value < 0.001.
|Parameters||CPIS (n = 93)||NHSN (n = 33)|
|Age||45.2 ± 15.9||40.36 ± 13.98|
|Male||62 (66.7%)||22 (66.7%)|
|Female||31 (33.3%)||11 (33.3%)|
|Duration of MV (days)||8.44 ± 3||9.06 ± 3.96|
|Onset of VAP (days)||4.7 ± 1.81||4.48 ± 1.48|
|VAC criteria||IVAC criteria||PVAP criteria||No. of patients fulfilling the criteria||Diagnosis by NHSN criteria|
Ventilator-associated pneumonia is one of the most common hospital-acquired infections among mechanically ventilated patients. The incidence of VAP in our study was 39.59 episodes per 1,000 ventilator days according to CPIS criteria, which is similar to other Indian studies where the incidence of VAP ranged from 8.9–46 episodes per 1,000 ventilator days.7 This high incidence rate may be due to inadequate nursing staff in the ICU (ideally 1:1 ratio) which would indirectly have a negative impact on the care conferred to the patients.
Our study was conducted only in MICU, therefore the difference in the occurrence of VAP between different ICUs was not studied. A study by Song et al. showed that there was no significant difference in the incidence of VAP between MICU and surgical intensive care unit (SICU).8 However, a study by Dallas showed that the incidence of VAP was higher in SICU (13.6 per 1,000 ventilator days) when compared to MICU (4.8 per 1000 ventilator-days).9 A study done by Joseph et al. showed that there was no significant change in the incidence of VAP between MICU and critical care unit (CCU) (p-value = 0.0976).10
Our study results proved that the NHSN surveillance scoring system had a weakened ability to recognize patients with a clinical suspicion of VAP, indicating a huge disparity in deciding the VAP occurrence rates. In the present study, out of 273 who were included in the study period, only 33 (12.08%) patients had ventilator-associated events using the NHSN surveillance scoring system proposed by CDC resulting in a VAP rate of 11.53 per 1,000 ventilator days. Our finding was similar to those of Skrupky et al. who found that only 14.5% of clinically diagnosed VAP cases were identified using NHSN surveillance criteria.11 Similar studies conducted by Lilly et al. and Waltrick et al. showed that the sensitivity of NHSN surveillance criteria in diagnosing VAP was 32% and 37%, respectively.6,12 A study conducted by Miller et al. in 2006 in trauma ICU showed that there was less precision when surveillance criteria were utilized at the bedside to settle on treatment choices and resulted in non-treatment in 16% of VAP cases.5
Numerous patients who satisfied the VAP definition (CPIS) and had VAP with elevated levels of clinical suspicion were not recognized using the NHSN surveillance criteria basically on the grounds that they did not meet the stable baseline necessities of ventilator settings or did not have worsening of gas exchange indicated by an increase in FiO2 or PEEP (positive end-expiratory pressure) for 2 days which cannot be seen in all the patients. Another possible reason for the reduced sensitivity of the NHSN surveillance criteria is that it did not utilize the most delicate variable for pathologically analyzed VAP that is the chest radiograph.
Our study has a few drawbacks, such as a small sample size and involving only one ICU (MICU) that limited the study power.
To conclude, clinicians and the hospital infection control committee should be careful while interpreting the data on VAP detailed to them using surveillance criteria, as they tend to have lower sensitivity in predicting the infection and may under-report the occurrence of these infections.
Ethical statement: This study received ethical approval from the institute ethics committee JIPMER—JIP/IEC/2018/0142.
Anitha Gunalan https://orcid.org/0000-0002-7779-7877
Sujatha Sistla https://orcid.org/0000-0002-4286-6908
Apurba S Sastry https://orcid.org/0000-0003-2337-3830
Ramanathan Venkateswaran https://orcid.org/0000-0002-1602-5785
1. Hunter JD. Ventilator associated pneumonia. BMJ 2012;344:e3325. DOI: 10.1136/bmj.e3325.
2. Charles MP, Kali A, Easow JM, Joseph NM, Ravishankar M, Srinivasan S, et al. Ventilator-associated pneumonia. Australas Med J 2014;7(8):334–344. DOI: 10.4066/AMJ.2014.2105.
3. Magill SS, Klompas M, Balk R, Burns SM, Deutschman CS, Diekema D, et al. Developing a new, national approach to surveillance for ventilator-associated events. Crit Care Med 2013;41(11): 2467–2475. DOI: 10.1097/CCM.0b013e3182a262db.
4. Klompas M. Complications of mechanical ventilation—the CDC's new surveillance paradigm. N Engl J Med 2013;368(16):1472–1475. DOI: 10.1056/NEJMp1300633.
5. Miller PR, Johnson JC 3rd, Karchmer T, Hoth JJ, Meredith JW, Chang MC. National nosocomial infection surveillance system: from benchmark to bedside in trauma patients. J Trauma 2006;60(1): 98–103. DOI: 10.1097/01.ta.0000196379.74305.e4.
6. Lilly CM, Landry KE, Sood RN, Dunnington CH, Ellison RT 3rd, Bagley PH, et al. Prevalence and test characteristics of national health safety network ventilator-associated events. Crit Care Med 2014;42(9): 2019–2028. DOI: 10.1097/CCM.0000000000000396.
7. Mathai AS, Phillips A, Isaac R. Ventilator-associated pneumonia: a persistent healthcare problem in Indian Intensive Care Units! Lung India 2016;33(5):512–516. DOI: 10.4103/0970-2113.188971.
8. Song X, Chen Y, Li X. Differences in incidence and outcome of ventilator-associated pneumonia in surgical and medical ICUs in a tertiary hospital in China. Clin Respir J 2014;8(3):262–268. DOI: 10.1111/crj.12036.
9. Dallas J, Skrupky L, Abebe N, Boyle WA III, Kollef MH. Ventilator-associated tracheobronchitis in a mixed surgical and medical ICU population. Chest 2011;139(3):513–518. DOI: 10.1378/chest.10-1336.
10. Joseph NM, Sistla S, Dutta TK, Badhe AS, Parija SC. Ventilator-associated pneumonia in a tertiary care hospital in India: incidence and risk factors. J Infect Dev Ctries 2009;3(10):771–777. DOI: 10.3855/jidc.396.
11. Skrupky LP, McConnell K, Dallas J, Kollef MH. A comparison of ventilator-associated pneumonia rates as identified according to the National Healthcare Safety Network and American College of Chest Physicians criteria. Crit Care Med 2012;40(1):281–284. DOI: 10.1097/CCM.0b013e31822d7913.
12. Waltrick R, Possamai DS, de Aguiar FP, Dadam M, de Souza Filho VJ, Ramos LR, et al. Comparison between a clinical diagnosis method and the surveillance technique of the Center for Disease Control and Prevention for identification of mechanical ventilator-associated pneumonia. Rev Bras Ter Intensiva 2015;27(3):260–265. DOI: 10.5935/0103-507X.20150047.
© Jaypee Brothers Medical Publishers. 2021 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by-nc/4.0/), which permits unrestricted use, distribution, and non-commercial reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.