Skip to main navigation menu Skip to main content Skip to site footer
##common.pageHeaderLogo.altText##

Original article

Vol. 148 No. 1112 (2018)

Screening for delirium with the Intensive Care Delirium Screening Checklist (ICDSC): a re-evaluation of the threshold for delirium

  • Soenke Boettger
  • David Garcia Nuñez
  • Rafael Meyer
  • André Richter
  • Alain Rudiger
  • Maria Schubert
  • Josef Jenewein
DOI
https://doi.org/10.4414/smw.2018.14597
Cite this as:
Swiss Med Wkly. 2018;148:w14597
Published
14.03.2018

Summary

BACKGROUND

With its high incidence and subsequent adverse consequences in the intensive care setting, several instruments have been developed to screen for and detect delirium. One of the more commonly used is the Intensive Care Delirium Screening Checklist (ICDSC); however, the optimal cut-off score indicating delirium has been debated.

METHODS

In this prospective cohort study, the ICDSC threshold for delirium set at ≥3, ≥4, or ≥5 was compared with the DSM-IV-TR-determined diagnosis of delirium (used as standard), and with the Confusion Assessment Method for the ICU (CAM-ICU), with respect to their concurrent validity.

RESULTS

In total, 289 patients were assessed, including 122 with delirium. The cut-off score of ≥4 had several shortcomings: although 90% of patients with delirium were correctly classified, 23% remained undetected. The agreement with the DSM-IV-TR diagnosis of delirium was only moderate (Cohen’s κ 0.59) and the sensitivity was only 62%. In contrast, when the cut-off was ≥3, 83% of patients with delirium were correctly classified and only 14.5% remained undetected. The agreement with DSM-IV-TR was substantial (Cohen’s κ 0.68) and the sensitivity increased to 83%. The benefit of setting the cut-off at ≥5 was not convincing: although 90% of patients with delirium were correctly classified, 30% remained undetected. The concurrent validity was only moderate (Cohen’s κ 0.44), and the sensitivity reached only 44%. Changing the ICDSC cut-off score did not strengthen the moderate agreement with the CAM-ICU (Cohen’s κ 0.45–0.56).

CONCLUSION

In clinical routine, decreasing the ICDSC threshold for delirium to ≥3 increased the accuracy in detecting delirium at the cost of over-identification and is therefore recommended as the optimal threshold. Increasing the cut-off score to ≥5 decreased the concurrent validity and sensitivity; in addition, the under-detection of delirium was substantial.

Trial registration number

PB 2016-01264

References

  1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, Text Revision. Washington, DC: American Psychiatric Association; 2000. pp 124–7.
  2. Trzepacz PT, Breitbart W, Franklin J, Levenson J, Martini R, Wang P ; American Psychiatric Association. Practice guideline for the treatment of patients with delirium. Am J Psychiatry. 1999;156(5, Suppl):1–20.
  3. Inouye SK, Westendorp RG, Saczynski JS. Delirium in elderly people. Lancet. 2014;383(9920):911–22. doi:.https://doi.org/10.1016/S0140-6736(13)60688-1
  4. Bucht G, Gustafson Y, Sandberg O. Epidemiology of delirium. Dement Geriatr Cogn Disord. 1999;10(5):315–8. doi:.https://doi.org/10.1159/000017161
  5. Norkiene I, Ringaitiene D, Misiuriene I, Samalavicius R, Bubulis R, Baublys A, et al. Incidence and precipitating factors of delirium after coronary artery bypass grafting. Scand Cardiovasc J. 2007;41(3):180–5. doi:.https://doi.org/10.1080/14017430701302490
  6. Gottesman RF, Grega MA, Bailey MM, Pham LD, Zeger SL, Baumgartner WA, et al. Delirium after coronary artery bypass graft surgery and late mortality. Ann Neurol. 2010;67(3):338–44.
  7. Pun BT, Ely EW. The importance of diagnosing and managing ICU delirium. Chest. 2007;132(2):624–36. doi:.https://doi.org/10.1378/chest.06-1795
  8. Santos FS, Velasco IT, Fráguas R, Jr. Risk factors for delirium in the elderly after coronary artery bypass graft surgery. Int Psychogeriatr. 2004;16(2):175–93. doi:.https://doi.org/10.1017/S1041610204000365
  9. Rosen SF, Clagett GP, Valentine RJ, Jackson MR, Modrall JG, McIntyre KE. Transient advanced mental impairment: an underappreciated morbidity after aortic surgery. J Vasc Surg. 2002;35(2):376–81. doi:.https://doi.org/10.1067/mva.2002.119233
  10. Koster S, Hensens AG, van der Palen J. The long-term cognitive and functional outcomes of postoperative delirium after cardiac surgery. Ann Thorac Surg. 2009;87(5):1469–74. doi:.https://doi.org/10.1016/j.athoracsur.2009.02.080
  11. Ely EW, Shintani A, Truman B, Speroff T, Gordon SM, Harrell FE, Jr, et al. Delirium as a predictor of mortality in mechanically ventilated patients in the intensive care unit. JAMA. 2004;291(14):1753–62. doi:.https://doi.org/10.1001/jama.291.14.1753
  12. Ouimet S, Kavanagh BP, Gottfried SB, Skrobik Y. Incidence, risk factors and consequences of ICU delirium. Intensive Care Med. 2007;33(1):66–73. doi:.https://doi.org/10.1007/s00134-006-0399-8
  13. Heymann A, Radtke F, Schiemann A, Lütz A, MacGuill M, Wernecke KD, et al. Delayed treatment of delirium increases mortality rate in intensive care unit patients. J Int Med Res. 2010;38(5):1584–95. doi:.https://doi.org/10.1177/147323001003800503
  14. Balas MC, Happ MB, Yang W, Chelluri L, Richmond T. Outcomes Associated With Delirium in Older Patients in Surgical ICUs. Chest. 2009;135(1):18–25. doi:.https://doi.org/10.1378/chest.08-1456
  15. Bickel H, Gradinger R, Kochs E, Förstl H. High risk of cognitive and functional decline after postoperative delirium. A three-year prospective study. Dement Geriatr Cogn Disord. 2008;26(1):26–31. doi:.https://doi.org/10.1159/000140804
  16. Devlin JW, Fong JJ, Schumaker G, O’Connor H, Ruthazer R, Garpestad E. Use of a validated delirium assessment tool improves the ability of physicians to identify delirium in medical intensive care unit patients. Crit Care Med. 2007;35(12):2721–4, quiz 2725. doi:.https://doi.org/10.1097/00003246-200712000-00007
  17. Gusmao-Flores D, Salluh JI, Chalhub RA, Quarantini LC. The confusion assessment method for the intensive care unit (CAM-ICU) and intensive care delirium screening checklist (ICDSC) for the diagnosis of delirium: a systematic review and meta-analysis of clinical studies. Crit Care. 2012;16(4):R115. doi:.https://doi.org/10.1186/cc11407
  18. van Eijk MM, van Marum RJ, Klijn IA, de Wit N, Kesecioglu J, Slooter AJ. Comparison of delirium assessment tools in a mixed intensive care unit. Crit Care Med. 2009;37(6):1881–5. doi:.https://doi.org/10.1097/CCM.0b013e3181a00118
  19. Neufeld KJ, Leoutsakos JS, Sieber FE, Joshi D, Wanamaker BL, Rios-Robles J, et al. Evaluation of two delirium screening tools for detecting post-operative delirium in the elderly. Br J Anaesth. 2013;111(4):612–8. doi:.https://doi.org/10.1093/bja/aet167
  20. Marquis F, Ouimet S, Riker R, Cossette M, Skrobik Y. Individual delirium symptoms: do they matter? Crit Care Med. 2007;35(11):2533–7. doi:.https://doi.org/10.1097/01.CCM.0000284506.43390.F3
  21. Gusmao-Flores D, Salluh JI, Dal-Pizzol F, Ritter C, Tomasi CD, Lima MA, et al. The validity and reliability of the Portuguese versions of three tools used to diagnose delirium in critically ill patients. Clinics (Sao Paulo). 2011;66(11):1917–22.
  22. Plaschke K, von Haken R, Scholz M, Engelhardt R, Brobeil A, Martin E, et al. Comparison of the confusion assessment method for the intensive care unit (CAM-ICU) with the Intensive Care Delirium Screening Checklist (ICDSC) for delirium in critical care patients gives high agreement rate(s). Intensive Care Med. 2008;34(3):431–6. doi:.https://doi.org/10.1007/s00134-007-0920-8
  23. George C, Nair JS, Ebenezer JA, Gangadharan A, Christudas A, Gnanaseelan LK, et al. Validation of the Intensive Care Delirium Screening Checklist in nonintubated intensive care unit patients in a resource-poor medical intensive care setting in South India. J Crit Care. 2011;26(2):138–43. doi:.https://doi.org/10.1016/j.jcrc.2010.11.002
  24. van Eijk MM, van den Boogaard M, van Marum RJ, Benner P, Eikelenboom P, Honing ML, et al. Routine use of the confusion assessment method for the intensive care unit: a multicenter study. Am J Respir Crit Care Med. 2011;184(3):340–4. doi:.https://doi.org/10.1164/rccm.201101-0065OC
  25. Boettger S, Nuñez DG, Meyer R, Richter A, Fernandez SF, Rudiger A, et al. Delirium in the intensive care setting: A reevaluation of the validity of the CAM-ICU and ICDSC versus the DSM-IV-TR in determining a diagnosis of delirium as part of the daily clinical routine. Palliat Support Care. 2017;15(6):675–83. doi:.https://doi.org/10.1017/S1478951516001176
  26. Ely EW, Inouye SK, Bernard GR, Gordon S, Francis J, May L, et al. Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU). JAMA. 2001;286(21):2703–10. doi:.https://doi.org/10.1001/jama.286.21.2703
  27. Bergeron N, Dubois MJ, Dumont M, Dial S, Skrobik Y. Intensive Care Delirium Screening Checklist: evaluation of a new screening tool. Intensive Care Med. 2001;27(5):859–64. doi:.https://doi.org/10.1007/s001340100909
  28. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 3rd Edition, revised. Washington, DC: American Psychiatric Association; 1987.
  29. Trzepacz PT, Mittal D, Torres R, Kanary K, Norton J, Jimerson N. Validation of the Delirium Rating Scale-revised-98: comparison with the delirium rating scale and the cognitive test for delirium. J Neuropsychiatry Clin Neurosci. 2001;13(2):229–42. doi:.https://doi.org/10.1176/jnp.13.2.229
  30. DeVellis RF. Scale development: Theory and applications. Los Angeles, CA: Sage publications; 2012. pp 109–10.
  31. Bergeron N, Dubois MJ, Dumont M, Dial S, Skrobik Y. Intensive Care Delirium Screening Checklist: evaluation of a new screening tool. Intensive Care Med. 2001;27(5):859–64. doi:.https://doi.org/10.1007/s001340100909
  32. Haenggi M, Blum S, Brechbuehl R, Brunello A, Jakob SM, Takala J. Effect of sedation level on the prevalence of delirium when assessed with CAM-ICU and ICDSC. Intensive Care Med. 2013;39(12):2171–9. doi:.https://doi.org/10.1007/s00134-013-3034-5

Most read articles by the same author(s)

<< < 1 2