1887
Volume 2026, Issue 1
  • ISSN: 1999-7086
  • EISSN: 1999-7094

Abstract

Emergency department (ED) visits have increased exponentially in many countries, leading to overcrowding. This overcrowding results in delays in care across most EDs and has been associated with poorer outcomes, including increased morbidity and mortality. Triage algorithms were developed and widely implemented in EDs worldwide to identify patients requiring resources and to allocate those resources appropriately. However, despite the use of algorithms, the care delivery remains highly variable. Machine learning (ML) models have been developed to improve clinicians’ predictive ability to identify high-risk patients and to improve resource allocation in EDs globally. This systematic review and meta-analysis, therefore, outlines the current evidence on the efficacy of artificial intelligence (AI) in predicting patients’ clinical deterioration in the ED.

A comprehensive literature search was conducted across five electronic databases—ScienceDirect, PubMed, Google Scholar, CENTRAL, and EMBASE—to identify all relevant articles published up to February 2025. Data were extracted from the studies that met the inclusion criteria, and the reported outcomes were pooled using the MedCalc statistical software.

A total of 743 articles were identified through the literature search; however, only nine met the inclusion criteria and were thus included in the review. We pooled the area under the receiver operating characteristic curve (AUROC) of ML models for predicting the occurrence of in-hospital cardiac arrest (IHCA) and observed a pooled Area Under the Curve (AUC) of 0.909 (95% CI: 0.889–0.929; < 0.001). The models showed high predictive ability for the other clinical deterioration outcomes in the ED. However, we were unable to pool the results because only a limited number of studies reported these different outcomes.

Our systematic review and meta-analysis found that ML models have a high predictive ability in identifying patients at risk of clinical deterioration in the ED. However, limited data exist on the additional benefits clinicians gain from incorporating AI into routine ED patient care. Moreover, although many models have been developed, further studies are needed to evaluate their clinical utility.

Loading

Article metrics loading...

/content/journals/10.5339/jemtac.2026.15
2026-02-02
2026-02-04

Metrics

Loading full text...

Full text loading...

/deliver/fulltext/jemtac/2026/1/jemtac.2026.15.html?itemId=/content/journals/10.5339/jemtac.2026.15&mimeType=html&fmt=ahah

References

  1. HCUPnet Data Tools – Healthcare cost and utilization project (HCUPnet) [online]. [Accessed 26 February 2025]. Available from: https://datatools.ahrq.gov/hcupnet/
    [Google Scholar]
  2. Sun BC, Hsia RY, Weiss RE, Zingmond D, Liang L-J, Han W, et al. Effect of emergency department crowding on outcomes of admitted patients. Ann Emerg Med. 2013 Jun; 61:(6):605–11.e6. https://doi.org/10.1016/j.annemergmed.2012.10.026
    [Google Scholar]
  3. Darraj A, Hudays A, Hazazi A, Hobani A, Alghamdi A. The association between emergency department overcrowding and delay in treatment: A systematic review. Healthcare. 2023 Jan 29; 11:(3):385. https://doi.org/10.3390/healthcare11030385
    [Google Scholar]
  4. Saukkonen KA, Varpula M, Räsänen P, Roine RP, Voipio-Pulkki L-M, Pettilä V. The effect of emergency department delay on outcome in critically ill medical patients: Evaluation using hospital mortality and quality of life at 6 months. J Intern Med. 2006 Dec; 260:(6):586–91. https://doi.org/10.1111/j.1365-2796.2006.01716.x
    [Google Scholar]
  5. Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Dtsch Arztebl Int. 2010 Dec; 107:(50):892–8. https://doi.org/10.3238/arztebl.2010.0892
    [Google Scholar]
  6. Zachariasse JM, van der Hagen V, Seiger N, Mackway-Jones K, van Veen M, Moll HA. Performance of triage systems in emergency care: A systematic review and meta-analysis. BMJ Open. 2019 May 28; 9:(5):e026471. https://doi.org/10.1136/bmjopen-2018-026471
    [Google Scholar]
  7. Hinson JS, Martinez DA, Schmitz PSK, Toerper M, Radu D, Scheulen J, et al. Accuracy of emergency department triage using the Emergency Severity Index and independent predictors of under-triage and over-triage in Brazil: A retrospective cohort analysis. Int J Emerg Med. 2018 Jan 15; 11:(1):3. https://doi.org/10.1186/s12245-017-0161-8
    [Google Scholar]
  8. Shailaja K, Seetharamulu B, Jabbar MA. Machine learning in healthcare: A review. In: 2018 Second international conference on electronics, communication and aerospace technology (ICECA); 2018. 910–4.
    [Google Scholar]
  9. Hany A. Zaki, Eman E. Shaban, Nabil Shallik et al. A Comprehensive Systematic Review and Meta-Analysis: Evaluating the Effectiveness and Integration Obstacles of Artificial Intelligence (AI) within Anesthesia Departments., 19 June 2024, PREPRINT (Version 1) available at Research Square [https://doi.org/10.21203/rs.3.rs-4599435/v1].
    [Google Scholar]
  10. Desautels T, Calvert J, Hoffman J, Jay M, Kerem Y, Shieh L, et al. Prediction of sepsis in the intensive care unit with minimal electronic health record data: A machine learning approach. JMIR Med Inform. 2016 Sep 30; 4:(3):e28. https://doi.org/10.2196/medinform.5909
    [Google Scholar]
  11. Sánchez-Salmerón R, Gómez-Urquiza JL, Albendín-García L, Correa-Rodríguez M, Martos-Cabrera MB, Velando-Soriano A, et al. Machine learning methods applied to triage in emergency services: A systematic review. Int Emerg Nurs. 2022 Jan; 60::101109. https://doi.org/10.1016/j.ienj.2021.101109
    [Google Scholar]
  12. Logothetis SB, Green D, Holland M, Al Moubayed N. Predicting acute clinical deterioration with interpretable machine learning to support emergency care decision making. Sci Rep. 2023 Aug 21; 13:(1):13563. https://doi.org/10.1038/s41598-023-40661-0
    [Google Scholar]
  13. Lu T-C, Wang C-H, Chou F-Y, Sun J-T, Chou EH, Huang EP-C, et al. Machine learning to predict in-hospital cardiac arrest from patients presenting to the emergency department. Intern Emerg Med. 2023 Mar; 18:(2):595–605. https://doi.org/10.1007/s11739-022-03143-1
    [Google Scholar]
  14. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. 2021 Mar 29; 372:n71. https://doi.org/10.1136/bmj.n71
    [Google Scholar]
  15. Mongan J, Moy L, Kahn CE. Checklist for artificial intelligence in medical imaging (CLAIM): A guide for authors and reviewers. Radiol Artif Intell. 2020 Mar 25; 2:(2):e200029. https://doi.org/10.1148/ryai.2020200029
    [Google Scholar]
  16. Jakob CEM, Mahajan UM, Oswald M, Stecher M, Schons M, Mayerle J, et al. Prediction of COVID-19 deterioration in high-risk patients at diagnosis: An early warning score for advanced COVID-19 developed by machine learning. Infection. 2022 Apr; 50:(2):359–70. https://doi.org/10.1007/s15010-021-01656-z
    [Google Scholar]
  17. Shamout FE, Shen Y, Wu N, Kaku A, Park J, Makino T, et al. An artificial intelligence system for predicting the deterioration of COVID-19 patients in the emergency department. NPJ Digi Med. 2021; 4:80. https://doi.org/10.1038/s41746-021-00453-0
    [Google Scholar]
  18. Choi A, Lee K, Hyun H, Kim KJ, Ahn B, Lee KH, et al. A novel deep learning algorithm for real-time prediction of clinical deterioration in the emergency department for a multimodal clinical decision support system. Sci Rep. 2024 Dec 3; 14:(1):30116. https://doi.org/10.1038/s41598-024-80268-7
    [Google Scholar]
  19. Choi A, Choi SY, Chung K, Chung HS, Song T, Choi B, et al. Development of a machine learning-based clinical decision support system to predict clinical deterioration in patients visiting the emergency department. Sci Rep. 2023; 13:8561. https://doi.org/10.1038/s41598-023-35617-3
    [Google Scholar]
  20. Hong S, Lee S, Lee J, Cha WC, Kim K. Prediction of cardiac arrest in the emergency department based on machine learning and sequential characteristics: Model development and retrospective clinical validation study. JMIR Med Inform. 2020 Aug 4; 8:(8):e15932. https://doi.org/10.2196/15932
    [Google Scholar]
  21. Kim JH, Choi A, Kim MJ, Hyun H, Kim S, Chang H-J. Development of a machine-learning algorithm to predict in-hospital cardiac arrest for emergency department patients using a nationwide database. Sci Rep. 2022; 12:21797. https://doi.org/10.1038/s41598-022-26167-1
    [Google Scholar]
  22. Watson M, Boulitsakis Logothetis S, Green D, Holland M, Chambers P, Al Moubayed N. Performance of machine learning versus the national early warning score for predicting patient deterioration risk: A single-site study of emergency admissions. BMJ Health Care Inform. 2024 Dec 4; 31:(1):e101088. https://doi.org/10.1136/bmjhci-2024-101088
    [Google Scholar]
  23. Moffat LM, Xu D. Accuracy of machine learning models to predict in-hospital cardiac arrest: A systematic review. Clin Nurse Spec. 2022 Jan-Feb; 36:(1):29–44. https://doi.org/10.1097/NUR.0000000000000644
    [Google Scholar]
  24. Armand TPT, Nfor KA, Kim J-I, Kim H-C. Applications of artificial intelligence, machine learning, and deep learning in nutrition: A systematic review. Nutrients. 2024 Apr 6; 16:(7):1073. https://doi.org/10.3390/nu16071073
    [Google Scholar]
  25. Garcia-Gutiérrez S, Esteban-Aizpiri C, Lafuente I, Barrio I, Quiros R, Quintana JM, et al. Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19. Sci Rep. 2022 May 2; 12:(1):7097. https://doi.org/10.1038/s41598-022-09771-z
    [Google Scholar]
  26. Veldhuis LI, Woittiez NJC, Nanayakkara PWB, Ludikhuize J. Artificial intelligence for the prediction of in-hospital clinical deterioration: A systematic review. Crit Care Explor. 2022 Aug 26; 4:(9):e0744. https://doi.org/10.1097/CCE.0000000000000744
    [Google Scholar]
/content/journals/10.5339/jemtac.2026.15
Loading
/content/journals/10.5339/jemtac.2026.15
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error