Deployment of machine learning algorithms to predict sepsis: systematic review and application of the SALIENT clinical AI implementation framework
- PMID: 37172264
- PMCID: PMC10280361
- DOI: 10.1093/jamia/ocad075
Deployment of machine learning algorithms to predict sepsis: systematic review and application of the SALIENT clinical AI implementation framework
Abstract
Objective: To retrieve and appraise studies of deployed artificial intelligence (AI)-based sepsis prediction algorithms using systematic methods, identify implementation barriers, enablers, and key decisions and then map these to a novel end-to-end clinical AI implementation framework.
Materials and methods: Systematically review studies of clinically applied AI-based sepsis prediction algorithms in regard to methodological quality, deployment and evaluation methods, and outcomes. Identify contextual factors that influence implementation and map these factors to the SALIENT implementation framework.
Results: The review identified 30 articles of algorithms applied in adult hospital settings, with 5 studies reporting significantly decreased mortality post-implementation. Eight groups of algorithms were identified, each sharing a common algorithm. We identified 14 barriers, 26 enablers, and 22 decision points which were able to be mapped to the 5 stages of the SALIENT implementation framework.
Discussion: Empirical studies of deployed sepsis prediction algorithms demonstrate their potential for improving care and reducing mortality but reveal persisting gaps in existing implementation guidance. In the examined publications, key decision points reflecting real-word implementation experience could be mapped to the SALIENT framework and, as these decision points appear to be AI-task agnostic, this framework may also be applicable to non-sepsis algorithms. The mapping clarified where and when barriers, enablers, and key decisions arise within the end-to-end AI implementation process.
Conclusions: A systematic review of real-world implementation studies of sepsis prediction algorithms was used to validate an end-to-end staged implementation framework that has the ability to account for key factors that warrant attention in ensuring successful deployment, and which extends on previous AI implementation frameworks.
Keywords: AI implementation; artificial intelligence; machine learning; sepsis prediction; systematic review.
© The Author(s) 2023. Published by Oxford University Press on behalf of the American Medical Informatics Association.
Conflict of interest statement
The authors declare no competing interests with respect to this publication.
Figures
![Figure 1.](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/10280361/bin/ocad075f1.gif)
![Figure 2.](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/10280361/bin/ocad075f2.gif)
![Figure 3.](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/10280361/bin/ocad075f3.gif)
Similar articles
-
Systematic review and longitudinal analysis of implementing Artificial Intelligence to predict clinical deterioration in adult hospitals: what is known and what remains uncertain.J Am Med Inform Assoc. 2024 Jan 18;31(2):509-524. doi: 10.1093/jamia/ocad220. J Am Med Inform Assoc. 2024. PMID: 37964688 Free PMC article.
-
Promoting Artificial Intelligence for Global Breast Cancer Risk Prediction and Screening in Adult Women: A Scoping Review.J Clin Med. 2024 Apr 25;13(9):2525. doi: 10.3390/jcm13092525. J Clin Med. 2024. PMID: 38731054 Free PMC article. Review.
-
APPRAISE-AI Tool for Quantitative Evaluation of AI Studies for Clinical Decision Support.JAMA Netw Open. 2023 Sep 5;6(9):e2335377. doi: 10.1001/jamanetworkopen.2023.35377. JAMA Netw Open. 2023. PMID: 37747733 Free PMC article.
-
Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework.J Am Med Inform Assoc. 2023 Aug 18;30(9):1503-1515. doi: 10.1093/jamia/ocad088. J Am Med Inform Assoc. 2023. PMID: 37208863 Free PMC article. Review.
-
Preventing sepsis; how can artificial intelligence inform the clinical decision-making process? A systematic review.Int J Med Inform. 2021 Jun;150:104457. doi: 10.1016/j.ijmedinf.2021.104457. Epub 2021 Apr 10. Int J Med Inform. 2021. PMID: 33878596 Review.
Cited by
-
Achieving large-scale clinician adoption of AI-enabled decision support.BMJ Health Care Inform. 2024 May 30;31(1):e100971. doi: 10.1136/bmjhci-2023-100971. BMJ Health Care Inform. 2024. PMID: 38816209 Free PMC article.
-
Navigating the Complexity of Scoring Systems in Sepsis Management: A Comprehensive Review.Cureus. 2024 Feb 11;16(2):e54030. doi: 10.7759/cureus.54030. eCollection 2024 Feb. Cureus. 2024. PMID: 38481909 Free PMC article. Review.
-
Development and Validation of Deep-Learning-Based Sepsis and Septic Shock Early Prediction System (DeepSEPS) Using Real-World ICU Data.J Clin Med. 2023 Nov 17;12(22):7156. doi: 10.3390/jcm12227156. J Clin Med. 2023. PMID: 38002768 Free PMC article.
-
Systematic review and longitudinal analysis of implementing Artificial Intelligence to predict clinical deterioration in adult hospitals: what is known and what remains uncertain.J Am Med Inform Assoc. 2024 Jan 18;31(2):509-524. doi: 10.1093/jamia/ocad220. J Am Med Inform Assoc. 2024. PMID: 37964688 Free PMC article.
-
Perspectives on implementing models for decision support in clinical care.J Am Med Inform Assoc. 2023 Aug 18;30(9):1463-1464. doi: 10.1093/jamia/ocad142. J Am Med Inform Assoc. 2023. PMID: 37593902 No abstract available.
References
-
- Bone RC, Balk RA, Cerra FB, et al.Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Chest 1992; 101 (6): 1644–55. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical