Open Access
CC BY 4.0 · ACI open 2025; 09(01): e18-e28
DOI: 10.1055/a-2437-9977
Research Article

Human-Centered Design and Iterative Refinement of Tools and Methods to Implement a Surveillance and Risk Prediction System for Clinical Deterioration in Ambulatory Cancer Care

Daniel J. France
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
2   Vanderbilt University School of Nursing, Nashville, Tennessee, United States
,
Paromita Nath
3   Department of Mechanical Engineering, Henry M. Rowan College of Engineering, Glassboro, New Jersey, United States
,
Jason Slagle
4   Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Shilo Anders
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Megan Salwei
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Timothy Vogus
5   Owen Graduate School of Management, Vanderbilt University, Nashville, Tennessee, United States
,
Hannah Slater
4   Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Carrie Reale
6   Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Laurie Novak
4   Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Lori-Anne Parker-Danley
7   Department of Patient and Family Engagement, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Zachary Kohutek
8   Department of Radiation, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Rajiv Agarwal
9   Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Joyce Harris
4   Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Barbara Yudiskas
6   Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Ralph Conwill
6   Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Terrell Smith
10   Department of Patient Care, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Evan Rhodes
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Emma Schremp
11   Department of Pediatrics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Erin A. Gillaspie
12   Department of Thoracic Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Adam Wright
4   Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Robert E. Freundlich
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Ryan Myles
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Janelle Faiman
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Sankaran Mahadevan
13   Department of Civil Engineering, Vanderbilt University, Nashville, Tennessee, United States
,
Matthew Weinger
1   Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
› Institutsangaben

Funding This study was supported by grant 5R18HS026616 to Drs. Weinger and France from the Agency for Healthcare Research and Quality (AHRQ, Rockville, MD). The use of REDCap and MyCap were supported by a grant from the National Center for Advancing Translational Sciences (NCATS) Clinical Translational Science Award (CTSA) Program (5UL1TR002243) via the Vanderbilt Institute for Clinical and Translational Research (VICTR) center.
Preview

Abstract

Background A common cause of preventable harm is the failure to detect and appropriately respond to clinical deterioration. Timely intervention is needed, particularly in medically complex patients, to mitigate the effects of adverse events, disease progression, and medical error. This challenging problem requires clinical surveillance, early recognition, timely notification of the appropriate clinicians, and effective intervention.

Objectives We determined the feasibility of designing, developing, and implementing the tools and processes to create a surveillance-and-risk prediction system to detect clinical deterioration in cancer outpatients.

Methods We used systems engineering and iterative human-centered design to develop a functional prototype of a surveillance-and-risk prediction system. The system includes passive surveillance involving wearable sensors, active surveillance involving patient event and symptom reporting as well as extraction of selected patient data from the electronic health record (EHR), a predictive model, and communication of estimated risk to clinicians. System usability was evaluated using patient and clinician interviews and clinician ratings using the System Usability Scale (SUS).

Results Fifty of 71 recruited patients enrolled in the feasibility study. Patient-reported outcome measures and clinical data extracted from the EHR were the best predictors of a patient's 7-day risk of experiencing unplanned treatment events (UTEs, i.e., emergency room visits, hospital admissions, or major treatment changes). Deep learning neural network models using these predictors demonstrated modest performance in predicting 7-day UTE risk (PROMS, F-measure: 0.900, area under the receiver operating characteristic curve [AUC-ROC]: 0.983; clinical data from EHR F-measure: 0.625, AUC-ROC: 0.983). Patient risk scores were communicated to clinicians using a risk communication prototype rated favorably by clinicians with a SUS score of 76 out of 100 (median = 80; range: 60–85).

Conclusion We demonstrate the feasibility of a surveillance-and-risk prediction system for detecting and reporting clinical deterioration in cancer outpatients. Future research is needed to fully implement and evaluate system adoption and effectiveness under different clinical situations.

Protection of Human and Animal Subjects

The study was approved by the The Vanderbilt University Institutional Review Board Institutional Review Board. Patient recruitment and enrollment occurred between September 2019 and July 2023.


Supplementary Material



Publikationsverlauf

Eingereicht: 18. März 2024

Angenommen: 10. September 2024

Artikel online veröffentlicht:
21. Februar 2025

© 2025. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution License, permitting unrestricted use, distribution, and reproduction so long as the original work is properly cited. (https://creativecommons.org/licenses/by/4.0/)

Georg Thieme Verlag KG
Oswald-Hesse-Straße 50, 70469 Stuttgart, Germany