Clinical Decision Support Enhanced by User Acceptance Testing to Promote Situational Awareness for Pediatric Patients with a Difficult Airway

Background Children with a difficult airway are at high risk of decompensation in the setting of respiratory distress. Situational awareness among all team members, and a shared plan in case of an emergency, can reduce the chance of catastrophic outcomes. Methods We developed clinical decision support (CDS) to improve difficult airway situational awareness while minimizing alert burden. Three iterative designs were developed and implemented from 2015 through 2023. We measured interruptive alert burden and performed observations between each implementation to estimate point prevalence among hospitalized patients with a difficult airway of three desired behaviors: presence of a difficult airway sign at the head of the bed, orders placed for appropriate equipment nearby, and primary nurse awareness of the difficult airway. Results Over the course of the redesign, the alert burden decreased from 12,316 firings per month to 125 firings per month from the first alert to the 2nd redesign and final iteration. There was a statistically significant increase in the proportion of difficult airway patients with orders for appropriate equipment from 51.4% to 83.9% (p<0.001). There was no significant change in difficult airway sign placement (71.4% to 87.1%, p=0.29) or observed nurse awareness of difficult airway status of the patient (80.0% to 87.1%, p=0.447). The greatest improvements in alert burden and rates of desired user action occurred after redesigning based on usability testing. Discussion and Conclusion CDS redesign using popular frameworks alone reduced alert burden without significantly worsening situational awareness. Redesign through guerilla in-situ usability testing led to much more substantial reductions in alert burden and greater improvements in desired user action.

Publication History

Received: 27 December 2024

Accepted after revision: 11 June 2025

Accepted Manuscript online:
12 June 2025