Appl Clin Inform 2015; 06(03): 521-535
DOI: 10.4338/ACI-2015-02-RA-0019
Research Article
Schattauer GmbH

Development, Evaluation and Implementation of Chief Complaint Groupings to Activate Data Collection

A Multi-Center Study of Clinical Decision Support for Children with Head Trauma
S. J. Deakyne
1   Children’s Hospital Colorado, Department of Research Informatics, Aurora, Colorado, United States
,
L. Bajaj
2   University of Colorado, Department of Pediatrics, Section of Emergency Medicine, Aurora, Colorado, United States
,
J. Hoffman
3   Nationwide Children’s Hospital, Columbus, Ohio, United States
,
E. Alessandrini
4   Children’s Hospital Medical Center, Cincinnati, Ohio, United States
,
D. W. Ballard
5   Kaiser Permanente, San Rafael Medical Center, San Rafael, California, United States
,
R. Norris
6   Kaiser Permanente, Sacramento Medical Center, Sacramento, California, United States
,
L. Tzimenatos
7   University of California Davis School of Medicine, Departments of Emergency Medicine and Pediatrics, Sacramento, California, United States
,
M. Swietlik
8   Children’s Hospital Colorado, Department of Clinical Application Services, Aurora, Colorado, United States
,
E. Tham
2   University of Colorado, Department of Pediatrics, Section of Emergency Medicine, Aurora, Colorado, United States
,
R. W. Grundmeier
9   Children’s Hospital of Philadelphia and Perelman School of Medicine, Philadelphia, Pennsylvania, United States
,
N. Kuppermann
7   University of California Davis School of Medicine, Departments of Emergency Medicine and Pediatrics, Sacramento, California, United States
,
P. S. Dayan
10   Columbia University College of Physicians and Surgeons, Department of Pediatrics, Division of Emergency Medicine, New York, New York, United States
,
the Pediatric Emergency Care Applied Research Network (PECARN) › Author Affiliations
Further Information

Publication History

received: 15 February 2015

accepted in revised form: 07 July 2015

Publication Date:
19 December 2017 (online)

Summary

Background: Overuse of cranial computed tomography scans in children with blunt head trauma unnecessarily exposes them to radiation. The Pediatric Emergency Care Applied Research Network (PECARN) blunt head trauma prediction rules identify children who do not require a computed tomography scan. Electronic health record (EHR) based clinical decision support (CDS) may effectively implement these rules but must only be provided for appropriate patients in order to minimize excessive alerts.

Objective: To develop, implement and evaluate site-specific groupings of chief complaints (CC) that accurately identify children with head trauma, in order to activate data collection in an EHR.

Methods: As part of a 13 site clinical trial comparing cranial computed tomography use before and after implementation of CDS, four PECARN sites centrally developed and locally implemented CC groupings to trigger a clinical trial alert (CTA) to facilitate the completion of an emergency department head trauma data collection template. We tested and chose CC groupings to attain high sensitivity while maintaining at least moderate specificity.

Results: Due to variability in CCs available, identical groupings across sites were not possible. We noted substantial variability in the sensitivity and specificity of seemingly similar CC groupings between sites. The implemented CC groupings had sensitivities greater than 90% with specificities between 75–89%. During the trial, formal testing and provider feedback led to tailoring of the CC groupings at some sites.

Conclusion: CC groupings can be successfully developed and implemented across multiple sites to accurately identify patients who should have a CTA triggered to facilitate EHR data collection. However, CC groupings will necessarily vary in order to attain high sensitivity and moderate-to-high specificity. In future trials, the balance between sensitivity and specificity should be considered based on the nature of the clinical condition, including prevalence and morbidity, in addition to the goals of the intervention being considered.

Citation: Deakyne SJ, Bajaj L, Hoffmann J, Alessandrini E, Ballard DW, Norris R, Tzimenatos L, Swietlik M, Tham E, Grundmeier RW, Kuppermann N, Dayan PS. Development, Evaluation and Implementation of Chief Complaint Groupings to Activate Data Collection in a Multi-Center Study of Clinical Decision Support for Children with Head Trauma. Appl Clin Inform 2015; 6: 521–535

http://dx.doi.org/10.4338/ACI-2015-02-RA-0019