Subscribe to RSS
DOI: 10.1055/a-2804-5877
Effect of an Outcome Feedback Reporting System on Emergency Department Physicians' Chart Reaccess
Authors
Funding Information This work's use of the REDCap platform was supported by the National Center for Advancing Translational Sciences of the National Institutes of Health (grant no.: UM1TR004403) through the University of Iowa's Institute for Clinical and Translational Science. C.L.C. was supported by the Agency for Healthcare Research and Quality (AHRQ) through a K08 grant (grant no.: HS026965) and an internal start-up grant from the University of Iowa Carver College of Medicine Department of Pediatrics. H.S. is funded in part by the Houston Veterans Administration (VA) Health Systems Research (HSR) Center for Innovations in Quality, Effectiveness and Safety (grant no.: CIN13–413) and the Agency for Healthcare Research and Quality (grant nos.: R01HS028595 and R18HS029347). The content of this article is solely the responsibility of the authors and does not necessarily represent the official views of AHRQ, the Department of Veterans Affairs, or the U.S. government.
Abstract
Background
Learning about critically ill children's outcomes after transfer to the pediatric intensive care unit (PICU) can help emergency department (ED) physicians improve future performance. However, there are no standard processes in place to systematically provide this information; thus, most ED physicians obtain inconsistent feedback.
Objectives
We aimed to determine the effect of delivering patient outcome feedback through the electronic health record (EHR) on the frequency of ED physicians' re-access of patients' EHRs after PICU transfer.
Methods
We performed a retrospective cohort study at an academic tertiary referral hospital before and after implementing an EHR-based system delivering individual patient outcome feedback to ED physicians who admitted children from the ED to the same institution's PICU (2019–2021).
Results
A total of 180 patients transferred to the PICU by 30 unique ED physicians were included (100 pre- and 80 postintervention). After implementing the feedback system, the proportion of patients for whom ED physicians re-accessed the EHR increased from 26% preintervention to 80% postintervention (p < 0.001). Propensity score-adjusted multivariable modeling accounting for patient, clinician, encounter, and diagnostic covariates showed a significant association between receipt of patient outcome feedback reports and ED physicians' EHR re-access, with the rate of EHR re-access 2.58 times higher in the postintervention cohort (p < 0.001). The estimated marginal means, which provide an adjusted average outcome for each cohort, showed a significantly higher number of EHR re-access episodes per patient postintervention (0.44 [95% CI: 0.3, 0.66] pre- vs. 1.14 [95% CI: 0.86, 1.51] postintervention, p < 0.001).
Conclusion
Receipt of consistent patient outcome feedback increased ED physicians' re-access of patients' EHRs after PICU transfer, potentially allowing them to obtain information that can be used to improve future clinical performance. Further study is needed to determine the effectiveness of feedback systems in improving clinician practice and outcomes of critically ill children.
Protection of Human and Animal Subjects
This study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research involving Human Subjects. The University of Iowa Institutional Review Board (IRB) reviewed and approved this study (IRB #201911358, December 3, 2019, and IRB approval no.: 202105599, July 22, 2021).
Publication History
Received: 14 September 2025
Accepted: 03 February 2026
Article published online:
24 February 2026
© 2026. Thieme. All rights reserved.
Georg Thieme Verlag KG
Oswald-Hesse-Straße 50, 70469 Stuttgart, Germany
-
References
- 1 Lavoie CF, Croskerry P. Outcome feedback and patient safety. In: Patient Safety in Emergency Medicine. Lippincott Williams & Wilkins; 2009. :pp. 251-258
- 2 Rudolph JW, Morrison JB. Sidestepping superstitious learning, ambiguity, and other roadblocks: a feedback model of diagnostic problem solving. Am J Med 2008; 121 (Suppl. 05) S34-S37
- 3 Meyer AND, Singh H. The path to diagnostic excellence includes feedback to calibrate how clinicians think. JAMA 2019; 321 (08) 737-738
- 4 Omron R, Kotwal S, Garibaldi BT, Newman-Toker DE. The Diagnostic Performance Feedback “Calibration Gap”: Why clinical experience alone is not enough to prevent serious diagnostic errors?. AEM Educ Train 2018; 2 (04) 339-342
- 5 Graff LG, Chern CH, Radford M. Emergency physicians' acute coronary syndrome testing threshold and diagnostic performance: Acute coronary syndrome critical pathway with return visit feedback. Crit Pathw Cardiol 2014; 13 (03) 99-103
- 6 Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD. Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Qual Saf Health Care 2006; 15 (06) 433-436
- 7 Ivers N, Jamtvedt G, Flottorp S. et al. Audit and feedback: Effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012; 2012 (06) CD000259
- 8 Choi B, Tsai D, McGillivray CG, Amedee C, Sarafin JA, Silver B. Hospital-directed feedback to Emergency Medical Services improves prehospital performance. Stroke 2014; 45 (07) 2137-2140
- 9 Maruthappu M, Trehan A, Barnett-Vanes A, McCulloch P, Carty MJ. The impact of feedback of surgical outcome data on surgical performance: A systematic review. World J Surg 2015; 39 (04) 879-889
- 10 Gregory CJ, Nasrollahzadeh F, Dharmar M, Parsapour K, Marcin JP. Comparison of critically ill and injured children transferred from referring hospitals versus in-house admissions. Pediatrics 2008; 121 (04) e906-e911
- 11 Odetola FO, Clark SJ, Gurney JG, Dechert RE, Shanley TP, Freed GL. Effect of interhospital transfer on resource utilization and outcomes at a tertiary pediatric intensive care unit. J Crit Care 2009; 24 (03) 379-386
- 12 Cifra CL, Lin O, Gonzales CL. et al; Pediatric Acute Lung Injury and Sepsis Investigators (PALISI) Network. Interfacility transfer and admission to PICUs in the United States: Survey of Referral Communications in 2023. Pediatr Crit Care Med 2025; 26 (05) e669-e679
- 13 Cifra CL, Tigges CR, Miller SL, Herwaldt LA, Singh H. Updates to referring clinicians regarding critically ill children admitted to the pediatric intensive care unit: A state-wide survey. Diagnosis (Berl) 2020; 7 (02) 123-128
- 14 Croskerry P. The feedback sanction. Acad Emerg Med 2000; 7 (11) 1232-1238
- 15 Cifra CL, Tigges CR, Miller SL. et al. Reporting outcomes of pediatric intensive care unit patients to referring physicians via an electronic health record-based feedback system. Appl Clin Inform 2022; 13 (02) 495-503
- 16 Cifra CL, Sittig DF, Singh H. Bridging the feedback gap: A sociotechnical approach to informing clinicians of patients' subsequent clinical course and outcomes. BMJ Qual Saf 2021; 30 (07) 591-597
- 17 von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. J Clin Epidemiol 2008; 61 (04) 344-349
- 18 Adler-Milstein J, Adelman JS, Tai-Seale M, Patel VL, Dymek C. EHR audit logs: A new goldmine for health services research?. J Biomed Inform 2020; 101: 103343
- 19 Sittig DF, Wright A. A guide to mitigating audit log-related risk in medical professional liability cases. J Healthc Risk Manag 2023; 43 (02) 37-47
- 20 Rule A, Kannampallil T, Hribar MR. et al. Guidance for reporting analyses of metadata on electronic health record use. J Am Med Inform Assoc 2024; 31 (03) 784-789
- 21 Hautz SC, Schuler L, Kämmer JE. et al. Factors predicting a change in diagnosis in patients hospitalised through the emergency room: A prospective observational study. BMJ Open 2016; 6 (05) e011585
- 22 Hautz WE, Kämmer JE, Hautz SC. et al. Diagnostic error increases mortality and length of hospital stay in patients presenting through the emergency room. Scand J Trauma Resusc Emerg Med 2019; 27 (01) 54
- 23 Cifra CL, Custer JW, Smith CM. et al. Prevalence and characteristics of diagnostic error in pediatric critical care: A multicenter study. Crit Care Med 2023; 51 (11) 1492-1501
- 24 Cifra CL, Custer JW, Smith CM. et al. Diagnostic uncertainty among critically ill children admitted to the PICU: A multicenter study. Crit Care Med 2025; 53 (02) e294-e307
- 25 Greifer N, Stuart EA. Choosing the causal estimand for propensity score analysis of observational studies. arXiv ;arXiv.2106.10577. Preprint posted online July 11, 2023;
- 26 Fernandez Branson C, Williams M, Chan TM. et al. Improving diagnostic performance through feedback: The Diagnosis Learning Cycle. BMJ Qual Saf 2021; 30 (12) 1002-1009
- 27 Rosner BI, Zwaan L, Olson APJ. Imagining the future of diagnostic performance feedback. Diagnosis (Berl) 2022; 10 (01) 31-37
- 28 Donner-Banzhoff N, Müller B, Beyer M, Haasenritter J, Seifart C. Thresholds, rules and defensive strategies: how physicians learn from their prior diagnosis-related experiences. Diagnosis (Berl) 2020; 7 (02) 115-121
- 29 Graham JMK, Ambroggio L, Leonard JE, Ziniel SI, Grubenhoff JA. Evaluation of feedback modalities and preferences regarding feedback on decision-making in a pediatric emergency department. Diagnosis (Berl) 2021; 9 (02) 216-224
- 30 Bowen JL, Ilgen JS, Irby DM, Ten Cate O, O'Brien BC. “You Have to Know the End of the Story”: Motivations to follow up after transitions of clinical responsibility. Acad Med 2017; 92 (11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 56th Annual Research in Medical Education Sessions): S48-S54
- 31 Bowen JL, O'Brien BC, Ilgen JS, Irby DM, Ten Cate O. Chart stalking, list making, and physicians' efforts to track patients' outcomes after transitioning responsibility. Med Educ 2018; 52 (04) 404-413
- 32 Rudolf F, Oyama LC, El-Kareh R. Impact of an automated patient outcome feedback system on emergency medicine resident patient follow-up: An interrupted time series analysis. AEM Educ Train 2024; 8 (04) e11011
- 33 Shenvi EC, Feupe SF, Yang H, El-Kareh R. “Closing the loop”: A mixed-methods study about resident learning from outcome feedback after patient handoffs. Diagnosis (Berl) 2018; 5 (04) 235-242
- 34 Narayana S, Rajkomar A, Harrison JD, Valencia V, Dhaliwal G, Ranji SR. What happened to my patient? An educational intervention to facilitate postdischarge patient follow-up. J Grad Med Educ 2017; 9 (05) 627-633
- 35 Lane KP, Chia C, Lessing JN. et al. Improving resident feedback on diagnostic reasoning after handovers: The LOOP Project. J Hosp Med 2019; 14 (10) 622-625
- 36 Gawande A. The Coach in the Operating Room. The New Yorker. September 26, 2011 . Accessed May 21, 2025 at: https://www.newyorker.com/magazine/2011/10/03/personal-best
- 37 Gupta R, Siemens I, Campbell S. The use of outcome feedback by emergency medicine physicians: Results of a physician survey. World J Emerg Med 2019; 10 (01) 14-18
- 38 Goldman MP, Query LA, Wong AH. et al. Closing the loop: Program description and qualitative analysis of a pediatric posttransfer follow-up and feedback program. Pediatr Emerg Care 2021; 37 (12) e1535-e1543
