Enhancing Patient Safety Event ReportingA Systematic Review of System Design Features
17 March 2017
25 June 2017
20 December 2017 (online)
Objectives: Electronic patient safety event reporting (e-reporting) is an effective mechanism to learn from errors and enhance patient safety. Unfortunately, the value of e-reporting system (a software or web server based platform) in patient safety research is greatly overshadowed by low quality reporting. This paper aims at revealing the current status of system features, detecting potential gaps in system design, and accordingly proposing suggestions for future design and implementation of the system.
Methods: Three literature databases were searched for publications that contain informative descriptions of e-reporting systems. In addition, both online publicly accessible reporting forms and systems were investigated.
Results: 48 systems were identified and reviewed. 11 system design features and their frequencies of occurrence (Top 5: widgets (41), anonymity or confidentiality (29), hierarchy (20), validator (17), review notification (15)) were identified and summarized into a system hierarchical model.
Conclusions: The model indicated the current e-reporting systems are at an immature stage in their development, and discussed their future development direction toward efficient and effective systems to improve patient safety.
Citation: Gong Y, Kang H, Wu X, Hua L. Enhancing Patient Safety Event Reporting. Appl Clin Inform 2017; 8: 893–909 https://doi.org/10.4338/ACI-2016-02-R-0023
KeywordsIncident reporting - clinical information systems - patient safety - user-computer interface - medical informatics applications
Clinical Relevance Statement
This study advances the knowledge regarding the design features of the current e-reporting systems. Our results hold promise in facilitating the development of e-reporting systems and improving the patient safety in clinical settings.
Protection of Human and Animal Subjects
Human and animal subjects were not included in the project.
- 1 International Classification for Patient Safety (ICPS): World Health Organization. Available from: http://www.who.int/patientsafety/implementation/taxonomy/development_site/en
- 2 Pronovost PJ, Morlock LL, Sexton JB, Miller MR, Holzmueller CG, Thompson DA. et al. Improving the Value of Patient Safety Reporting Systems. In: Henriksen K, Battles JB, Keyes MA, Grady ML. editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol 1: Assessment). Advances in Patient Safety.. Rockville (MD): 2008
- 3 Barach P, Small SD. Reporting and preventing medical mishaps: lessons from non-medical near miss reporting systems. BMJ 2000; 320 7237 759-63.
- 4 Mahajan RP. Critical incident reporting and learning. Br J Anaesth 2010; 105 (01) 69-75.
- 5 Shaw R, Drever F, Hughes H, Osborn S, Williams S. Adverse events and near miss reporting in the NHS. Qual Saf Health Care 2005; 14 (04) 279-83.
- 6 Kuo YH, Lee TT, Mills ME, Lin KC. The evaluation of a web-based incident reporting system. Computers, informatics, nursing CIN 2012; 30 (07) 386-94.
- 7 Rudman WJ, Bailey JH, Hope C, Garrett P, Brown CA. The Impact of a Web-based Reporting System on the Collection of Medication Error Occurrence Data. In: Henriksen K, Battles JB, Marks ES, Lewin DI. editors. Advances in Patient Safety: From Research to Implementation (Volume 3: Implementation Issues). Advances in Patient Safety.. Rockville (MD) 2005
- 8 Gong Y. Data consistency in a voluntary medical incident reporting system. Journal of medical systems 2011; 35 (04) 609-15.
- 9 Tuttle D, Holloway R, Baird T, Sheehan B, Skelton WK. Electronic reporting to improve patient safety. Qual Saf Health Care 2004; 13 (04) 281-6.
- 10 Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc 2013; 20 (01) 144-51.
- 11 Wand Y, Wang RY. Anchoring data quality dimensions in ontological foundations. Communications of the ACM 1996; 39 (11) 86-95.
- 12 Johnson C. Failure in safety-critical systems: A handbook of accident and incident reporting. Glasgow: University of Glasgow Press; 2003
- 13 Holden RJ, Karsh BT. A review of medical error reporting system design considerations and a proposed cross-level systems research framework. Hum Factors 2007; 49 (02) 257-76.
- 14 Cheng L, Sun N, Li Y, Zhang Z, Wang L, Zhou J. et al. International comparative analyses of incidents reporting systems for healthcare risk management. Journal of evidence-based medicine 2011; 4 (01) 32-47.
- 15 Benn J, Koutantji M, Wallace L, Spurgeon P, Rejman M, Healey A. et al. Feedback from incident reporting: information and action to improve patient safety. Qual Saf Health Care 2009; 18 (01) 11-21.
- 16 Data quality: Wikipedia. Available from: https://en.wikipedia.org/wiki/Data_quality#Definitions
- 17 PRISMA Transparent Reporting of Systematic Reviews and Meta-Analysis. The PRISMA Flow Diagram. Available from: http://www.prisma-statement.org/statement.htm
- 18 EMR Adoption ModelSM EMR Adoption Model Structure Ensures Objectivity Available from: http://www.himssanalytics.org/hc_providers/emr_adoption.asp
- 19 Hersh W, Wright A. What workforce is needed to implement the health information technology agenda? Analysis from the HIMSS analytics database. AMIA Annu Symp Proc 2008: 303-7.
- 20 Rudas I, Fodor J. Intelligent systems. J of Computers, Communications & Control 2008; 3 (Proceedings of ICCCC 2008): 132-8
- 21 Chen K, Chen H, Conway N, Hellerstein JM, Parikh TS. Usher: Improving data quality with dynamic forms. Knowledge and Data Engineering, IEEE Transactions on 2011; 23 (08) 1138-53.
- 22 Tulving E. Episodic memory: from mind to brain. Annu Rev Psychol 2002; 53: 1-25.
- 23 Handler SM, Perera S, Olshansky EF, Studenski SA, Nace DA, Fridsma DB. et al. Identifying modifiable barriers to medication error reporting in the nursing home setting. J Am Med Dir Assoc 2007; 8 (09) 568-74.
- 24 Martin SK, Etchegaray JM, Simmons D, Belt WT, Clark K. Development and Implementation of The University of Texas Close Call Reporting System. In: Henriksen K, Battles JB, Marks ES, Lewin DI. editors. Advances in Patient Safety: From Research to Implementation (Volume 2: Concepts and Methodology). Advances in Patient Safety. Rockville (MD) 2005
- 25 Guffey P, Szolnoki J, Caldwell J, Polaner D. Design and implementation of a near-miss reporting system at a large, academic pediatric anesthesia department. Paediatric anaesthesia 2011; 21 (07) 810-4.
- 26 Daniels JP, King AD, Cochrane DD, Carr R, Shaw NT, Lim J. et al. A human factors and survey methodology-based design of a web-based adverse event reporting system for families. International journal of medical informatics 2010; 79 (05) 339-48.
- 27 Haw C, Cahill C. A computerized system for reporting medication events in psychiatry: the first two years of operation. Journal of psychiatric and mental health nursing 2011; 18 (04) 308-15.
- 28 van der Veer S, Cornet R, de Jonge E. Design and implementation of an ICU incident registry. International journal of medical informatics 2007; 76 2–3 103-8.
- 29 Alrwisan A, Ross J, Williams D. Medication incidents reported to an online incident reporting system. European journal of clinical pharmacology 2011; 67 (05) 527-32.
- 30 Mekhjian HS, Bentley TD, Ahmad A, Marsh G. Development of a Web-based event reporting system in an academic environment. J Am Med Inform Assoc 2004; 11 (01) 11-8.
- 31 Haller G, Myles PS, Stoelwinder J, Langley M, Anderson H, McNeil J. Integrating incident reporting into an electronic patient record system. J Am Med Inform Assoc 2007; 14 (02) 175-81.
- 32 Peterfreund RA, Driscoll WD, Walsh JL, Subramanian A, Anupama S, Weaver M. et al. Evaluation of a mandatory quality assurance data capture in anesthesia: a secure electronic system to capture quality assurance information linked to an automated anesthesia record. Anesthesia and analgesia 2011; 112 (05) 1218-25.
- 33 Patient safety zone: Patient safety events reporting system [cited 2017 Feb 1]. Available from: http://www.patientsafetyzone.com/PatientSafetyEventsReportingSystem.html
- 34 Pierson S, Hansen R, Greene S, Williams C, Akers R, Jonsson M. et al. Preventing medication errors in long-term care: results and evaluation of a large scale web-based error reporting system. Qual Saf Health Care 2007; 16 (04) 297-302.
- 35 Crespin DJ, Modi AV, Wei D, Williams CE, Greene SB, Pierson S. et al. Repeat medication errors in nursing homes: Contributing factors and their association with patient harm. The American journal of geriatric pharmacotherapy 2010; 8 (03) 258-70.
- 36 Greene SB, Williams CE, Pierson S, Hansen RA, Carey TS. Online medication error graphic reports: a pilot in North Carolina nursing homes. Journal of patient safety 2011; 7 (02) 92-8.
- 37 Whitehurst JM, Cozart H, Leonard D, Schroder J, Horvath M, Avent S. et al. Tailoring ,,best-of-breed“ safety classification for patient fall voluntary reporting. Journal of patient safety 2010; 6 (03) 192-8.
- 38 Whitehurst JM, Schroder J, Leonard D, Horvath MM, Cozart H, Ferranti J. Towards the creation of a flexible classification scheme for voluntarily reported transfusion and laboratory safety events. Journal of biomedical semantics 2012; 3: 4.
- 39 Tepfers A, Louie H, Drouillard M. Developing an electronic incident report: experiences of a multi-site teaching hospital. Healthcare quarterly (Toronto, Ont) 2007; 10 (02) 117-22.
- 40 Grando VT, Rantz MJ, Maas M. Nursing home staff ‘s views on quality improvement interventions: a follow-up study. J Gerontol Nurs 2007; 33 (01) 40-7.
- 41 Welters ID, Gibson J, Mogk M, Wenstone R. Major sources of critical incidents in intensive care. Critical care (London, England) 2011; 15 (05) R232.
- 42 Kivlahan C, Sangster W, Nelson K, Buddenbaum J, Lobenstein K. Developing a comprehensive electronic adverse event reporting system in an academic health center. Jt Comm J Qual Improv 2002; 28 (11) 583-94.
- 43 Ansar M, Khan TA. editors. Non-technical issues in software designing phase. 2016 Sixth International Conference on Innovative Computing Technology (INTECH); Dublin, Ireland: IEEE.
- 44 Anderson AE, Murphy ED, Nichols EM, Sigman RS, Willimack DK. Designing edits for electronic economic surveys and censuses: Issues and guidelines. Available from: http://www.fcsm.gov/working-papers/Anderson_Murphy_Nichols_AAPOR_1004.pdf
- 45 Gong Y, Hua L, Wang S. Leveraging user‘s performance in reporting patient safety events by utilizing text prediction in narrative data entry. Computer methods and programs in biomedicine 2016; 131: 181-9.
- 46 Stow J. Using medical-error reporting to drive patient safety efforts. AORN journal 2006; 84 (03) 405-20.
- 47 Kang H, Gong Y. A Novel Schema to Enhance Data Quality of Patient Safety Event Reports. AMIA Annu Symp Proc 2016; 2016: 1840-9.
- 48 Anesthesia Qualtiy Institute: Anesthesia incident reporting system [cited 2017 Feb 1]. Available from: https://www.aqihq.org/airs/airsIntro.aspx
- 49 Patient Safety Reporting System (PSRS) Report Form [cited 2017 Feb 1]. Available from: http://www.psrs.arc.nasa.gov/web_docs/PSRS_ExampleForm.pdf
- 50 DANA-FARBER Cancer Institute: Patient Safety Reporting Form [cited 2017 Feb 1]. Available from: https://www.dana-farber.org/apps/patient-safety-form.aspx
- 51 Institute for Safe Medication Practices [cited 2017 Feb 1]. Available from: http://www.consumermed/safety.org/report-a-medication-error
- 52 Hickner J, Zafar A, Kuo GM, Fagnan LJ, Forjuoh SN, Knox LM. et al. Field test results of a new ambulatory care Medication Error and Adverse Drug Event Reporting System –MEADERS. Annals of family medicine 2010; 8 (06) 517-25.
- 53 Good VS, Saldana M, Gilder R, Nicewander D, Kennerly DA. Large-scale deployment of the Global Trigger Tool across a large hospital system: refinements for the characterisation of adverse events to support patient safety learning opportunities. BMJ quality & safety 2011; 20 (01) 25-30.
- 54 Foster PN, Sidhu R, Gadhia DA, DeMusis M. Leveraging computerized sign-out to increase error reporting and addressing patient safety in graduate medical education. Journal of general internal medicine 2008; 23 (04) 481-4.
- 55 Hohenstein C, Hempel D, Schultheis K, Lotter O, Fleischmann T. Critical incident reporting in emergency medicine: results of the prehospital reports. Emergency medicine journal EMJ 2014; 31 (05) 415-8.
- 56 Harris CB, Krauss MJ, Coopersmith CM, Avidan M, Nast PA, Kollef MH. et al. Patient safety event reporting in critical care: a study of three intensive care units. Crit Care Med 2007; 35 (04) 1068-76.
- 57 ROIR Radiation Oncology Incident Reporting System [cited 2014 March 6]. Available from: http://www.cars-pso.org
- 58 Khare RK, Uren B, Wears RL. Capturing more emergency department errors via an anonymous web-based reporting system. Quality management in health care 2005; 14 (02) 91-4.
- 59 Hoffmann B, Beyer M, Rohe J, Gensichen J, Gerlach FM. ,,Every error counts“: a web-based incident reporting and learning system for general practice. Qual Saf Health Care 2008; 17 (04) 307-12.
- 60 Gong Y, Jackson-Thompson J. A Human-centered design of cancer registry system. NAACCR: North American Association of Central Cancer Registries. ; June 8; Detroit, MI2007.
- 61 Levtzion-Korach O, Alcalai H, Orav EJ, Graydon-Baker E, Keohane C, Bates DW. et al. Evaluation of the contributions of an electronic web-based reporting system: enabling action. Journal of patient safety 2009; 5 (01) 9-15.
- 62 State of New Jersey: Department of Health Patient Safety Reporting System [cited 2014 March 6]. Available from: https://www13.state.nj.us/DHSS_PSRS/(S(4zg42dqjape2l3ivzd0wvteo))/welcome/anonymous.aspx
- 63 Reporting of medical errors: Real-time tales [cited 2017 Feb 1]. Available from: http://ocw.jhsph.edu/courses/patientsafety/PDFs/PS_lec10_miller-wu.pdf
- 64 Hansen RA, Greene SB, Williams CE, Blalock SJ, Crook KD, Akers R. et al. Types of medication errors in North Carolina nursing homes: a target for quality improvement. The American journal of geriatric pharmacotherapy 2006; 4 (01) 52-61.
- 65 NHS: Report a patient safety incident here [cited 2017 Feb 1]. Available from: http://www.nrls.npsa.nhs.uk/report-a-patient-safety-incident/healthcare-staff-reporting/
- 66 Wagner LM, Capezuti E, Taylor JA, Sattin RW, Ouslander JG. Impact of a falls menu-driven incident-reporting system on documentation and quality improvement in nursing homes. The Gerontologist. 2005; 45 (06) 835-42.
- 67 Taylor JA, Brownstein D, Klein EJ, Strandjord TP. Evaluation of an anonymous system to report medical errors in pediatric inpatients. Journal of hospital medicine : an official publication of the Society of Hospital Medicine 2007; 2 (04) 226-33.
- 68 Avery J, Beyea SC, Campion P. Active error management: use of a Web-based reporting system to support patient safety initiatives. The Journal of nursing administration 2005; 35 (02) 81-5.
- 69 Davis MA, Rake GW. Implementation of a Data-based Medical Event Reporting System in the U.S. Department of Defense. In: Henriksen K, Battles JB, Marks ES, Lewin DI. editors. Advances in Patient Safety: From Research to Implementation (Volume 3: Implementation Issues). Advances in Patient Safety. Rockville (MD) 2005
- 70 Pennsylvania Patient Safety Reporting System Anonymous Report Form [cited 2017 Feb 1]. Available from: https://www.papsrs.state.pa.us/psa/_pdf/PA-PSRS%20Anonymous%20Report.pdf
- 71 Dixon JF. Going paperless with custom-built Web-based patient occurrence reporting. Jt Comm J Qual Improv 2002; 28 (07) 387-95.
- 72 Joshi MS, Anderson JF, Marwaha S. A systems approach to improving error reporting. Journal of healthcare information management JHIM 2002; 16 (01) 40-5.
- 73 Milch CE, Salem DN, Pauker SG, Lundquist TG, Kumar S, Chen J. Voluntary electronic reporting of medical errors and adverse events. An analysis of 92,547 reports from 26 acute care hospitals. Journal of general internal medicine 2006; 21 (02) 165-70.
- 74 Snydman LK, Harubin B, Kumar S, Chen J, Lopez RE, Salem DN. Voluntary electronic reporting of laboratory errors: an analysis of 37,532 laboratory event reports from 30 health care organizations. American journal of medical quality 2012; 27 (02) 147-53.
- 75 Holzmueller CG, Pronovost PJ, Dickman F, Thompson DA, Wu AW, Lubomski LH. et al. Creating the web-based intensive care unit safety reporting system. J Am Med Inform Assoc 2005; 12 (02) 130-9.
- 76 Suresh G, Horbar JD, Plsek P, Gray J, Edwards WH, Shiono PH. et al. Voluntary anonymous reporting of medical errors for neonatal intensive care. Pediatrics 2004; 113 (06) 1609-18.
- 77 Arroyo DA. A Nonpunitive, Computerized System for Improved Reporting of Medical Occurrences. In: Henriksen K, Battles JB, Marks ES, Lewin DI. editors. Advances in Patient Safety: From Research to Implementation (Volume 4: Programs, Tools, and Products). Advances in Patient Safety. Rockville (MD) 2005
- 78 Conlon P, Havlisch R, Kini N, Porter C. Using an Anonymous Web-Based Incident Reporting Tool to Embed the Principles of a High-Reliability Organization. In: Henriksen K, Battles JB, Keyes MA, Grady ML. editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol 1: Assessment). Advances in Patient Safety. Rockville (MD) 2008
- 79 Holloway RG, Tuttle D, Baird T, Skelton WK. The safety of hospital stroke care. Neurology 2007; 68 (08) 550-5.
- 80 Kanda H. Development of an online incident-reporting system for management of medical risks at hospital. Yakugaku zasshi Journal of the Pharmaceutical Society of Japan 2011; 131 (09) 1353-9.
- 81 Fernald DH, Pace WD, Harris DM, West DR, Main DS, Westfall JM. Event reporting to a primary care patient safety reporting system: a report from the ASIPS collaborative. Annals of family medicine 2004; 2 (04) 327-32.
- 82 Kobus DA, Amundson D, Moses JD, Rascona D, Gubler KD. A computerized medical incident reporting system for errors in the intensive care unit: initial evaluation of interrater agreement. Military medicine 2001; 166 (04) 350-3.
- 83 Takeda H, Matsumura Y, Nakajima K, Kuwata S, Zhenjun Y, Shanmai J. et al. Health care quality management by means of an incident report system and an electronic patient record system. International journal of medical informatics 2003; 69 2–3 285-93.
- 84 Nakajima K, Kurata Y, Takeda H. A web-based incident reporting system and multidisciplinary collaborative projects for patient safety in a Japanese hospital. Qual Saf Health Care 2005; 14 (02) 123-9.