Examining the Concordance in the Documented Pressure Injury Site, Stage, and Count in Medical Information Mart for Intensive Care-III

Abstract

Objectives This study aimed to compare the concordance of pressure injury (PI) site, stage, and count documented in electronic health records (EHRs); explore if PI count during each patient hospitalization is consistent based on PI site or stage count in the diagnosis or chart event records; and examine if discrepancies in PI count were associated with patient characteristics.

Methods Hospitalization records with the International Classification of Diseases ninth edition (ICD-9) codes, chart events from two systems (CareVue, MetaVision), and clinical notes on PI were extracted from the Medical Information Mart for Intensive Care (MIMIC)-III database. PI site and stage counts from individual hospitalization were computed. Hospitalizations with the same or different counts of site and stage according to ICD-9 codes (site and stage), CareVue (site and stage), or MetaVision (stage) charts were defined as consistent or discrepant reporting. Chi-squared, independent t-, and Kruskal–Wallis tests were examined if the count discrepancy was associated with patient characteristics. ICD-9 codes and charts were also compared for people with one site or stage.

Results A total of 31,918 hospitalizations had PI data. Within hospitalizations with ICD-9-coded sites and stages, 55.9% reported different counts. Within hospitalizations with CareVue charts on PI, 99.3% reported the same count. For hospitalizations with stages based on ICD-9 codes or MetaVision chart data, only 42.9% reported the same count. Discrepancies in counts were consistently and significantly associated with variables including PI recording in clinical notes, dead/hospice at discharge, more caregivers, longer hospitalization or intensive care unit stays, and more days to first transfer. Discrepancies between ICD-9 code and chart values on the site and stage were also reported.

Conclusion Patient characteristics associated with PI count discrepancies identified patients at risk of having discrepant PI counts or worse outcomes. PI documentation quality could be improved with better communication, care continuity, and integrity. Clinical research using EHRs should adopt systematic data quality analysis to inform limitations.

Keywords

clinical data management - pressure injury - documentation concordance

Author Contributions

All authors conceptualized the study. W.Z. designed and conducted the data analysis. M.S. conducted the data management. W.Z. is responsible for the integrity of the work. W.Z. drafted the manuscript. All authors participated in writing and revising the paper. All aspects of the study (design; management, analysis, and interpretation of data; preparing report; and decision to publish) were led by the authors. All authors read and approved the final manuscript.

Protection of Human and Animal Subjects

No human subjects were recruited for this study.

Publication History

Received: 07 March 2021

Accepted: 20 July 2021

Article published online:
29 September 2021

• References

• 1 Edsberg LE, Black JM, Goldberg M, McNichol L, Moore L, Sieggreen M. Revised National Pressure Ulcer Advisory Panel Pressure Injury Staging System: revised pressure injury staging system. J Wound Ostomy Continence Nurs 2016; 43 (06) 585-597
• 2 National Pressure Ulcer Advisory Panel, European Pressure Ulcer Advisory Panel. Prevention and treatment of pressure ulcers: clinical practice guideline. Accessed August 2, 2021 at: https://www.ehob.com/media/2018/04/prevention-and-treatment-of-pressure-ulcers-clinical-practice-guidline.pdf
• 3 Agency for Healthcare Research and Quality. Preventing pressure ulcers in hospitals. Accessed August 2, 2021 at: https://www.ahrq.gov/patient-safety/settings/hospital/resource/pressureulcer/tool/index.html
• 4 Bauer K, Rock K, Nazzal M, Jones O, Qu W. Pressure ulcers in the United States' inpatient population from 2008 to 2012: results of a retrospective nationwide study. Ostomy Wound Manage 2016; 62 (11) 30-38
• 5 National Quality Forum. National voluntary consensus standards for developing a framework for measuring quality for prevention and management of pressure ulcers. Accessed August 2, 2021 at: https://www.qualityforum.org/Publications/2011/12/National_Voluntary_Consensus_Standards_for_Developing_a_Framework_for_Measuring_Quality_for_Prevention_and_Management_of_Pressure_Ulcers.aspx
• 6 Centers for Medicare and Medicaid Services. Hospital-acquired conditions. Accessed August 2, 2021 at: https://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/HospitalAcqCond/Hospital-Acquired_Conditions
• 7 Thoroddsen A, Sigurjónsdóttir G, Ehnfors M, Ehrenberg A. Accuracy, completeness and comprehensiveness of information on pressure ulcers recorded in the patient record. Scand J Caring Sci 2013; 27 (01) 84-91
• 8 European Pressure Ulcer Advisory Panel, National Pressure Injury Advisory Panel and Pan Pacific Pressure Injury Alliance. Prevention and treatment of pressure ulcers/injuries: clinical practice guideline. The international guideline 2019. Accessed August 2, 2021 at: https://www.biosanas.com.br/uploads/outros/artigos_cientificos/127/956e02196892d7140b9bb3cdf116d13b.pdf
• 9 Cramer EM, Seneviratne MG, Sharifi H, Ozturk A, Hernandez-Boussard T. Predicting the incidence of pressure ulcers in the intensive care unit using machine learning. EGEMS (Wash DC) 2019; 7 (01) 49
• 10 Nissen F, Quint JK, Morales DR, Douglas IJ. How to validate a diagnosis recorded in electronic health records. Breathe (Sheff) 2019; 15 (01) 64-68
• 11 Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc 2013; 20 (01) 144-151
• 12 Weiskopf NG, Bakken S, Hripcsak G, Weng C. A data quality assessment guideline for electronic health record data reuse. EGEMS (Wash DC) 2017; 5 (01) 14
• 13 Coomer NM, McCall NT. Examination of the accuracy of coding hospital-acquired pressure ulcer stages. Medicare Medicaid Res Rev 2013; 3 (04) mmrr.003.04.b03
• 14 Squitieri L, Ganz DA, Mangione CM. et al. Consistency of pressure injury documentation across interfacility transfers. BMJ Qual Saf 2018; 27 (03) 182-189
• 15 Park S-H, Lee Y-S, Kwon Y-M. Predictive validity of pressure ulcer risk assessment tools for elderly: a meta-analysis. West J Nurs Res 2016; 38 (04) 459-483
• 16 Johnson AEW, Pollard TJ, Shen L. et al. MIMIC-III, a freely accessible critical care database. Sci Data 2016; 3 (01) 160035
• 17 Goodwin TR, Demner-Fushman D. A customizable deep learning model for nosocomial risk prediction from critical care notes with indirect supervision. J Am Med Inform Assoc 2020; 27 (04) 567-576
• 18 Frosch K. How documentation and coding effect pressure injury rates. Accessed August 9, 2021 at: https://hsag.com/contentassets/6624899f35e54a3ba7e1836080ad8d8c/doccodingeffectpressinjrates.pdf
• 19 Zhang W, Sotoodeh M, Ho JC, Simpson RL, Hertzberg VS. Comparing the documented pressure injury in MIMIC-III: An “UpSet” visualization. In: 2021 American Nursing Informatics Association Annual Conference. 2021
• 20 The Joint Commission. Preventing pressure injuries. Accessed August 2, 2021 at: https://www.jointcommission.org/-/media/deprecated-unorganized/imported-assets/tjc/system-folders/joint-commission-online/quick_safety_issue_25_july_20161pdf.pdf?db=web&hash=A8BF4B1E486A6A67DD5210A2F36E0180
• 21 The R Foundation. The R Project for Statistical Computing. Accessed August 2, 2021 at: https://oasishub.co/dataset/the-r-project-for-statistical-computing
• 22 Wickham H, François R, Henry L, Müller K. RStudio. dplyr: a grammar of data manipulation. Accessed August 9, 2021 at: https://cran.r-project.org/web/packages/dplyr/index.html
• 23 Wickham H. RStudio. tidyverse: easily install and load the “tidyverse”. Accessed August 2, 2021 at: https://cran.r-project.org/web/packages/tidyverse/index.html
• 24 Yoshida K, Bartel A, Chipman JJ, Bohn J, ScGowan LDA, Barrett M, Christenson RHB, Bouzill G.. tableone: Creat ‘Table 1’ to describe baseline characteristics with or without propensity score weights. Accessed August 9, 2021 at: https://cran.r-project.org/web/packages/tableone/index.html
• 25 Wickham H. RStudio. stringr: simple, consistent wrappers for common string operations. Accessed August 9, 2021 at: https://cran.r-project.org/web/packages/stringr/index.html
• 26 Zhang W. Examining pressure injury site, stage, and count documentation concordances in MIMIC-III (open-source R codes). Accessed August 2, 2021 at: https://github.com/Wenhui-vivian/ACI-PUI-manuscript
• 27 Sotoodeh M, Gero ZH, Zhang W, Hertzberg VS, Ho JC. Pressure ulcer injury in unstructured clinical notes: detection and interpretation. AMIA Annu Symp Proc; 2020 2020 1160-1169
• 28 Nell Hodgson Woodruff School of Nursing. Project NeLL. Accessed August 2, 2021 at: https://www.nursing.emory.edu/overview/project-nell#Section-2
• 29 Verhovshek GJ. Build up better pressure ulcer surgery coding. Accessed August 2, 2021 at: https://www.aapc.com/blog/23376-build-up-better-pressure-ulcer-surgery-coding/