Health IT Usability Focus Section: Adapting EHR-Based Medication Instructions to Comply with Plain Language Guidance—A Randomized Experiment

Abstract

Objective Patient instructions are generally written by clinicians. However, clinician-centered language is challenging for patients to understand; in the case of pediatric medication instructions, consequences can be serious. Using examples of clinician-written medication instructions from an electronic health record, we conducted an experiment to determine whether parental misinterpretations would be reduced by instructions that followed best practices for plain language.

Methods We selected examples of dosing instructions from after-visit summaries in a commercial electronic health record. A demographically diverse sample of parents and adult caregivers was recruited from an online panel to participate in an English-language experiment, in which they received a comprehension questionnaire with either original after-visit summary instructions or instructions revised to comply with federal and other sources of plain-language guidance.

Results Nine-hundred and fifty-one respondents completed the experiment; 50% were women, the mean age was 36 years, and 38% had less than a 4-year college education. The revisions were associated with an 8 percentage point increase in correct answers overall (from 55% to 63%, p < 0.001), although revisions were not equally effective for all instructions. Health literacy and health numeracy were strong and independent predictors of comprehension. Overall, mistakes on comprehension questions were common, with respondents missing an average of 41% (6.1 of 15) of questions.

Conclusion In this experimental study, a relatively simple intervention of revising text was associated with a modest reduction in frequency of misinterpretations of medication instructions. As a supplement to more intensive high-touch interventions, revising electronic health record output to replace complex language with patient-centered language in an automated fashion is a potentially scalable solution that could reduce medication administration errors by parents.

Keywords

health literacy - pediatrics - drug overdose - medication errors - survey and questionnaires

Protection of Human and Animal Subjects

The study was reviewed by the Weill Cornell Institutional Review Board and was considered exempt because no personally identifying information was collected from the participants.

Funding

This study was supported by a pilot grant from the Department of Healthcare Policy & Research. Dr. Ancker is supported by K01 HS 021531 from the Agency for Healthcare Research and Quality.

• References

• 1 Davis TC, Federman AD, Bass III PF. , et al. Improving patient understanding of prescription drug label instructions. J Gen Intern Med 2009; 24 (01) 57-62
• 2 Lokker N, Sanders L, Perrin EM. , et al. Parental misinterpretations of over-the-counter pediatric cough and cold medication labels. Pediatrics 2009; 123 (06) 1464-1471
• 3 Bailey SC, Pandit AU, Yin S. , et al. Predictors of misunderstanding pediatric liquid medication instructions. Fam Med 2009; 41 (10) 715-721
• 4 Waldrop-Valverde D, Osborn CY, Rodriguez A, Rothman RL, Kumar M, Jones DL. Numeracy skills explain racial differences in HIV medication management. AIDS Behav 2010; 14 (04) 799-806
• 5 Yin HS, Dreyer BP, Foltin G, van Schaick L, Mendelsohn AL. Association of low caregiver health literacy with reported use of nonstandardized dosing instruments and lack of knowledge of weight-based dosing. Ambul Pediatr 2007; 7 (04) 292-298
• 6 Yin HS, Johnson M, Mendelsohn AL, Abrams MA, Sanders LM, Dreyer BP. The health literacy of parents in the United States: a nationally representative study. Pediatrics 2009; 124 (Suppl. 03) S289-S298
• 7 Yin HS, Mendelsohn AL, Wolf MS. , et al. Parents' medication administration errors: role of dosing instruments and health literacy. Arch Pediatr Adolesc Med 2010; 164 (02) 181-186
• 8 Kutner M, Greenberg E, Jin Y, Paulsen C, White S. The Health Literacy of America's Adults: Results from the 2003 National Assessment of Adult Literacy. Washington, DC: National Center for Health Statistics; 2006. . Contract No.: NCES 2006–483
• 9 McCray AT. Promoting health literacy. J Am Med Inform Assoc 2005; 12 (02) 152-163
• 10 Kutner M, Greenberg E, Baer J. A First Look at the Literacy of America's Adults in the 21st Century: National Assessment of Adult Literacy. Washington, DC: National Center for Education Statistics; 2005
• 11 Rudd R, Kirsch I, Yamamoto K. Literacy and Health in America. Princeton, NJ: Center for Global Assessment Policy Information Center Research and Development Educational Testing Service; 2004
• 12 Nielsen-Bohlman L, Panzer AM, Kindig DA. , eds. Committee on Health Literacy. Health Literacy: A Prescription to End Confusion. Washington, DC: Institute of Medicine, The National Academies Press; 2004
• 13 Ancker JS, Kaufman D. Rethinking health numeracy: a multidisciplinary literature review. J Am Med Inform Assoc 2007; 14 (06) 713-721
• 14 Lipkus IM, Samsa G, Rimer BK. General performance on a numeracy scale among highly educated samples. Med Decis Making 2001; 21 (01) 37-44
• 15 Ancker JS. Addressing health literacy and numeracy through systems approaches. In: Patel VL, Arocha JF, Ancker JS. , eds. Cognitive Informatics in Health and Biomedicine: Understanding and Modeling Health Behaviors. Cham: Springer International Publishing; 2017: 237-251
• 16 Golbeck AL, Ahlers-Schmidt CR, Paschal AM, Dismuke SE. A definition and operational framework for health numeracy. Am J Prev Med 2005; 29 (04) 375-376
• 17 Zandieh SO, Goldmann DA, Keohane CA, Yoon C, Bates DW, Kaushal R. Risk factors in preventable adverse drug events in pediatric outpatients. J Pediatr 2008; 152 (02) 225-231
• 18 Walsh KE, Kaushal R, Chessare JB. How to avoid paediatric medication errors: a user's guide to the literature. Arch Dis Child 2005; 90 (07) 698-702
• 19 Schillie SF, Shehab N, Thomas KE, Budnitz DS. Medication overdoses leading to emergency department visits among children. Am J Prev Med 2009; 37 (03) 181-187
• 20 Kang AM, Brooks DE. US poison control center calls for infants 6 months of age and younger. Pediatrics 2016; 137 (02) e20151865
• 21 Li SF, Lacher B, Crain EF. Acetaminophen and ibuprofen dosing by parents. Pediatr Emerg Care 2000; 16 (06) 394-397
• 22 Yin HS, Dreyer BP, Ugboaja DC. , et al. Unit of measurement used and parent medication dosing errors. Pediatrics 2014; 134 (02) e354-e361
• 23 Mehndiratta S. Strategies to reduce medication errors in pediatric ambulatory settings. J Postgrad Med 2012; 58 (01) 47-53
• 24 Johnson KB, Butta JK, Donohue PK, Glenn DJ, Holtzman NA. Discharging patients with prescriptions instead of medications: sequelae in a teaching hospital. Pediatrics 1996; 97 (04) 481-485
• 25 Simon HK, Weinkle DA. Over-the-counter medications. Do parents give what they intend to give?. Arch Pediatr Adolesc Med 1997; 151 (07) 654-656
• 26 Patel VL, Branch T, Arocha JF. Errors in interpreting quantities as procedures: the case of pharmaceutical labels. Int J Med Inform 2002; 65 (03) 193-211
• 27 Carayon P, Schoofs Hundt A, Karsh B-T. , et al. Work system design for patient safety: the SEIPS model. Qual Saf Health Care 2006; 15 (Suppl. 01) i50-i58
• 28 Carayon P. , ed. Human Factors and Ergonomics in Healthcare and Patient Safety. 2nd ed. Boca Raton, FL: CRC Press, Taylor & Francis Group; 2012
• 29 Rosson MB, Carroll JM. Usability Engineering: Scenario-based Development of Human-Computer Interaction. San Francisco: Morgan Kaufmann; 2002
• 30 Moore JO, Boyer EW, Safren S. , et al. Designing interventions to overcome poor numeracy and improve medication adherence in chronic illness, including HIV/AIDS. J Med Toxicol 2011; 7 (02) 133-138
• 31 Fogarty L, Roter D, Larson S, Burke J, Gillespie J, Levy R. Patient adherence to HIV medication regimens: a review of published and abstract reports. Patient Educ Couns 2002; 46 (02) 93-108
• 32 Machtinger EL, Wang F, Chen LL, Rodriguez M, Wu S, Schillinger D. A visual medication schedule to improve anticoagulation control: a randomized, controlled trial. Jt Comm J Qual Patient Saf 2007; 33 (10) 625-635
• 33 Kripalani S, Schmotzer B, Jacobson TA. Improving Medication Adherence through Graphically Enhanced Interventions in Coronary Heart Disease (IMAGE-CHD): a randomized controlled trial. J Gen Intern Med 2012; 27 (12) 1609-1617
• 34 Bailey SC, Wolf MS, Lopez A. , et al. Expanding the Universal Medication Schedule: a patient-centred approach. BMJ Open 2014; 4 (01) e003699
• 35 Yin HS, Dreyer BP, Moreira HA. , et al. Liquid medication dosing errors in children: role of provider counseling strategies. Acad Pediatr 2014; 14 (03) 262-270
• 36 McMahon SR, Rimsza ME, Bay RC. Parents can dose liquid medication accurately. Pediatrics 1997; 100 (3 Pt 1): 330-333
• 37 Frush KS, Luo X, Hutchinson P, Higgins JN. Evaluation of a method to reduce over-the-counter medication dosing error. Arch Pediatr Adolesc Med 2004; 158 (07) 620-624
• 38 Baker DW. The meaning and the measure of health literacy. J Gen Intern Med 2006; 21 (08) 878-883
• 39 Rudd RE. Improving Americans' health literacy. N Engl J Med 2010; 363 (24) 2283-2285
• 40 Osterberg L, Blaschke T. Adherence to medication. N Engl J Med 2005; 353 (05) 487-497
• 41 Nieuwlaat R, Wilczynski N, Navarro T. , et al. Interventions for enhancing medication adherence. Cochrane Database Syst Rev 2014; (11) CD000011
• 42 Workgroup to Evaluate and Enhance the Reach and Dissemination of Health Promotion Interventions. RE-AIM. Available at: http://re-aimorg . Accessed June 12, 2017
• 43 Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999; 89 (09) 1322-1327
• 44 Bakken S, Ruland CM. Translating clinical informatics interventions into routine clinical care: how can the RE-AIM framework help?. J Am Med Inform Assoc 2009; 16 (06) 889-897
• 45 Sullivan JE, Farrar HC. ; Section on Clinical Pharmacology and Therapeutics; Committee on Drugs. Fever and antipyretic use in children. Pediatrics 2011; 127 (03) 580-587
• 46 Shoemaker SJ, Wolf MS, Brach C. Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information. Patient Educ Couns 2014; 96 (03) 395-403
• 47 Leroy G, Endicott JE, Mouradi O, Kauchak D, Just ML. Improving perceived and actual text difficulty for health information consumers using semi-automated methods. AMIA Annu Symp Proc 2012; 2012: 522-531
• 48 Julian-Reynier C, Welkenhuysen M, Hagoel L, Decruyenaere M, Hopwood P. ; CRISCOM Working Group. Risk communication strategies: state of the art and effectiveness in the context of cancer genetic services. Eur J Hum Genet 2003; 11 (10) 725-736
• 49 www.plainlanguage.gov
• 50 Bailey SC, Hasnain-Wynia R, Chen AH. , et al. Developing multilingual prescription instructions for patients with limited English proficiency. J Health Care Poor Underserved 2012; 23 (01) 81-87
• 51 Bailey SC, Sarkar U, Chen AH, Schillinger D, Wolf MS. Evaluation of language concordant, patient-centered drug label instructions. J Gen Intern Med 2012; 27 (12) 1707-1713
• 52 Yin HS, Mendelsohn AL, Fierman A, van Schaick L, Bazan IS, Dreyer BP. Use of a pictographic diagram to decrease parent dosing errors with infant acetaminophen: a health literacy perspective. Acad Pediatr 2011; 11 (01) 50-57
• 53 Ancker JS, Senathirajah Y, Kukafka R, Starren JB. Design features of graphs in health risk communication: a systematic review. J Am Med Inform Assoc 2006; 13 (06) 608-618
• 54 Kincaid J, Fishburne R, Rogers R, Chissom B. Derivation of new readability formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy enlisted personnel. Research Branch Report 8–75. Memphis: Naval Air Station; 1975
• 55 McLaughlin GH. SMOG grading: a new readability formula. J Read 1969; 12 (08) 639-646
• 56 Leroy G, Kauchak D. The effect of word familiarity on actual and perceived text difficulty. J Am Med Inform Assoc 2014; 21 (e1): e169-e172
• 57 Zarcadoolas C. The simplicity complex: exploring simplified health messages in a complex world. Health Promot Int 2011; 26 (03) 338-350
• 58 Zarcadoolas C, Pleasant A, Greer DS. Understanding health literacy: an expanded model. Health Promot Int 2005; 20 (02) 195-203
• 59 Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med 2004; 36 (08) 588-594
• 60 Morris NS, MacLean CD, Chew LD, Littenberg B. The Single Item Literacy Screener: evaluation of a brief instrument to identify limited reading ability. BMC Fam Pract 2006; 7 (21) 21
• 61 Wallace LS, Keenum AJ, DeVoe JE, Bolon SK, Hansen JS. Women's understanding of different dosing instructions for a liquid pediatric medication. J Pediatr Health Care 2012; 26 (06) 443-450
• 62 Schapira MM, Walker CM, Miller T. , et al. Development and validation of the numeracy understanding in Medicine Instrument short form. J Health Commun 2014; 19 (Suppl. 02) 240-253
• 63 Schapira MM, Walker CM, Cappaert KJ. , et al. The numeracy understanding in medicine instrument: a measure of health numeracy developed using item response theory. Med Decis Making 2012; 32 (06) 851-865
• 64 Davis TC, Wolf MS, Bass III PF. , et al. Literacy and misunderstanding prescription drug labels. Ann Intern Med 2006; 145 (12) 887-894
• 65 Wolf MS, Davis TC, Curtis LM. , et al. A patient-centered prescription drug label to promote appropriate medication use and adherence. J Gen Intern Med 2016; 31 (12) 1482-1489
• 66 Wolf MS, Bailey SC, Serper M. , et al. Comparative effectiveness of patient-centered strategies to improve FDA medication guides. Med Care 2014; 52 (09) 781-789
• 67 Rampey BD, Finnegan R, Goodman M. , et al. Skills of US Unemployed, Young, and Older Adults in Sharper Focus: Results from the Program for the International Assessment of Adult Competencies (PIAAC) 2012/2014. Washington, DC: National Center for Education Statistics, U.S. Department of Education; 2016. . Contract No.: NCES 2016–039
• 68 Ancker JS, Weber EU, Kukafka R. Effects of game-like interactive graphics on risk perceptions and decisions. Med Decis Making 2011; 31 (01) 130-142
• 69 Greengold NL, Shane R, Schneider P. , et al. The impact of dedicated medication nurses on the medication administration error rate: a randomized controlled trial. Arch Intern Med 2003; 163 (19) 2359-2367
• 70 Yin HS, Dreyer BP, van Schaick L, Foltin GL, Dinglas C, Mendelsohn AL. Randomized controlled trial of a pictogram-based intervention to reduce liquid medication dosing errors and improve adherence among caregivers of young children. Arch Pediatr Adolesc Med 2008; 162 (09) 814-822