Are We There Yet? Human Factors Knowledge and Health Information Technology – the Challenges of Implementation and Impact
11 September 2017 (online)
Objective: To review the developments in human factors (HF) research on the challenges of health information technology (HIT) implementation and impact given the continuing incidence of usability problems and unintended consequences from HIT development and use.
Methods: A search of PubMed/Medline and Web of Science® identified HF research published in 2015 and 2016. Electronic health records (EHRs) and patient-centred HIT emerged as significant foci of recent HF research. The authors selected prominent papers highlighting ongoing HF and usability challenges in these areas. This selective rather than systematic review of recent HF research highlights these key challenges and reflects on their implications on the future impact of HF research on HIT.
Results: Research provides evidence of continued poor design, implementation, and usability of HIT, as well as technology-induced errors and unintended consequences. The paper highlights support for: (i) strengthening the evidence base on the benefits of HF approaches; (ii) improving knowledge translation in the implementation of HF approaches during HIT design, implementation, and evaluation; (iii) increasing transparency, governance, and enforcement of HF best practices at all stages of the HIT system development life cycle.
Discussion and Conclusion: HF and usability approaches are yet to become embedded as integral components of HIT development, implementation, and impact assessment. As HIT becomes ever-more pervasive including with patients as end-users, there is a need to expand our conceptualisation of the problems to be addressed and the suite of tactics and strategies to be used to calibrate our pro-active involvement in its improvement.
- 1 Park HA. Are We Ready for the Fourth Industrial Revolution?. Yearb Med Inform 2016; 1-3.
- 2 Sankar PL, Parker LS. The Precision Medicine Initiative’s All of Us Research Program: an agenda for research on its ethical, legal, and social issues. Genet Medicine. 2016 Dec 8..
- 3 Coiera E, Ash J, Berg M. The Unintended Consequences of Health Information Technology Revisited. Yearb Med Inform 2016; 163-9.
- 4 Yardley L, Choudhury T, Patirck K, Michie S. Current Issues and Future Directions for Research Into Digital Behavior Change Interventions. Am J Prev Med 2016; 51 (05) 814-5.
- 5 Chapanis A, Safrin MA. Of misses and medicines. J Chronic Dis 1960; 12 (04) 403-8.
- 6 Weizenbaum J. Computer Power and Human Reason: From Judgment to Calculation. W.H. Freeman and Co; 1976
- 7 Perrow C. Normal Accidents: Living With High Risk Technologies. Basic Books; 1984
- 8 Burnum JF. The misinformation era: the fall of the medical record. Ann Intern Med 1989; Mar 15: 110 (06) 482-4.
- 9 Klatzky RL, Kober N, Mavor A. editors. Safe, Comfortable, Attractive, and Easy to Use: Improving the Usability of Home Medical Devices. National Research Council (US) Committee on Human Factors; 1996
- 10 Berg M. Medical work and the computer-based patient record: a sociological perspective. Methods Inf Med 1998; 37: 294-301.
- 11 Carayon P, Kianfar S, Li YQ, Xie AP, Alyousef B, Wooldridge A. A systematic review of mixed methods research on human factors and ergonomics in health care. Appl Ergon 2015; 51: 291-321.
- 12 Meeks DW, Smith MW, Taylor L, Sittig DF, Scott JM, Singh H. An analysis of electronic health record-related patient safety concerns. J Am Med Inform Assoc 2014; Nov-Dec; 21 (06) 1053-9.
- 13 Ammenwerth E. Evidence-based Health Informatics: How Do We Know What We Know?. Methods Inf Med 2015; 54 (04) 298-307.
- 14 Kannampallil TG, Schauer GF, Cohen T, Patel VL. Considering complexity in healthcare systems. J Biomed Inform 2011; Dec; 44 (06) 943-7.
- 15 Sawyer S, Jarrahi M. Sociotechnical approaches to the study of information systems. In Tucker A. editors: Computing Handbook: Information Systems and Information Technology. 3rd ed.. V2 CRC Boca Raton, FL: Chapman and Hall; 2014
- 16 Kaplan B. Evaluation of People, Social, and Organizational Issues - Sociotechnical Ethnographic Evaluation Evidence-Based Health Informatics. Ammenwerth E, Rigby M. editors IOS Press; 2016
- 17 Berg M, Langenberg C, Berg IVD, Kwakkernaat J. Considerations for sociotechnical design: experiences with an electronic patient record in a clinical context. Int J Med Inform 1998; 52: 243-51.
- 18 Berg M. Patient care information systems and health care work: a sociotechnical approach. Int J Med Inform 1999; 55: 87-101.
- 19 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010; Oct 19 (Suppl 3): i68-74.
- 20 Brown CL, Mulcaster HL, Triffitt KL, Sittig DF, Ash JS, Reygate K. et al. A systematic review of the types and causes of prescribing errors generated from using computerized provider order entry systems in primary and secondary care. J Am Med Inform Assoc 2017; Mar 1; 24 (02) 432-40.
- 21 Gephart S, Carrington JM, Finley BA. Systematic Review of Nurses’ Experiences With Unintended Consequences When Using the Electronic Health Record. Nurs Adm Q 2015; Oct-Dec; 39 (04) 345-56.
- 22 Ratwani RM, Fairbanks RJ, Hettinger AZ, Benda N. Electronic Health Record Usability: Analysis of the User Centered Design Processes of Eleven Electronic Health Record Vendors. J Am Med Inform Assoc 2015; November 11; 22 (06) 1179-82.
- 23 McCray AT, Glaser J, Koppel R, Langlotz CP, Silverstein J. Health IT vendors and the academic community: The 2014 ACMI debate. J Biomed Inform 2016; Apr; 60: 365-75.
- 24 Koppel R, Lehmann CU. Implications of an emerging EHR monoculture for hospitals and healthcare systems. J Am Med Inform Assoc 2015; Mar; 22 (02) 465-71.
- 25 Sinsky CA, Hess J, Karsh B, Keller JP, Koppel R. Comparative user experiences of health IT products: how user experiences would be reported and used. Institute of Medicine; 2012
- 26 Miliard M. Frustrations linger around electronic health records and user-centered design. Mar 10, 2016 http://www.healthcareitnews.com/news/frustrations-linger-around-electronic-health-records-and-user-centered-design.
- 27 McCann E. How satisfied are you with your EHR?. 2015 Satisfaction Survey results. Sept 18, 2015 http://www.healthcareitnews.com/ news/2015-ehr-satisfaction-survey.
- 28 Off ice of the National Coordinator. Safer guides will help optimize safety. Jan 14, 2014 https://www.healthit.gov/buzzblog/electron-ic-health-and-medical-records/safer-guides-optimize-safety/.
- 29 Shanafelt TD, Hasan O, Dyrbye LN, Sinsky C, Satele D, Sloan J. et al. Changes in Burnout and Satisfaction With Work-Life Balance in Physicians and the General US Working Population Between 2011 and 2014. Mayo Clin Proc December 2015; 90 (12) 1600-13.
- 30 Wildenbos GA, Peute LW, Jaspers MWM. Impact of Patient-centered eHealth Applications on Patient Outcomes: A Review on the Mediating Influence of Human Factor Issues. Yearb Med Inform 2016; 113-9.
- 31 Baysari MT, Westbrook J. Mobile Applications for Patient-centered Care Coordination: A Review of Human Factors Methods Applied to their Design, Development, and Evaluation. Yearb Med Inform 2015; 10: 47-54.
- 32 Purkayastha S, Price A, Biswas R, Jai AUGanesh, Otero P. From Dyadic Ties to Information Infrastructures: Care-Coordination between Patients, Providers, Students and Researchers Contribution of the Health Informatics Education Working Group. Yearb Med Inform 2015; 10: 68-74.
- 33 Sawesi S, Rashrash M, Phalakornkule K, Carpenter JS, Jones JF. The Impact of Information Technology on Patient Engagement and Health Behavior Change: A Systematic Review of the Literature. JMIR Med Inform 2016; Jan 21; 04 (01) e1.
- 34 International Ergonomics Association (IEA). Defnition & Domains of Ergonomics. http://www.iea.cc/whats/index.html.
- 35 Carayon P. Human Factors and ergonomics in healthcare and patient safety. In; Carayon P. 2011
- 36 Patel VL, Kannampallil TG. Human factors and health information technology: current challenges and future directions. Yearb Med Inform 2014; 58-66.
- 37 Kushniruk A, Nohr C, Borycki E. Human Factors for more usable and safer information technology: where are we now and Where do we go from here?. Yearb Med Inform 2016; Nov 10: 120-5.
- 38 Beuscart-Zephir MC, Elkin P, Pelayo S, Beuscart R. The Human Factors Engineering Approach to biomedical Informatics projects: State of the Art, Results, Benefits and Challenges. Yearb Med Inform 2007; 109-27.
- 39 Beuscart-Zephir MC, Borycki E, Jaspers MWM, Pelayo S. Evolution of Human Factors research and Studies of Health Information Technologies: The role of patient Safety. Yearb Med Inform 2013; 67-77.
- 40 Ratwani RM, Fairbanks T, Savage E, Adams K, Wittie M, Boone E. et al. Mind the Gap: A systematic review to identify usability and safety challenges and practices during electronic health record implementation. Appl Clin Inform 2016; Nov 16; 07 (04) 1069-87.
- 41 Ratwani RM, Benda NC, Hettinger A, Fairbanks R. Electronic health record vendor adherence to usability certification requirements and testing standards. JAMA 2015; Sep 8; 314 (10) 1070-1.
- 42 Babbott S, Manwell LB, Brown R, Montague E, Williams E, Schwartz M. et al. Electronic medical records and physician stress in primary care: results from the MEMO Study. J Am Med Inform Assoc 2014; Feb;21 (e1): e100-106.
- 43 Friedman A, Crosson JC, Howard J, Clark EC, Pellerano M, Karsh BT. et al. A typology of electronic health record workarounds in small-to-medium size primary care practices. J Am Med Inform Assoc 2014; 21: e78-e83.
- 44 Graber ML, Siegal D, Riah H, Johnston D, Kenyon K. Electronic health record-related events in medical malpractice claims. J Patient Saf. 2015 Nov 6
- 45 Ellsworth MA, Dziadzko M, O’Horo JC, Farrell AM, Zhang J, Herasevich V. An appraisal of published usability evaluations of electronic health records via systematic review. J Am Med Inform Assoc 2017; Jan; 24 (01) 218-26.
- 46 Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K. et al. Understanding and Promoting Effective Engagement with Digital Behavior Change Interventions. Am J Prev Med 2016; Nov 51 (05) 833-42.
- 47 Kayser L, Kushniruk A, Osborne RH, Norgaard O, Turner P. Enhancing the Effectiveness of Consumer-Focused Health Information Technology Systems Through eHealth Literacy: A Framework for Understanding Users’ Needs. JMIR Hum Factors 2015; May 20, 02 (01) e9.
- 48 Ammenwerth E, Rigby M. editors. Evidence-Based Health Informatics - Promoting Safety Efficiency Through Scientific Methods Ethical Policy. 2016. Vol 222 Studies in Health Technology & Informatics..
- 49 Singh H, Sittig DF. Measuring and improving patient safety through health information technology: The Health IT Safety Framework. BMJ Qual Saf 2016; Apr; 25 (04) 226-32.
- 50 Koppel R. The health information technology safety framework: building great structures on vast voids. BMJ Qual Saf 2016; Apr; 25 (04) 218-20.
- 51 Coiera E. A New Informatics Geography, Yearb Med Inform. 2016; 251-5.
- 52 HIMSS EHR Usability Task Force. “Defining and Testing EMR Usability: Principles and Proposed Methods of EMR Usability Evaluation and Rating.”. June 2009
- 53 Riskin L, Koppel R, Riskin D. Re-examining health IT policy: what will it take to derive value from our investment?. J Am Med Inform Assoc 2015; Mar; 22 (02) 459-64.
- 54 Kellermann AL, Jones SS. What it will take to achieve the as-yet-unfulfilled promises of health information technology. Health Aff (Millwood) 2013; Jan 1; 32 (01) 63-8.
- 55 Medical Device Directive MDD93/42/EEC. http:// www.mdss.com/download/download_station.htm accessed December 21, 2016..
- 56 ONC Meaningful Use and Usability Testing. http:// www.healthcareusability.com/article/onc-meaningful-use-and-usabilitytesting accessed September 20, 2016..
- 57 Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM. et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc 2013; Jun 1; 20 (e1): e2-8.
- 58 Magrabi F, Baker M, Sinha I, Ong MS, Harrison S, Kidd MR. et al. Clinical safety of England’s national programme for IT: A retrospective analysis of all reported safety events 2005 to 2011. Int J Med Inform 2015; Mar; 84 (03) 198-206.
- 59 Magrabi F, Liaw ST, Arachi D, Runciman W, Coiera E, Kidd MR. Identifying patient safety problems associated with information technology in general practice: an analysis of incident reports. BMJ Qual Saf 2016; 25 (11) 870-80.
- 60 Marcilly R, Ammenwerth E, Roehrer E, Pelayo S, Vasseur F, Beuscart-Zéphir MC. Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System. Yearb Med Inform 2015; 55-67.
- 61 Schiff G, Amato M, Eguale T, Boehne JJ, Wright A, Koppel R. et al. Computerised physician order entry-related medication errors: analysis of reported errors and vulnerability testing of current systems. BMJ Qual Saf 2015; Apr; 24 (04) 264-71.
- 62 Castro GM, Buczkowski L, Hafner JM. The Contribution of Sociotechnical Factors to Health Information Technology-Related Sentinel Events. Jt Comm J Qual Patient Saf 2016; Feb; 42 (02) 70-6.
- 63 Brenner SK, Kaushal R, Grinspan Z, Joyce C, Kim I, Allard RJ. et al. Effects of health information technology on patient outcomes: a systematic review. J Am Med Inform Assoc 2016; Sep; 23 (05) 1016-36.
- 64 Guise V, Anderson J, Wiig S. Patient safety risks associated with telecare: a systematic review and narrative synthesis of the literature. BMC Health Serv Res 2014; Nov 25; 14: 588.
- 65 Matthew-Maich N, Harris L, Ploeg J, Markle-Reid M, Valaitis R, Ibrahim S. et al. Designing, Implementing, and Evaluating Mobile Health Technologies for Managing Chronic Conditions in Older Adults: A Scoping Review. JMIR mHealth & uHealth 2016; 04 (02) 164-81.
- 66 Zapata BC, Fernandez-Aleman JL, Idri A, Toval A. Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review. J Med Syst 2015; 39 (02) 1.
- 67 Queiros A, Silva A, Alvarelhao J, Rocha NP, Teixeira A. Usability, accessibility and ambient-assisted living: a systematic literature review. Universal Access in the Information Society 2015; 14 (01) SI57-66.
- 68 Sheikh A, Sood HS, Bates DW. Leveraging health information technology to achieve the “triple aim” of healthcare reform. J Am Med Inform Assoc 2015; Jul; 22 (04) 849-56.
- 69 National Patient Safety Foundation. Free from Harm: Accelerating Patient Safety Improvement Fifteen Years after To Err Is Human. Boston, MA: http://www.npsf.org/ 2015
- 70 Zhang J, Muhammad W. editors. Better EHR: Usability, Workflow and Cognitive Support in Electronic Health Records. National Center for Cognitive Informatics & Decision Making in Healthcare. 2014 https://sbmi.uth.edu/nccd/ better-ehr/.
- 71 National Institute of Standards and Technology Health IT Usability. http://www.nist.gov/healthcare/usability (Accessed January 5, 2017)
- 72 Agency for Healthcare Research and Quality, Developing Evidence-Based, User-Centered Design and Implementation Guidelines to Improve Health Information Technology Usability (Maryland). (Accessed January 5, 2017) https:// healthit.ahrq.gov/ahrq-funded-projects/develop-ing-evidence-based-user-centered-design-and-implementation-guidelines.
- 73 Office of the National Coordinator. Safer guides will help optimize safety. 2014 https://www. healthit.gov/safer/safer-guides (Accessed January 5, 2017)
- 74 Kaipio J, Lääveri T, Hyppönen H, Vainiomäki S, Reponen J, Kushniruk A. et al. Usability problems do not heal by themselves: National survey on physicians’ experiences with EHRs in Finland. Int J Med Inform 2017; Jan 97: 266-81.
- 75 Jensen S, Rasmussen SL, Lyng KM. Use of clinical simulation for assessment in EHR-procurement: design of method. Stud Health Technol Inform 2013; 192: 576-80.
- 76 Marcilly R, Peute L, Beuscart-Zephir MC. From Usability Engineering to Evidence-based Usability in Health IT. Stud Health Technol Inform 2016; 222: 126-38.
- 77 Lyon AR, Lewis CC, Melvin A, Boyd M, Nicodimos S, Liu FF. et al. Health Information Technologies—Academic and Commercial Evaluation (HIT-ACE) methodology: description and application to clinical feedback systems. Implement Sci 2016; Sep 22; 11 (01) 128.
- 78 Australian Commission on Safety and Quality in Health Care (ACSQHC). National Guidelines for On-Screen Display of Clinical Medicines Information, Sydney, New South Wales, Commonwealth of Australia. 2016 http://www.safetyandquality.gov.au/ our-work/medication-safety/electronic-medication-management-systems/.
- 79 Kushniruk AW, Borycki EM. Low-cost rapid usability testing: Its application in both product development and system implementation. Stud Health Technol Inform 2017; 234: 195-200.
- 80 Martin SA, Sinsky CA. The map is not the territory: medical records and 21st century practice. Lancet 2016; Oct 22; 388 (10055): 2053-6.