Development and Evaluation of Clinical Decision Support for Immigrant Child Health Screening in Primary Care

Abstract

Background

While electronic health record (EHR)-based tools for refugee health screening exist, support for other immigrant children has lagged. Reasons include lack of time, difficulty determining screening eligibility, and lack of awareness of screening recommendations. EHR-based tools to promote immigrant child health screening (ICHS) can address these challenges, but guidance is needed for tools that are usable by clinicians and acceptable to immigrant families.

Objectives

Develop useful EHR-based tools to support ICHS while incorporating evaluation of acceptability, usability, and implementation effort.

Methods

We followed a five-step human-centered design approach to develop EHR-based tools for ICHS. This included: (1) representative users completing semi-structured interviews. (2) Health professionals and community advisory groups providing ongoing guidance. (3) Developing a functional prototype. (4) Usability testing of the prototype. And (5) an assessment of the implementation effort involving a second site installation coupled with expert implementation time estimations.

Results

Sixteen interviewees discussed screening barriers and how EHR-based tools could support discussing nativity (country of birth). From the interview findings and in consultation with advisory group members, we developed an EHR-based toolkit including noninterruptive alerts, an order set, and a documentation prompt. Ten clinicians completed usability testing. All recognized the alert and asked country of birth. Most (9) were satisfied with the system. All felt it was easy to use, helpful, and would not hinder patient care. Content experts (n = 8) estimated installation times (range: 4–20 hours, median 10) with high levels of confidence (range: 1–5, median 4). A second-site test installation required 7.25 hours.

Conclusion

Our EHR-based tools designed with the guidance of experts were highly rated on usability and can help clinicians identify patients eligible for ICHS in a sensitive manner. Installation testing demonstrated that this content could be implemented in a reasonable timeframe at external sites.

Keywords

immigrant child health - healthcare informatics - usability testing - clinical decision support

Protection of Human and Animal Subjects

The study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects and was reviewed by Children's Hospital of Philadelphia Institutional Review Board

Publikationsverlauf

Eingereicht: 11. Januar 2025

Angenommen: 24. April 2025

Accepted Manuscript online:
28. April 2025

Artikel online veröffentlicht:
29. August 2025

• References

• 1 Department of Homeland Security. Yearbook of Immigration Statistics, 2015–2017. Washington, DC: Department of Homeland Security, Office of Immigration Statistics. Accessed February 3, 2019 at: http://www.dhs.gov/files/statistics/publications/yearbook.shtm
• 2 Children of Immigrants Data Tool,. American Community Survey [database on the Internet]. 2022
• 3 Wasley A, Kruszon-Moran D, Kuhnert W. et al. The prevalence of hepatitis B virus infection in the United States in the era of vaccination. J Infect Dis 2010; 202 (02) 192-201
• 4 Ugwu C, Varkey P, Bagniewski S, Lesnick T. Sero-epidemiology of hepatitis B among new refugees to Minnesota. J Immigr Minor Health 2008; 10 (05) 469-474
• 5 Rossi C, Shrier I, Marshall L. et al. Seroprevalence of chronic hepatitis B virus infection and prior immunity in immigrants and refugees: a systematic review and meta-analysis. PLoS One 2012; 7 (09) e44611
• 6 Ott JJ, Stevens GA, Groeger J, Wiersma ST. Global epidemiology of hepatitis B virus infection: new estimates of age-specific HBsAg seroprevalence and endemicity. Vaccine 2012; 30 (12) 2212-2219
• 7 Schmit KM, Wansaula Z, Pratt R, Price SF, Langer AJ. Tuberculosis - United States, 2016. MMWR Morb Mortal Wkly Rep 2017; 66 (11) 289-294
• 8 Davidow AL, Katz D, Ghosh S. et al; Tuberculosis Epidemiologic Studies Consortium. Preventing infectious pulmonary tuberculosis among foreign-born residents of the United States. Am J Public Health 2015; 105 (09) e81-e88
• 9 Swaminathan S, Rekha B. Pediatric tuberculosis: global overview and challenges. Clin Infect Dis 2010; 50 (Suppl. 03) S184-S194
• 10 Unicef. Towards an AIDS-free generation: Children and AIDS: Sixth Stocktaking Report, 2013. United Nations Children's Fund, UNICEF; 2013
• 11 Berti E, Thorne C, Noguera-Julian A. et al. The new face of the pediatric HIV epidemic in Western countries: demographic characteristics, morbidity and mortality of the pediatric HIV-infected population. Pediatr Infect Dis J 2015; 34 (5, suppl 1): S7-S13
• 12 Singer PM, Noppert GA, Jenkins CH. Gaps in federal and state screening of tuberculosis in the United States. Am J Public Health 2017; 107 (11) 1750-1752
• 13 Cohen C, Holmberg SD, McMahon BJ. et al. Is chronic hepatitis B being undertreated in the United States?. J Viral Hepat 2011; 18 (06) 377-383
• 14 Mitchell AE, Colvin HM, Palmer Beasley R. Institute of Medicine recommendations for the prevention and control of hepatitis B and C. Hepatology 2010; 51 (03) 729-733
• 15 Alvarez-del Arco D, Monge S, Azcoaga A. et al. HIV testing and counselling for migrant populations living in high-income countries: a systematic review. Eur J Public Health 2013; 23 (06) 1039-1045
• 16 Mukolo A, Villegas R, Aliyu M, Wallston KA. Predictors of late presentation for HIV diagnosis: a literature review and suggested way forward. AIDS Behav 2013; 17 (01) 5-30
• 17 Wright A, Sittig DF, Ash JS, Sharma S, Pang JE, Middleton B. Clinical decision support capabilities of commercially-available clinical information systems. J Am Med Inform Assoc 2009; 16 (05) 637-644
• 18 Lee D, Philen R, Wang Z. et al; Centers for Disease Control and Prevention. Disease surveillance among newly arriving refugees and immigrants–electronic disease notification system, United States, 2009. MMWR Surveill Summ 2013; 62 (07) 1-20
• 19 Levison J, Triant V, Losina E, Keefe K, Freedberg K, Regan S. Development and validation of a computer-based algorithm to identify foreign-born patients with HIV infection from the electronic medical record. Appl Clin Inform 2014; 5 (02) 557-570
• 20 U.S. Department of Homeland Security. Uniting for Ukraine. 2020 . Accessed September 9, 2024 at: https://www.dhs.gov/ukraine
• 21 Meneses C, Chilton L, Duffee J. et al. Immigrant Child Health Toolkit. Accessed June 4, 2017 at https://www.aap.org/en-us/advocacy-and-policy/aap-health-initiatives/immigrant-child-health-toolkit/pages/immigrant-child-health-toolkit.aspx
• 22 Sisk B, Green A, Chan K, Yun K. Caring for children in immigrant families: are United States pediatricians prepared?. Acad Pediatr 2020; 20 (03) 391-398
• 23 Fang JL, Sorita A, Carey WA, Colby CE, Murad MH, Alahdab F. Interventions to prevent retinopathy of prematurity: a meta-analysis. Pediatrics 2016; 137 (04) e20153387
• 24 Hsu L, Bowlus CL, Stewart SL. et al. Electronic messages increase hepatitis B screening in at-risk Asian American patients: a randomized, controlled trial. Dig Dis Sci 2013; 58 (03) 807-814
• 25 Sirajuddin AM, Osheroff JA, Sittig DF, Chuo J, Velasco F, Collins DA. Implementation pearls from a new guidebook on improving medication use and outcomes with clinical decision support. Effective CDS is essential for addressing healthcare performance improvement imperatives. J Healthc Inf Manag 2009; 23 (04) 38-45
• 26 Campbell EM, Guappone KP, Sittig DF, Dykstra RH, Ash JS. Computerized provider order entry adoption: implications for clinical workflow. J Gen Intern Med 2009; 24 (01) 21-26
• 27 Damiani G, Pinnarelli L, Colosimo SC. et al. The effectiveness of computerized clinical guidelines in the process of care: a systematic review. BMC Health Serv Res 2010; 10: 2
• 28 Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005; 330 (7494) 765
• 29 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010; 19 (Suppl. 03) i68-i74
• 30 Shiffman RN, Michel G, Essaihi A, Thornquist E. Bridging the guideline implementation gap: a systematic, document-centered approach to guideline implementation. J Am Med Inform Assoc 2004; 11 (05) 418-426
• 31 Ratwani RM, Fairbanks RJ, Hettinger AZ, Benda NC. Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors. J Am Med Inform Assoc 2015; 22 (06) 1179-1182
• 32 Brunner J, Chuang E, Goldzweig C, Cain CL, Sugar C, Yano EM. United Nations Children's Fund. User-centered design to improve clinical decision support in primary care. Int J Med Inform 2017; 104: 56-64
• 33 International Organization for Standardization (ISO). Ergonomics of Human-System Interaction - Part 210: Human-centered design for interactive systems (ISO Standard No. 9241–210:2019). . 2019
• 34 Harris PA, Taylor R, Minor BL. et al; REDCap Consortium. The REDCap consortium: building an international community of software platform partners. J Biomed Inform 2019; 95: 103208
• 35 Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009; 42 (02) 377-381
• 36 Carayon P. Handbook of human factors and ergonomics in health care and patient safety. Boca Raton, FL: CRC Press; 2016
• 37 Holden RJ, Carayon P, Gurses AP. et al. SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients. Ergonomics 2013; 56 (11) 1669-1686
• 38 Hamilton AB, Finley EP. Qualitative methods in implementation research: an introduction. Psychiatry Res 2019; 280: 112516
• 39 St George SM, Harkness AR, Rodriguez-Diaz CE, Weinstein ER, Pavia V, Hamilton AB. Applying rapid qualitative analysis for health equity: lessons learned using “EARS” with Latino communities. Int J Qual Methods 2023; 22: 22
• 40 Kushniruk AW, Patel VL, Cimino JJ. , Eds. Usability testing in medical informatics: Cognitive approaches to evaluation of information systems and user interfaces. Proceedings of the AMIA annual fall symposium; 1997 : American Medical Informatics Association
• 41 Kushniruk A, Nohr C, Jensen S, Borycki EM. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group. From usability testing to clinical simulations: bringing context into the design and evaluation of usable and safe health information technologies. Contribution of the IMIA human factors engineering for healthcare informatics working group. Yearb Med Inform 2013; 8 (01) 78-85
• 42 Jaspers MW. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int J Med Inform 2009; 78 (05) 340-353
• 43 Arenas Villafranca JJ, Gómez Sánchez A, Nieto Guindo M, Faus Felipe V. Using failure mode and effects analysis to improve the safety of neonatal parenteral nutrition. Am J Health Syst Pharm 2014; 71 (14) 1210-1218
• 44 Holden RJ, Karsh BT. The technology acceptance model: its past and its future in health care. J Biomed Inform 2010; 43 (01) 159-172
• 45 Rasulo R, Matadi A, Dousa I. et al. Ask Where: Communication Guidance for Clinicians Implementing Immigrant Child Health Screening in Primary Care. Refugee Health Program, Children's Hospital of Philadelphia. Accessed 2023 at: https://www.health.state.mn.us/communities/rih/coe/askwhere.pdf
• 46 Minnesota Department of Health and the Minnesota Center for Excellence in Newcomer Health. CareRef Clinical Assessment for Refugees. Minnesota Department of Health; 2024 . Accessed September 27, 2024 at: https://careref.web.health.state.mn.us/
• 47 Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R. with the HITEC Investigators. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak 2017; 17 (01) 36
• 48 Basil NN, Ambe S, Ekhator C, Fonkem E. Health records database and inherent security concerns: a review of the literature. Cureus 2022; 14 (10) e30168
• 49 Kruse CS, Kristof C, Jones B, Mitchell E, Martinez A. Barriers to electronic health record adoption: a systematic literature review. J Med Syst 2016; 40 (12) 252
• 50 Campos-Castillo C, Anthony DL. The double-edged sword of electronic health records: implications for patient disclosure. J Am Med Inform Assoc 2015; 22 (e1): e130-e140
• 51 Systems E. Patient Demographics Setup and Support Guide. Verona, WI: Epic Systems Corporation; 2024
• 52 DeSilva MB, Kodet A, Walker PF. A best practice alert for identifying hepatitis B-infected patients. Am J Trop Med Hyg 2020; 103 (02) 884-886
• 53 Ancker JS, Kern LM, Edwards A. et al; HITEC Investigators. How is the electronic health record being used? Use of EHR data to assess physician-level variability in technology use. J Am Med Inform Assoc 2014; 21 (06) 1001-1008
• 54 Overhage JM, Qeadan F, Choi EHE, Vos D, Kroth PJ. Explaining variability in electronic health record effort in primary care ambulatory encounters. Appl Clin Inform 2024; 15 (02) 212-219