Subscribe to RSS
DOI: 10.1055/a-2786-0291
Optimizing HIV Care Engagement: Usability of a mHealth App for Identifying and Retaining Individuals with Nonviral Suppression in Digital Cohort
Authors
Funding Information Research reported in this study was funded by the National Institute of Allergy and Infectious Diseases through grant number: UG3 AI176566. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the National Institute of Allergy and Infectious Diseases.
Abstract
Background
Drive to Zero is a mobile health application (app) designed to identify and retain people with HIV (PWH) who have experienced challenges with achieving or maintaining viral suppression. The app targets PWH who have lacked documented HIV care in the past months and are experiencing medication adherence barriers. Features include an interactive chat for communicating with the study team and access to educational resources to support care engagement and health management.
Objectives
This usability study aimed to assess the Drive to Zero app's ease of use and interface design through expert heuristic evaluation and end-user testing.
Methods
Usability was evaluated through two approaches: heuristic evaluations conducted by five informatics experts following Nielsen's usability principles, and end-user testing with 20 PWH using the validated Post-Study System Usability Questionnaire and qualitative interviews to collect feedback on app functionality and user experience.
Results
Heuristic experts and end-users demonstrated satisfaction with the app's appearance, reporting that it has a simple and intuitive interface for identifying and retaining PWH, which will assist them with study engagement and ultimately reengage with HIV care. However, participants highlighted areas needing improvement, suggesting better accessibility of “home” and “help” buttons to improve user control and a more detailed explanation of the incentive program to enhance user engagement and retention.
Conclusion
Usability evaluations provided valuable insights into the Drive to Zero app's design. Areas for improvement were enhancing user controls and improving the readability of the incentive program. These findings will guide iterative refinements, ensuring that future versions of the app improve the usability and acceptability of its target audience.
Keywords
HIV - consumer health informatics - human–computer interaction - interfaces and usability - smartphoneProtection of Human and Animal Subjects
This study was approved by the Institutional Review Board. Informed verbal consent was obtained from interview participants who were notified of their right to refuse to participate and the study team's procedures for deidentifying data.
Data Availability Statement
The data underlying this article will be shared on reasonable request to the corresponding author.
Publication History
Received: 05 August 2025
Accepted: 11 January 2026
Article published online:
30 January 2026
© 2026. Thieme. All rights reserved.
Georg Thieme Verlag KG
Oswald-Hesse-Straße 50, 70469 Stuttgart, Germany
-
References
- 1 Gant Z, Dailey A, Wang S. et al. Trends in HIV care outcomes among adults and adolescents in the U.S. South, 2015-2019. Ann Epidemiol 2022; 71: 15-22
- 2 Bassler JR, Ostrenga L, Levitan EB. et al. Redlining and time to viral suppression among persons with HIV. JAMA Intern Med 2024; 184 (11) 1329-1337
- 3 Dos Santos FC, Batey DS, Kay ES. et al. The effect of a combined mHealth and community health worker intervention on HIV self-management. J Am Med Inform Assoc 2025; 32 (03) 510-517
- 4 Centers for Disease Control and Prevention. Estimated HIV Incidence and Prevalence in the United States, 2018–2022. HIV Surveillance Supplemental Report; 2024. Accessed at: https://www.cdc.gov/hiv-data/nhss/estimated-hiv-incidence-and-prevalence.html
- 5 Dombrowski JC, Baeten JM. It's time to make the time to viral suppression after HIV diagnosis a metric of HIV care success. J Infect Dis 2019; 219 (06) 845-847
- 6 National Center for HIV/AIDS. Viral Hepatitis, STD, and TB Prevention Division of HIV/AIDS Prevention. Diagnoses of HIV Infection in the United States and Dependent Areas; 2016. Accessed at: https://stacks.cdc.gov/view/cdc/50233
- 7 The White House. National HIV/AIDS Strategy Federal Implementation Plan; 2022. Accessed at: https://files.hiv.gov/s3fs-public/2022-09/NHAS_Federal_Implementation_Plan.pdf
- 8 McCurdie T, Taneva S, Casselman M. et al. mHealth consumer apps: the case for user-centered design. Biomed Instrum Technol 2012; 46 (suppl): 49-56
- 9 Chang IC, Hwang HG, Hung WF, Li YC. Physicians' acceptance of pharmacokinetics-based clinical decision support systems. Expert Syst Appl 2007; 33 (02) 296-303
- 10 Dos Santos FC, Brin M, Tanner MR, Galindo CA, Schnall R. The mChoice app, an mHealth tool for the monitoring of preexposure prophylaxis adherence and sexual behaviors in young men who have sex with men: usability evaluation. JMIR Hum Factors 2025; 12: e59780-e59780
- 11 Adedoja D, Kuhns LM, Radix A, Garofalo R, Brin M, Schnall R. MyPEEPS mobile app for HIV prevention among transmasculine youth: adaptation through community-based feedback and usability evaluation. JMIR Form Res 2024; 8: e56561
- 12 Li Y, Li J, Li M. et al. VaxBot-HPV: a GPT-based chatbot for answering HPV vaccine-related questions. JAMIA Open 2025; 8 (01) ooaf005
- 13 Romero S, Alvarez KS, Nijhawan AE, Nethi A, Bistransin K, King HL. Association of an HIV-prediction model with uptake of preexposure prophylaxis. Appl Clin Inform 2025; 16 (03) 507-515
- 14 Roveta A, Canonico M, Francese A. et al. Developing mobile apps to support clinical management of HIV patients: an observational study. Appl Clin Inform 2025; 16 (03) 544-555
- 15 Abran A, Khelifi A, Suryn W, Seffah A. Usability meanings and interpretations in ISO standards. Softw Qual J 2003; 11 (04) 325-338
- 16 Yen PY, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc 2012; 19 (03) 413-422
- 17 Jaspers MWM. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int J Med Inform 2009; 78 (05) 340-353
- 18 Bertini E, Gabrielli S, Kimani S. Appropriating and assessing heuristics for mobile computing. In: Proceedings of the Working Conference on Advanced Visual Interfaces. 2006.
- 19 Nielsen J, Molich R. Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; 1990: 249-256
- 20 Young R, Sage K, Broom D, Hext A, Snowdon N, Smith C. Evaluating the usability of a co-designed power assisted exercise graphical user interface for people with stroke. J Neuroeng Rehabil 2023; 20 (01) 95
- 21 Mendiola MF, Kalnicki M, Lindenauer S. Valuable features in mobile health apps for patients and consumers: content analysis of apps and user ratings. JMIR Mhealth Uhealth 2015; 3 (02) e40
- 22 Dos Santos FC, Garofalo R, Kuhns L, Scherr T, Schnall R. Evaluating the effectiveness of a mobile health intervention on enhancing HIV knowledge in sexual and gender minority men. J Acquir Immune Defic Syndr 2025; 33 (03) 448-451
- 23 Guo SHM, Lin JL, Hsing HC, Lee CC, Chuang SM. The effect of mobile eHealth education to improve knowledge, skills, self-care, and mobile eHealth literacies among patients with diabetes: development and evaluation study. J Med Internet Res 2023; 25: e42497
- 24 Rowland SP, Fitzgerald JE, Holme T, Powell J, McGregor A. What is the clinical value of mHealth for patients?. NPJ Digit Med 2020; 3 (01) 4
- 25 Tran S, Smith L, Carter S. Understanding patient perspectives on the use of gamification and incentives in mHealth apps to improve medication adherence: qualitative study. JMIR Mhealth Uhealth 2024; 12: e50851
- 26 Cotton V, Patel MS. Gamification use and design in popular health and fitness mobile applications. Am J Health Promot 2019; 33 (03) 448-451
- 27 Cho H, Yen PY, Dowding D, Merrill JA, Schnall R. A multi-level usability evaluation of mobile health applications: a case study. J Biomed Inform 2018; 86: 79-89
- 28 Schnall R, Higgins T, Brown W, Carballo-Dieguez A, Bakken S. Trust, perceived risk, perceived ease of use and perceived usefulness as factors related to mHealth technology use. Stud Health Technol Inform 2015; 216: 467-471
- 29 Khajouei R, Zahiri Esfahani M, Jahani Y. Comparison of heuristic and cognitive walkthrough usability evaluation methods for evaluating health information systems. J Am Med Inform Assoc 2017; 24 (e1): e55-e60
- 30 Khajouei R, Farahani F. A combination of two methods for evaluating the usability of a hospital information system. BMC Med Inform Decis Mak 2020; 20 (01) 84
- 31 Schnall R, Cho H, Liu J. Health information technology usability evaluation scale (Health-ITUES) for usability assessment of mobile health technology: validation study. JMIR Mhealth Uhealth 2018; 6 (01) e4
- 32 Alwashmi MF, Hawboldt J, Davis E, Fetters MD. The iterative convergent design for mobile health usability testing: mixed methods approach. JMIR Mhealth Uhealth 2019; 7 (04) e11656
