EUVIMEDDécouvrir EUVIMED
Open access

Evaluation of an Artificial Intelligence Conversational Chatbot to Enhance HIV Preexposure Prophylaxis Uptake: Development and Usability Internal Testing

Jun Tao, Ellie Pavlick, Amaris Grondin, Josue D Bustamante, Harrison Martin, Hannah Parent, Natalie Fenn, Alexi Almonte, Amanda Maguire-Wilkerson, Mofan Gu, Jack Rusley, Bryce K Perler and 3 more

Journal of Medical Internet Research · 2026-02-03 · 28 · e79671-e79671

DOI: 10.2196/79671 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2026-02-03. Written by Jun Tao and 14 co-authors. Institution: Department of Medicine, The Warren Alpert Medical School of Brown University, Room 130, 11 4th Street, Providence, RI, 02906, United States, 1 401-86…. Major MEDLINE topics: HIV Infections, Artificial Intelligence, Pre-Exposure Prophylaxis. Cited 9 times so far (Crossref); 61 references. The full text is freely available in PubMed Central. Funded by: NIAID NIH HHS, NIMH NIH HHS.

RésuméSubjectsRéférences bibliographiquesCiteRelated studies

Abstract (original language)

Background

The HIV epidemic in the United States disproportionately impacts gay, bisexual, and other men who have sex with men (MSM). Despite the effectiveness of HIV preexposure prophylaxis (PrEP) in preventing HIV acquisition, uptake among MSM remains suboptimal. Motivational interviewing (MI) has demonstrated efficacy at increasing PrEP uptake among MSM but is resource-intensive, limiting scalability. The use of artificial intelligence, particularly large language models with conversational agents (ie, “chatbots”) such as ChatGPT, may offer a scalable approach to delivering MI-based counseling for PrEP and HIV prevention.

Objective

This internal usability testing aimed to evaluate the development of an artificial intelligence–based chatbot, including its ability to provide MI-aligned education about PrEP and HIV prevention and potential to support PrEP uptake.

Methods

The Chatbot for HIV Prevention and Action (CHIA) was built on a GPT-4o base model embedded with a validated knowledge database on HIV and PrEP in English and Spanish. The CHIA was fine-tuned through training on a large MI dataset and prompt engineering. The use of the AutoGen multiagent framework enabled the CHIA to integrate 2 agents, the PrEP Counselor Agent and the Assistant Agent, which specialized in providing MI-based counseling and handling function calls (eg, assessment of HIV risk), respectively. During internal testing from March 10-April 28, 2025, we systematically evaluated the CHIA’s performance in English and Spanish using a set of 5-point Likert scales to measure accuracy, conciseness, up-to-dateness, trustworthiness, and alignment with aspects of the MI spirit (eg, collaboration, autonomy support) and MI-consistent behaviors (eg, affirmation, open-ended questions). Descriptive statistics and mixed linear regression were used to analyze the data.

Results

A total of 296 responses, including 145 English responses and 151 Spanish responses, were collected during the internal testing period. Overall, the CHIA demonstrated strong performance across both languages, receiving the highest combined scores in the general response quality metrics including up-to-dateness (mean 4.6, SD 0.8), trustworthiness (mean 4.5, SD 0.9), accuracy (mean 4.4, SD 0.9), and conciseness (mean 4.2, SD 1.1). The CHIA generally received higher combined scores for metrics that assessed alignment with the MI spirit (ie, empathy, evocation, autonomy support, and collaboration) and lower combined scores for MI-consistent behaviors (ie, affirmation, open-ended questions, and reflections). Spanish responses had significantly lower mean scores than English responses across nearly all MI-based metrics.

Conclusions

Our internal usability testing highlights the potential of the CHIA as a viable tool for delivering MI-aligned counseling in English and Spanish to promote HIV prevention and support PrEP uptake, though its Spanish language performance requires further improvement.

Subjects

MeSH terms (MEDLINE)

HIV InfectionsArtificial IntelligencePre-Exposure ProphylaxisHumansMaleMotivational InterviewingHomosexuality, MaleGenerative Artificial Intelligence

Author keywords

HIV infectionsartificial intelligencecounselingmotivational interviewingmultiagent frameworkpreexposure prophylaxis

Authors and institutions

  • Department of Medicine, The Warren Alpert Medical School of Brown University, Room 130, 11 4th Street, Providence, RI, 02906, United States, 1 401-863-1000.
  • Department of Computer Science, Brown University, Providence, RI, United States.
  • School of Electrical Engineering and Computer Science, College of Engineering, Oregon State University, Corvallis, OR, United States.
  • Department of Psychiatry and Human Behavior, The Warren Alpert Medical School of Brown University, Providence, RI, United States.
  • Division of Infectious Diseases, The Miriam Hospital, Providence, RI, United States.
  • Department of Health Services, Policy, and Practice, Brown University School of Public Health, Providence, RI, United States.

Funding

  • NIAID NIH HHS
  • NIMH NIH HHS

Cite

APA

Tao, J., Pavlick, E., Grondin, A., Bustamante, J. D., Martin, H., Parent, H., Fenn, N., Almonte, A., Maguire-Wilkerson, A., Gu, M., Rusley, J., Perler, B. K., Wray, T., Nunn, A. S., & Chan, P. A. (2026). Evaluation of an Artificial Intelligence Conversational Chatbot to Enhance HIV Preexposure Prophylaxis Uptake: Development and Usability Internal Testing. Journal of Medical Internet Research, 28, e79671-e79671. https://doi.org/10.2196/79671

Vancouver

Tao J, Pavlick E, Grondin A, Bustamante JD, Martin H, Parent H, et al. Evaluation of an Artificial Intelligence Conversational Chatbot to Enhance HIV Preexposure Prophylaxis Uptake: Development and Usability Internal Testing. Journal of Medical Internet Research. 2026;28:e79671-e79671. doi:10.2196/79671

BibTeX
@article{Tao2026,
  author = {Tao, Jun and Pavlick, Ellie and Grondin, Amaris and Bustamante, Josue D and Martin, Harrison and Parent, Hannah and Fenn, Natalie and Almonte, Alexi and Maguire-Wilkerson, Amanda and Gu, Mofan and Rusley, Jack and Perler, Bryce K and Wray, Tyler and Nunn, Amy S and Chan, Philip A},
  title = {Evaluation of an Artificial Intelligence Conversational Chatbot to Enhance HIV Preexposure Prophylaxis Uptake: Development and Usability Internal Testing},
  journal = {Journal of Medical Internet Research},
  year = {2026},
  volume = {28},
  pages = {e79671--e79671},
  doi = {10.2196/79671}
}
Start for free →