EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation of AI Chatbot Responses to Simulated Caregiver Questions About Asymptomatic Bacteriuria

Emely Luhan, Rachael Lee, Angela Fagerlin, Valerie Vaughn, Julie Szymczak, William Petty, Farrah Madanay, Alistair Thorpe

Antimicrobial Stewardship & Healthcare Epidemiology · 2026-08 · 6 (S1) · s58-s58

DOI: 10.1017/ash.2026.10512 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Antimicrobial Stewardship & Healthcare Epidemiology, online erschienen am 23.06.2026. Verfasst von Emely Luhan und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence (AI) chatbots are increasingly used by patients and caregivers seeking quick, conversational answers to medical questions. This trend raises concerns about the clinical accuracy and appropriateness of responses, which can influence illness beliefs, treatment expectations, and care-seeking. These concerns are relevant for conditions like asymptomatic bacteriuria (ASB), which is often mistaken for urinary tract infection (UTI), leading to unnecessary antibiotic use. We examined how AI chatbots respond to simulated caregiver questions about ASB/UTIs.

Methods

We created two clinical scenarios of hypothetical medical advice questions involving a positive urinalysis without specific UTI symptoms (i.e., ASB) that asked explicitly whether the parent had a UTI (Table 1). Scenario A described only a positive test, whereas scenario B included a fever and malodorous urine. For each scenario, we varied the parents’ gender (mother vs. father) and age (68 vs. 84 years). The eight questions were entered into three publicly available AI chatbots (ChatGPT v5, Gemini v3, and Copilot v5) on December 15, 2025, using private sessions with no memory enabled. Two team members independently coded responses, with discrepancies resolved by two additional reviewers.

Results

Most responses endorsed the suggestion of UTI (22/24, 91.7%; Table 2). Responses frequently acknowledged alternative explanations for symptoms (17/24, 70.9%) and over half mentioned ASB (16/24, 66.7%). Antibiotics were mentioned in 8 responses (33.3%), with 6 of those noting potential harms. Most responses recommended seeking immediate care (19/24, 79.2%). Tone varied: 9 (37.5%) stressed urgency (e.g., “this is not something to wait on—he needs urgent medical evaluation.”), 5 (20.8%) were reassuring (e.g., “I hear your concern”), and 10 (41.7%) neutral. Only 7 responses (29.2%) provided citations. Responses varied between scenarios. For instance, antibiotic harms were given for scenario A but not scenario B. Within scenarios (Table 3), responses varied by chatbot (e.g., mentioning ASB [0/4; Gemini] vs. [2/4; ChatGPT] vs. [2/4; Copilot]), parent’s gender (e.g., antibiotics suggested [1/6; father] vs. [3/6; mother]); and age (e.g., alternative diagnoses suggested [4/6; 68 years] vs. [1/6; 84 years]).

Conclusions

In response to simulated caregiver medical advice requests about ASB, AI chatbots often endorsed the suggestion of UTI and inconsistently referenced ASB, with variability by platform and patient attributes. These patterns may reinforce misperceptions of ASB and promote antibiotic misuse in older adults. Monitoring and improvement of chatbot outputs, alongside patient-facing guidance on how to use and interpret responses, are needed to support guideline-aligned care.

Zitieren

APA

Luhan, E., Lee, R., Fagerlin, A., Vaughn, V., Szymczak, J., Petty, W., Madanay, F., & Thorpe, A. (2026). Evaluation of AI Chatbot Responses to Simulated Caregiver Questions About Asymptomatic Bacteriuria. Antimicrobial Stewardship & Healthcare Epidemiology, 6(S1), s58-s58. https://doi.org/10.1017/ash.2026.10512

Vancouver

Luhan E, Lee R, Fagerlin A, Vaughn V, Szymczak J, Petty W, et al. Evaluation of AI Chatbot Responses to Simulated Caregiver Questions About Asymptomatic Bacteriuria. Antimicrobial Stewardship & Healthcare Epidemiology. 2026;6(S1):s58-s58. doi:10.1017/ash.2026.10512

BibTeX
@article{Luhan2026,
  author = {Luhan, Emely and Lee, Rachael and Fagerlin, Angela and Vaughn, Valerie and Szymczak, Julie and Petty, William and Madanay, Farrah and Thorpe, Alistair},
  title = {Evaluation of AI Chatbot Responses to Simulated Caregiver Questions About Asymptomatic Bacteriuria},
  journal = {Antimicrobial Stewardship & Healthcare Epidemiology},
  year = {2026},
  volume = {6},
  number = {S1},
  pages = {s58--s58},
  doi = {10.1017/ash.2026.10512}
}
Kostenlos starten →