How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek
Frontiers in Public Health · 13.08.2026 · 14
DOI: 10.3389/fpubh.2026.1886493 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Frontiers in Public Health, online erschienen am 13.08.2026. Verfasst von Hui Huang und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Nursing, The Second Hospital of Nanjing, Nanjing, China. Hauptthemen laut MEDLINE: HIV Infections, Artificial Intelligence. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Artificial intelligence (AI) has garnered significant attention and, to some extent, has even replaced certain search engines as a popular channel for people across regions to access information. HIV/AIDS is a common topic among infectious diseases, and patients or high-risk groups frequently search for information online. Our study evaluated the accuracy of two AI models (ChatGPT-3.5 and DeepSeek-R1) in answering HIV/AIDS-related questions.
Methods
This was a cross-sectional analytical study comparing two advanced large language models representing Eastern and Western cultural backgrounds, respectively, with a gold standard (an infectious disease specialist). We compiled 26 common questions related to HIV/AIDS and categorized them into four themes (basic knowledge, diagnosis, treatment, and prevention). Three infectious disease experts independently scored the AI models’ responses on a 4-point scale for each answer. There was no statistically significant difference in the scores for HIV/AIDS-related questions between the two AI models: Z = −2.135, two-sided p -value = 0.451 ( p > 0.05). DeepSeek-R1 demonstrated higher accuracy, with 53.85% of its responses rated as “Excellent,” compared to 48.72% for ChatGPT-3.5; there was no significant difference in accuracy between the two AI models when answering HIV/AIDS-related questions ( χ 2 = 0.429, df = 1, p = 0.513). Both AI models achieved high average composite scores (DeepSeek-R1 = 3.50, ChatGPT-3.5 = 3.44, out of a maximum of 4 points). The AI models performed exceptionally well across all domains, though they were relatively weaker in the “Treatment” domain.
Conclusion
Our study has identified the potential of AI models, particularly ChatGPT-3.5 and DeepSeek-R1, to provide accurate and comprehensive responses to HIV/AIDS-related questions. As free online tools, they can provide personalized, useful medical information to diverse populations across regions. However, medical information generated by AI models should still be used under the supervision and review of healthcare professionals.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Nursing, The Second Hospital of Nanjing, Nanjing, China.
- School of Nursing, Nanjing University of Chinese Medicine, Nanjing, China.
- Department of Infectious Diseases, The Second Hospital of Nanjing, Nanjing, China.
- Department of Public Health, The Second Hospital of Nanjing, Nanjing, China.
Zitieren
APA
Huang, H., Zhang, H., Qin, X., Wu, Y., Yu, Q., Fang, M., Sun, B., Cheng, J., Song, Y., Shu, J., & Wang, L. (2026). How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek. Frontiers in Public Health, 14. https://doi.org/10.3389/fpubh.2026.1886493
Vancouver
Huang H, Zhang H, Qin X, Wu Y, Yu Q, Fang M, et al. How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek. Frontiers in Public Health. 2026;14. doi:10.3389/fpubh.2026.1886493
BibTeX
@article{Huang2026,
author = {Huang, Hui and Zhang, Huichao and Qin, Xinxin and Wu, Yuhan and Yu, Qi and Fang, Mingxia and Sun, Binghu and Cheng, Jian and Song, Yan and Shu, Junmei and Wang, Ling},
title = {How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek},
journal = {Frontiers in Public Health},
year = {2026},
volume = {14},
doi = {10.3389/fpubh.2026.1886493}
}
EUVIMED