EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek

Hui Huang, Huichao Zhang, Xinxin Qin, Yuhan Wu, Qi Yu, Mingxia Fang, Binghu Sun, Jian Cheng, Yan Song, Junmei Shu, Ling Wang

Frontiers in Public Health · 13.08.2026 · 14

DOI: 10.3389/fpubh.2026.1886493 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Frontiers in Public Health, online erschienen am 13.08.2026. Verfasst von Hui Huang und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Nursing, The Second Hospital of Nanjing, Nanjing, China. Hauptthemen laut MEDLINE: HIV Infections, Artificial Intelligence. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence (AI) has garnered significant attention and, to some extent, has even replaced certain search engines as a popular channel for people across regions to access information. HIV/AIDS is a common topic among infectious diseases, and patients or high-risk groups frequently search for information online. Our study evaluated the accuracy of two AI models (ChatGPT-3.5 and DeepSeek-R1) in answering HIV/AIDS-related questions.

Methods

This was a cross-sectional analytical study comparing two advanced large language models representing Eastern and Western cultural backgrounds, respectively, with a gold standard (an infectious disease specialist). We compiled 26 common questions related to HIV/AIDS and categorized them into four themes (basic knowledge, diagnosis, treatment, and prevention). Three infectious disease experts independently scored the AI models’ responses on a 4-point scale for each answer. There was no statistically significant difference in the scores for HIV/AIDS-related questions between the two AI models: Z = −2.135, two-sided p -value = 0.451 ( p > 0.05). DeepSeek-R1 demonstrated higher accuracy, with 53.85% of its responses rated as “Excellent,” compared to 48.72% for ChatGPT-3.5; there was no significant difference in accuracy between the two AI models when answering HIV/AIDS-related questions ( χ 2 = 0.429, df = 1, p = 0.513). Both AI models achieved high average composite scores (DeepSeek-R1 = 3.50, ChatGPT-3.5 = 3.44, out of a maximum of 4 points). The AI models performed exceptionally well across all domains, though they were relatively weaker in the “Treatment” domain.

Conclusion

Our study has identified the potential of AI models, particularly ChatGPT-3.5 and DeepSeek-R1, to provide accurate and comprehensive responses to HIV/AIDS-related questions. As free online tools, they can provide personalized, useful medical information to diverse populations across regions. However, medical information generated by AI models should still be used under the supervision and review of healthcare professionals.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

HIV InfectionsArtificial IntelligenceHumansCross-Sectional StudiesGenerative Artificial IntelligenceLarge Language ModelsAcquired Immunodeficiency Syndrome

Stichwörter der Autor:innen

AIDSChatGPT-3.5Deepseek-R1HIVhealth knowledge

Autor:innen und Institutionen

  • Department of Nursing, The Second Hospital of Nanjing, Nanjing, China.
  • School of Nursing, Nanjing University of Chinese Medicine, Nanjing, China.
  • Department of Infectious Diseases, The Second Hospital of Nanjing, Nanjing, China.
  • Department of Public Health, The Second Hospital of Nanjing, Nanjing, China.

Zitieren

APA

Huang, H., Zhang, H., Qin, X., Wu, Y., Yu, Q., Fang, M., Sun, B., Cheng, J., Song, Y., Shu, J., & Wang, L. (2026). How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek. Frontiers in Public Health, 14. https://doi.org/10.3389/fpubh.2026.1886493

Vancouver

Huang H, Zhang H, Qin X, Wu Y, Yu Q, Fang M, et al. How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek. Frontiers in Public Health. 2026;14. doi:10.3389/fpubh.2026.1886493

BibTeX
@article{Huang2026,
  author = {Huang, Hui and Zhang, Huichao and Qin, Xinxin and Wu, Yuhan and Yu, Qi and Fang, Mingxia and Sun, Binghu and Cheng, Jian and Song, Yan and Shu, Junmei and Wang, Ling},
  title = {How AI responds to common HIV/AIDS questions: ChatGPT versus DeepSeek},
  journal = {Frontiers in Public Health},
  year = {2026},
  volume = {14},
  doi = {10.3389/fpubh.2026.1886493}
}
Kostenlos starten →