Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology
Access Microbiology · 01.08.2026 · 8 (8)
DOI: 10.1099/acmi.0.001137.v5 ↗Kurz gefasst
Fachartikel in der Zeitschrift Access Microbiology, erschienen am 01.08.2026. Verfasst von Withanage Dona Manushi Dinasha und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Science, International Institute of Health Sciences, Welisara, Sri Lanka. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
ChatGPT, an OpenAI chatbot, serves as a valuable tool in the present for learning and education. It also offers information on microbiology, as its popularity grows among students. However, assessing the accuracy of ChatGPT’s responses is essential due to the potential for ‘hallucinations’ in large language models (LLMs).
Objectives
This study focused on evaluating the accuracy of ChatGPT’s responses to general questions on bacterial species and assessing whether the responses included key microbiological terms typically expected in academic or examination settings. Methodology. Questions were designed to reflect interactions at three language proficiency levels, including low, moderate and high. A clinical microbiologist finalized a list of 15 bacterial species, each with 18 specific questions of both local and international relevance. These questions were then prompted to ChatGPT 3.5 and 4.1 mini models, simulating real user interactions. Responses were evaluated using a microbiology reference guide and categorized as accurate, mixed/incomplete or inaccurate.
Results
Results revealed average scores of 1.5%, 58.1% and 40.4% and 0.5%, 43.2% and 56.3% for inaccurate, mixed/incomplete and accurate answers for 3.5 and 4.1 mini models, respectively. While high proficiency demonstrated a higher percentage of accurate responses, all other results were either mixed/incomplete or inaccurate.
Conclusion
Findings suggest that precise questions yielded more accurate responses, while imprecise questions often led to partially correct responses. Notably, ChatGPT 4.1 mini gave clearer and more reliable answers than ChatGPT 3.5. The study emphasizes the influence of question formulation on response accuracy, recommending further research to explore more advanced LLMs like ChatGPT-4o and ChatGPT-o3 models.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Science, International Institute of Health Sciences, Welisara, Sri Lanka.
- Department of Microbiology, Faculty of Medicine, Sabaragamuwa University of Sri Lanka, Belihuloya, Sri Lanka.
ORCID-Profile: Vindya Perera, Hiripitiyage Gayan Danushka Gunatilake
Zitieren
APA
Manushi Dinasha, W. D., Nissanka, N. M. T. A., Wickramasinghe, C. P., Fernando, W. P. P. D., Perera, V., & Gunatilake, H. G. D. (2026). Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology. Access Microbiology, 8(8). https://doi.org/10.1099/acmi.0.001137.v5
Vancouver
Manushi Dinasha WD, Nissanka NMTA, Wickramasinghe CP, Fernando WPPD, Perera V, Gunatilake HGD. Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology. Access Microbiology. 2026;8(8). doi:10.1099/acmi.0.001137.v5
BibTeX
@article{ManushiDinasha2026,
author = {Manushi Dinasha, Withanage Dona and Nissanka, Nissanka Mudiyanselage Tanuri Ayanga and Wickramasinghe, Chamudhi Prabashi and Fernando, Warnakulasuriya Palakuttige Pasindu Damsara and Perera, Vindya and Gunatilake, Hiripitiyage Gayan Danushka},
title = {Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology},
journal = {Access Microbiology},
year = {2026},
volume = {8},
number = {8},
doi = {10.1099/acmi.0.001137.v5}
}
EUVIMED