EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology

Withanage Dona Manushi Dinasha, Nissanka Mudiyanselage Tanuri Ayanga Nissanka, Chamudhi Prabashi Wickramasinghe, Warnakulasuriya Palakuttige Pasindu Damsara Fernando, Vindya Perera iD, Hiripitiyage Gayan Danushka Gunatilake iD

Access Microbiology · 01.08.2026 · 8 (8)

DOI: 10.1099/acmi.0.001137.v5 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Access Microbiology, erschienen am 01.08.2026. Verfasst von Withanage Dona Manushi Dinasha und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Science, International Institute of Health Sciences, Welisara, Sri Lanka. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

ChatGPT, an OpenAI chatbot, serves as a valuable tool in the present for learning and education. It also offers information on microbiology, as its popularity grows among students. However, assessing the accuracy of ChatGPT’s responses is essential due to the potential for ‘hallucinations’ in large language models (LLMs).

Objectives

This study focused on evaluating the accuracy of ChatGPT’s responses to general questions on bacterial species and assessing whether the responses included key microbiological terms typically expected in academic or examination settings. Methodology. Questions were designed to reflect interactions at three language proficiency levels, including low, moderate and high. A clinical microbiologist finalized a list of 15 bacterial species, each with 18 specific questions of both local and international relevance. These questions were then prompted to ChatGPT 3.5 and 4.1 mini models, simulating real user interactions. Responses were evaluated using a microbiology reference guide and categorized as accurate, mixed/incomplete or inaccurate.

Results

Results revealed average scores of 1.5%, 58.1% and 40.4% and 0.5%, 43.2% and 56.3% for inaccurate, mixed/incomplete and accurate answers for 3.5 and 4.1 mini models, respectively. While high proficiency demonstrated a higher percentage of accurate responses, all other results were either mixed/incomplete or inaccurate.

Conclusion

Findings suggest that precise questions yielded more accurate responses, while imprecise questions often led to partially correct responses. Notably, ChatGPT 4.1 mini gave clearer and more reliable answers than ChatGPT 3.5. The study emphasizes the influence of question formulation on response accuracy, recommending further research to explore more advanced LLMs like ChatGPT-4o and ChatGPT-o3 models.

Schlagwörter

Stichwörter der Autor:innen

AI in educationChatGPTartificial intelligencebacterial specieslearningmicrobiology

Autor:innen und Institutionen

  • Department of Biomedical Science, International Institute of Health Sciences, Welisara, Sri Lanka.
  • Department of Microbiology, Faculty of Medicine, Sabaragamuwa University of Sri Lanka, Belihuloya, Sri Lanka.

ORCID-Profile: Vindya Perera, Hiripitiyage Gayan Danushka Gunatilake

Zitieren

APA

Manushi Dinasha, W. D., Nissanka, N. M. T. A., Wickramasinghe, C. P., Fernando, W. P. P. D., Perera, V., & Gunatilake, H. G. D. (2026). Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology. Access Microbiology, 8(8). https://doi.org/10.1099/acmi.0.001137.v5

Vancouver

Manushi Dinasha WD, Nissanka NMTA, Wickramasinghe CP, Fernando WPPD, Perera V, Gunatilake HGD. Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology. Access Microbiology. 2026;8(8). doi:10.1099/acmi.0.001137.v5

BibTeX
@article{ManushiDinasha2026,
  author = {Manushi Dinasha, Withanage Dona and Nissanka, Nissanka Mudiyanselage Tanuri Ayanga and Wickramasinghe, Chamudhi Prabashi and Fernando, Warnakulasuriya Palakuttige Pasindu Damsara and Perera, Vindya and Gunatilake, Hiripitiyage Gayan Danushka},
  title = {Assessment of the efficacy of ChatGPT responses to bacterial species-specific questions in microbiology},
  journal = {Access Microbiology},
  year = {2026},
  volume = {8},
  number = {8},
  doi = {10.1099/acmi.0.001137.v5}
}
Kostenlos starten →