The Assessment of ChatGPT and DeepSeek to Solve Chemistry Exams and the Classification of the Exam Questions According to Bloom’s Taxonomy in order to Alter the Level of Exams. A Comparative Study
Journal of Artificial Intelligence and Technology · 09.07.2026
DOI: 10.37965/jait.2026.0942 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Artificial Intelligence and Technology, online erschienen am 09.07.2026. Verfasst von Ali Ghadban und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This study examines the performance of ChatGPT and DeepSeek in solving undergraduate chemistry exams (general, organic, inorganic, and physical) and their ability to classify questions by Bloom’s Taxonomy to adjust cognitive levels. Both models perform well on general chemistry, with DeepSeek scoring about eight points higher, and both succeed on direct calculation tasks (e.g., kinetics, atomic structure, and Bohr model). ChatGPT struggles with complex numerical problems (e.g., Arrhenius equation) and does not handle diagram based tasks (e.g., orbital diagrams). In physical chemistry, both achieve near-perfect scores on thermodynamics questions, while performance on organic chemistry is low (38% for ChatGPT vs. 23% for DeepSeek), reflecting difficulty with stereochemistry, acid-base chemistry, resonance, and spatial structures. In inorganic chemistry, both perform moderately (62% vs. 56%), solving simple but not symmetry or group theory-related problems. Statistical analyses across multiple-choice questions show that differences between models are small and not statistically significant for any exam: organic chemistry (37.5% vs. 25.0%, p = 0.63), inorganic (84% vs. 68%, p = 0.72), general (100% vs. 86.7%, p = 0.50), and physical chemistry (100% vs. 95.2%, p = 1.00), indicating only potential advantages that cannot be generalized. Both classify most questions correctly by Bloom’s levels, though errors occur at the apply/analyze levels. ChatGPT is more effective in adjusting question difficulty by moving through Bloom’s verbs.
Zitieren
APA
Ghadban, A., Khatib, F. A., Rahal, H., & Khaled, S. (2026). The Assessment of ChatGPT and DeepSeek to Solve Chemistry Exams and the Classification of the Exam Questions According to Bloom’s Taxonomy in order to Alter the Level of Exams. A Comparative Study. Journal of Artificial Intelligence and Technology. https://doi.org/10.37965/jait.2026.0942
Vancouver
Ghadban A, Khatib FA, Rahal H, Khaled S. The Assessment of ChatGPT and DeepSeek to Solve Chemistry Exams and the Classification of the Exam Questions According to Bloom’s Taxonomy in order to Alter the Level of Exams. A Comparative Study. Journal of Artificial Intelligence and Technology. 2026. doi:10.37965/jait.2026.0942
BibTeX
@article{Ghadban2026,
author = {Ghadban, Ali and Khatib, Fatima Al and Rahal, Hanan and Khaled, Sanaa},
title = {The Assessment of ChatGPT and DeepSeek to Solve Chemistry Exams and the Classification of the Exam Questions According to Bloom’s Taxonomy in order to Alter the Level of Exams. A Comparative Study},
journal = {Journal of Artificial Intelligence and Technology},
year = {2026},
doi = {10.37965/jait.2026.0942}
}
EUVIMED