Designing life science assessments in the era of generative artificial intelligence
PLOS One · 2026
DOI: 10.1371/journal.pone.0346127 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Andrew C Kwong und 5 weiteren Autor:innen. Beteiligte Einrichtung: Division of Gastroenterology, Hepatology, and Nutrition, Boston Children's Hospital, Boston, Massachusetts, United States of America. Hauptthemen laut MEDLINE: Generative Artificial Intelligence, Educational Measurement, Biological Science Disciplines, Artificial Intelligence. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Harvard Medical School Dean’s Innovation Awards for the Use of Artificial Intelligence in Education, Research, and Administration.
Abstract (Originalsprache)
Generative artificial intelligence (GAI) algorithms have the potential to reshape education. Though GAI may help democratize access to education, it also presents many challenges for educators. Already, the ease of use of GAI has made it easier for students to bypass learning gains by prompting GAI for answers to assignments. Here, we assessed how ChatGPT performed on take-home assignments in a doctoral-level molecular biology course designed to train students in experimental design. Using Bloom’s taxonomy as a framework, we hypothesized that ChatGPT would perform similarly to doctoral students on lower cognitive levels involving memorization and underperform at higher levels that rely on critical thinking. Students outperformed ChatGPT, but surprisingly, this result was driven by ChatGPT’s poor performance on “remember” and “apply” tasks, which was partially improved by simple prompt engineering. To build assessments more robust to GAI usage, we developed and tested new free-response and multiple-choice assessments. We found a striking deficit in ChatGPT’s ability to interpret scientific graphs and raw data in both short-answer and multiple-choice questions, even when using a version specifically designed for image interpretation. Based on our results, we propose several tips for designing out-of-class assessments that promote student learning in the era of GAI.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Division of Gastroenterology, Hepatology, and Nutrition, Boston Children's Hospital, Boston, Massachusetts, United States of America.
- Program in Biological and Biomedical Sciences, Harvard Medical School, Boston, Massachusetts, United States of America.
- Department of Computer Science, Tufts University, Medford, Massachusetts, United States of America.
- Department of Biological Chemistry and Molecular Pharmacology, Blavatnik Institute, Harvard Medical School, Boston, Massachusetts, United States of America.
- Department of Biology, University of Richmond, Richmond, Virginia, United States of America.
ORCID-Profile: Christine Goglia, John Jacob Peters
Förderung
- Harvard Medical School Dean’s Innovation Awards for the Use of Artificial Intelligence in Education, Research, and Administration
Zitieren
APA
Kwong, A. C., Magnano, C., DeOliveira, C., Goglia, C., Loparo, J. J., & Peters, J. J. (2026). Designing life science assessments in the era of generative artificial intelligence. PLOS One. https://doi.org/10.1371/journal.pone.0346127
Vancouver
Kwong AC, Magnano C, DeOliveira C, Goglia C, Loparo JJ, Peters JJ. Designing life science assessments in the era of generative artificial intelligence. PLOS One. 2026. doi:10.1371/journal.pone.0346127
BibTeX
@article{Kwong2026,
author = {Kwong, Andrew C and Magnano, Christopher and DeOliveira, Cristina and Goglia, Christine and Loparo, Joseph J and Peters, John Jacob},
title = {Designing life science assessments in the era of generative artificial intelligence},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0346127}
}
EUVIMED