Developing a Large Language Model–Based Feedback System for Case Report Writing in Rehabilitation Education: Tutorial
JMIR Medical Education · 2026-06-15 · 12 · e76924
DOI: 10.2196/76924 ↗At a glance
Fallbericht in JMIR Medical Education, published online on 2026-06-15. Written by Yuuto Tonouchi and 3 co-authors. Institution: Department of Rehabilitation, Kyoto Min-iren Asukai Hospital, Kyoto, Kyoto, Japan. Major MEDLINE topics: Feedback, Large Language Models, Rehabilitation, Writing. 32 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Novice health care staff often write case reports during early clinical training. However, many institutions lack structured feedback systems because of time constraints and instructor shortages. Large language models, a form of artificial intelligence (AI), offer new opportunities to enhance educational feedback, yet their application in clinical training requires careful design to ensure pedagogically appropriate and ethically sound outputs.
Objective
This tutorial provides a practical guide for educators without programming experience to develop an AI-based feedback system using 3 accessible tools: Dify (an AI workflow platform), Slack (a messaging app), and Google Apps Script. The system balances educational quality with operational efficiency while incorporating data privacy safeguards for clinical educational content.
Methods
We developed a feedback system comprising 4 AI chatbots with 2 distinct approaches: “loop-based” bots that promote clinical reasoning through iterative, comment-based feedback and “single-shot” bots for efficient proofreading and summarization tasks. The tutorial describes the system architecture; feedback design principles grounded in formative assessment theory; a step-by-step implementation guide; and data privacy safeguards, including a deidentification protocol and application programming interface–based data protection measures. To illustrate feasibility, we conducted a pilot implementation at a community care hospital from April to June 2024, involving 5 novice staff members and 5 instructors.
Results
A pilot implementation at a community care hospital demonstrated that the system was feasible to deploy and operate within routine clinical education workflows. Participant feedback indicated high usability and suggested that the iterative, comment-based feedback approach supported learner engagement while also identifying areas where feedback criteria required refinement to better match institutional educational goals.
Conclusions
This tutorial provides a reproducible framework for building a customized AI feedback system that combines comment-based iterative feedback with human-in-the-loop oversight and a multilayered data privacy framework. By following this guide, educators can implement an adaptive system tailored to their institutional context and clinical domain.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Rehabilitation, Kyoto Min-iren Asukai Hospital, Kyoto, Kyoto, Japan.
- Department of Occupational Therapy, Faculty of Rehabilitation, Morinomiya University of Medical Sciences, Osaka, Osaka, Japan.
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, Osaka, Osaka, Japan.
- Center for Postgraduate Clinical Training and Career Development, Nagoya University Hospital, Nagoya, Aichi, Japan.
- Center for Medical Education, Graduate School of Medicine, Nagoya University, Nagoya, Aichi, Japan.
- Department of Healthcare Epidemiology, Graduate School of Medicine and Public Health, Kyoto University, Kyoto, Kyoto, Japan.
ORCID profiles: Yuuto Tonouchi, Shunsuke Nakai, Kayo Murakami, Yuki Kataoka
Cite
APA
Tonouchi, Y., Nakai, S., Murakami, K., & Kataoka, Y. (2026). Developing a Large Language Model–Based Feedback System for Case Report Writing in Rehabilitation Education: Tutorial. JMIR Medical Education, 12, e76924. https://doi.org/10.2196/76924
Vancouver
Tonouchi Y, Nakai S, Murakami K, Kataoka Y. Developing a Large Language Model–Based Feedback System for Case Report Writing in Rehabilitation Education: Tutorial. JMIR Medical Education. 2026;12:e76924. doi:10.2196/76924
BibTeX
@article{Tonouchi2026,
author = {Tonouchi, Yuuto and Nakai, Shunsuke and Murakami, Kayo and Kataoka, Yuki},
title = {Developing a Large Language Model–Based Feedback System for Case Report Writing in Rehabilitation Education: Tutorial},
journal = {JMIR Medical Education},
year = {2026},
volume = {12},
pages = {e76924},
doi = {10.2196/76924}
}
EUVIMED