EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Critical Writing Through AI Feedback: A Randomized Control Study

Kai Zhang iD

Behavioral Sciences · 30.04.2025 · 15 (5) · 600

DOI: 10.3390/bs15050600 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Behavioral Sciences, online erschienen am 30.04.2025. Verfasst von Kai Zhang. Beteiligte Einrichtung: Informatization Office, Fudan University, Shanghai 200433, China. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates the effectiveness of artificial intelligence-generated content (AIGC) systems on undergraduate writing development through a randomized controlled trial with 259 Chinese students. Despite promising applications of AI in educational settings, empirical evidence regarding its comparative effectiveness in writing instruction remains limited. Using a four-week intervention comparing Qwen-powered AI feedback to traditional instructor feedback, we employed difference-in-differences (DiD) analysis and structural equation modeling to examine how technology acceptance factors influence writing outcomes. Results demonstrated significant improvements in the AIGC intervention group compared to controls (β = 0.149, p < 0.001), with particularly strong effects on organization (β = 0.311, p < 0.001) and content development (β = 0.191, p < 0.001). Path analysis revealed that perceived usefulness fully mediated the relationship between perceived ease of use and attitudes toward the system (β = 0.326, p < 0.001), with attitudes strongly predicting behavioral engagement (β = 0.431, p < 0.001). Contrary to traditional technology acceptance models, perceived ease of use showed no direct effect on attitudes, suggesting that students prioritize functional benefits over interface simplicity in educational technology contexts. These findings contribute to an expanded technology acceptance model for educational settings while providing evidence-based guidelines for implementing AI writing assistants in higher education.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligence-generated contentcritical writingeducational interventiontechnology acceptance model

Autor:innen und Institutionen

  • Informatization Office, Fudan University, Shanghai 200433, China.

ORCID-Profile: Kai Zhang

Zitieren

APA

Zhang, K. (2025). Enhancing Critical Writing Through AI Feedback: A Randomized Control Study. Behavioral Sciences, 15(5), 600. https://doi.org/10.3390/bs15050600

Vancouver

Zhang K. Enhancing Critical Writing Through AI Feedback: A Randomized Control Study. Behavioral Sciences. 2025;15(5):600. doi:10.3390/bs15050600

BibTeX
@article{Zhang2025,
  author = {Zhang, Kai},
  title = {Enhancing Critical Writing Through AI Feedback: A Randomized Control Study},
  journal = {Behavioral Sciences},
  year = {2025},
  volume = {15},
  number = {5},
  pages = {600},
  doi = {10.3390/bs15050600}
}
Kostenlos starten →