EUVIMEDEUVIMED entdecken
Crossref

Using Large Language Models as Context Organizers: A Corpus-Assisted Framework for Analyzing EFL Student Feedback

Muyang Niu, Junjie Gavin Wu, Yantao Wei

Teaching English as a Second or Foreign Language--TESL-EJ · 01.11.2026 · 30 (3)

DOI: 10.55593/ej.30119int3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Teaching English as a Second or Foreign Language--TESL-EJ, online erschienen am 01.11.2026. Verfasst von Muyang Niu und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Student feedback is central to English as a Foreign Language (EFL) instruction; however, scaling qualitative interpretation while preserving contextual meaning remains a methodological challenge. This study proposes the T-CADS-LLMs framework, a qualitative text topic analysis framework integrated into an Agent Skill. Rather than treating large language models as autonomous coders, the framework positions them as context organizers constrained by corpus evidence and human verification. Its feasibility was evaluated using interview data from 27 students across two majors in university EFL courses. Across ten course grouped analytical units, 46 manually generated topics were compared with 63 Skill-based topics and 42 GPT-based topics using Topic Coverage, Weighted Coverage, MATS, WMATS, and qualitative analyses of matched topics. Codex+Skill consistently outperformed the Bare-model in descriptive mean scores for coverage (0.672 vs. 0.502), weighted coverage (0.721 vs. 0.600), MATS (0.778 vs. 0.700), and WMATS (0.816 vs. 0.772). Nevertheless, both workflows showed limited ability to capture relational and identity related meanings, performing substantially below human analysis. These findings provide initial evidence for the feasibility and traceability of the framework within a specific EFL context, while further validation with larger and more diverse datasets remains necessary.

Zitieren

APA

Niu, M., Wu, J. G., & Wei, Y. (2026). Using Large Language Models as Context Organizers: A Corpus-Assisted Framework for Analyzing EFL Student Feedback. Teaching English as a Second or Foreign Language--TESL-EJ, 30(3). https://doi.org/10.55593/ej.30119int3

Vancouver

Niu M, Wu JG, Wei Y. Using Large Language Models as Context Organizers: A Corpus-Assisted Framework for Analyzing EFL Student Feedback. Teaching English as a Second or Foreign Language--TESL-EJ. 2026;30(3). doi:10.55593/ej.30119int3

BibTeX
@article{Niu2026,
  author = {Niu, Muyang and Wu, Junjie Gavin and Wei, Yantao},
  title = {Using Large Language Models as Context Organizers: A Corpus-Assisted Framework for Analyzing EFL Student Feedback},
  journal = {Teaching English as a Second or Foreign Language--TESL-EJ},
  year = {2026},
  volume = {30},
  number = {3},
  doi = {10.55593/ej.30119int3}
}
Kostenlos starten →