An Empirical Study on Enhancing Large Language Models for Long-Term Conversations in Korean
Applied Sciences · 25.03.2026 · 16 (7) · 3175
DOI: 10.3390/app16073175 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 25.03.2026. Verfasst von Hongjin Kim und 4 weiteren Autor:innen. Die Arbeit nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Konkuk University, Institute of Information & communications Technology Planning & Evaluation.
Abstract (Originalsprache)
Large language models (LLMs) have shown strong performance in open-domain dialogue, yet they continue to struggle with long-term multi-session conversations (MSC), particularly in non-English languages such as Korean. In this work, we present a comprehensive empirical study on enhancing Korean MSC capabilities of LLMs through dataset construction, memory modeling, and parameter-efficient fine-tuning. We introduce an extended Korean MSC dataset that explicitly distinguishes between persona memory (long-term user attributes) and episode memory (short-term, event-driven information), enabling more effective memory management across sessions. Using this dataset, we evaluate LLM performance on three core MSC tasks: session summarization, memory update, and response generation. Our experiments reveal that Korean MSC is intrinsically more challenging than English MSC and that memory update and response generation require substantial reasoning ability. To address these challenges, we compare LoRA, DPO, MoE, CPT, Layer Tuning, and neuron-level tuning methods. Results consistently show that neuron tuning, guided by a novel language-specific neuron identification method based on activation scores and entropy, achieves superior performance and robustness, particularly in continual learning settings. Overall, our findings highlight neuron-level adaptation as an effective and interpretable approach for improving long-term conversational ability in low-resource languages.
Förderung
- Konkuk University
- Institute of Information & communications Technology Planning & Evaluation
Zitieren
APA
Kim, H., Kang, J., Jang, Y., Sim, Y., & Kim, H. (2026). An Empirical Study on Enhancing Large Language Models for Long-Term Conversations in Korean. Applied Sciences, 16(7), 3175. https://doi.org/10.3390/app16073175
Vancouver
Kim H, Kang J, Jang Y, Sim Y, Kim H. An Empirical Study on Enhancing Large Language Models for Long-Term Conversations in Korean. Applied Sciences. 2026;16(7):3175. doi:10.3390/app16073175
BibTeX
@article{Kim2026,
author = {Kim, Hongjin and Kang, Jeonghyun and Jang, Yeajin and Sim, Yujin and Kim, Harksoo},
title = {An Empirical Study on Enhancing Large Language Models for Long-Term Conversations in Korean},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {7},
pages = {3175},
doi = {10.3390/app16073175}
}
EUVIMED