Domain-Specific Summarization to Enhance LLM Effectiveness
Journal of Defence and Security Industries: Strategy and Technology · 26.06.2026 · 1 (2) · 129-156
DOI: 10.65834/jdsi.12.32 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Defence and Security Industries: Strategy and Technology, online erschienen am 26.06.2026. Verfasst von Hamza Emin Hacıoğlu und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Large Language Models (LLMs) have become increasingly prevalent in the field of natural language processing, particularly for text summarization tasks. Their ability to capture semantic relationships and generate coherent summaries has made them a powerful alternative to traditional extractive and abstractive summarization methods. However, the effective summarization of long and domain-specific texts, such as petitions, remains a challenging problem. This study explores the problem of petition text summarization by applying state-of-the-art LLMs and evaluating various training strategies on a custom-built dataset. The paper investigates different model training approaches, including Low-Rank Adaptation (LoRA) and prompt engineering techniques, to optimize summarization quality. Human-in-the-loop summarization methods are also incorporated to refine the models, ensuring high-quality outputs in real-world scenarios. Furthermore, the model’s performance is assessed through expert evaluation, which highlights areas for potential improvement in terms of both accuracy and coherence. The research further delves into methods for effectively summarizing long-form petition texts, exploring ways to preserve critical information while maintaining brevity and readability. The results demonstrate the feasibility of leveraging LLM-based summarization methods for complex, lengthy texts while providing insights into the challenges and opportunities within this evolving field.
Zitieren
APA
Hacıoğlu, H. E., Karakaya, İ., Erdoğan, E., Kalaycı, S., Ak, M., Vurgun, Ö. U., Mendi, A. F., & Nacar, M. A. (2026). Domain-Specific Summarization to Enhance LLM Effectiveness. Journal of Defence and Security Industries: Strategy and Technology, 1(2), 129-156. https://doi.org/10.65834/jdsi.12.32
Vancouver
Hacıoğlu HE, Karakaya İ, Erdoğan E, Kalaycı S, Ak M, Vurgun ÖU, et al. Domain-Specific Summarization to Enhance LLM Effectiveness. Journal of Defence and Security Industries: Strategy and Technology. 2026;1(2):129-156. doi:10.65834/jdsi.12.32
BibTeX
@article{Hacolu2026,
author = {Hacıoğlu, Hamza Emin and Karakaya, İsmail and Erdoğan, Ensar and Kalaycı, Serdar and Ak, Müge and Vurgun, Özgür Umut and Mendi, Arif Furkan and Nacar, Mehmet Akif},
title = {Domain-Specific Summarization to Enhance LLM Effectiveness},
journal = {Journal of Defence and Security Industries: Strategy and Technology},
year = {2026},
volume = {1},
number = {2},
pages = {129--156},
doi = {10.65834/jdsi.12.32}
}
EUVIMED