Forum Text Processing and Summarization
JOIV : International Journal on Informatics Visualization · 31.03.2024 · 8 (1) · 425
DOI: 10.62527/joiv.8.1.2279 ↗Kurz gefasst
Fachartikel in der Zeitschrift JOIV : International Journal on Informatics Visualization, online erschienen am 31.03.2024. Verfasst von Yen-Wei Mak und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Frequently Asked Questions (FAQs) are extensively studied in general domains like the medical field, but such frameworks are lacking in domains such as software engineering and open-source communities. This research aims to bridge this gap by establishing the foundations of an automated FAQ Generation and Retrieval framework specifically tailored to the software engineering domain. The framework involves analyzing, ranking, performing sentiment analysis, and summarization techniques on open forums like StackOverflow and GitHub issues. A corpus of Stack Overflow post data is collected to evaluate the proposed framework and the selected models. Integrating state-of-the-art models of string-matching models, sentiment analysis models, summarization models, and the proprietary ranking formula proposed in this paper forms a robust Automatic FAQ Generation and Retrieval framework to facilitate developers' work. String matching, sentiment analysis, and summarization models are evaluated, and F1 scores of 71.31%, 74.90%, and 53.4% were achieved. Given the subjective nature of evaluations in this context, a human review is used to further validate the effectiveness of the overall framework, with assessments made on relevancy, preferred ranking, and preferred summarization. Future work includes improving summarization models by incorporating text classification and summarizing them individually (Kou et al, 2023), as well as proposing feedback loop systems based on human reinforcement learning. Furthermore, efforts will be made to optimize the framework by utilizing knowledge graphs for dimension reduction, enabling it to handle larger corpora effectively
Zitieren
APA
Mak, Y., Goh, H., & Lim, A. H. (2024). Forum Text Processing and Summarization. JOIV : International Journal on Informatics Visualization, 8(1), 425. https://doi.org/10.62527/joiv.8.1.2279
Vancouver
Mak Y, Goh H, Lim AH. Forum Text Processing and Summarization. JOIV : International Journal on Informatics Visualization. 2024;8(1):425. doi:10.62527/joiv.8.1.2279
BibTeX
@article{Mak2024,
author = {Mak, Yen-Wei and Goh, Hui-Ngo and Lim, Amy Hui-Lan},
title = {Forum Text Processing and Summarization},
journal = {JOIV : International Journal on Informatics Visualization},
year = {2024},
volume = {8},
number = {1},
pages = {425},
doi = {10.62527/joiv.8.1.2279}
}
EUVIMED