Evaluating knowledge graph enhanced retrieval augmented generation for automated functional requirements extraction
New Trends in Computer Sciences · 12.06.2026 · 4 (1) · 1-19
DOI: 10.3846/ntcs.2026.27121 ↗Kurz gefasst
Fachartikel in der Zeitschrift New Trends in Computer Sciences, online erschienen am 12.06.2026. Verfasst von Dilki Sandunika Rathnayake und 1 weiteren Autor:innen. Die Arbeit nennt 23 Literaturangaben.
Abstract (Originalsprache)
The automation of requirements engineering using large language models offers significant potential for efficiency but struggles with hallucinations and a lack of domain-specific precision in highly regulated fields such as healthcare. While retrieval augmented generation (RAG) addresses some of these issues, standard vector-based retrieval often fails to capture complex semantic relationships required for strict compliance. This research assesses the effectiveness of automated functional requirement extraction by comparing two distinct retrieval architectures: a baseline vector-only RAG versus a knowledge graph-enhanced RAG with three distinct prompt strategies. We implemented an end-to-end automated extraction pipeline applied to a corpus of heterogeneous healthcare documents. The study constructed two separate knowledge bases to perform a comparative analysis. Under the experimental conditions (seven healthcare documents, three security-focused testing areas, and Claude3-Haiku at temperature zero), knowledge base curation was found to be a stronger determinant of extraction quality than retrieval architecture, though the relative impact may vary with corpus scale, domain, and base LLM. With a curated knowledge base, GraphRAG eliminated the systematic relevance collapse observed under standard preprocessing, achieved significant structural traceability validity in independent Neo4j cross-checking, and produced prompt-stable performance across three prompt strategies. Without rigorous preprocessing, graph augmentation amplified rather than mitigated retrieval noise
Zitieren
APA
Rathnayake, D. S., & Slotkienė, A. (2026). Evaluating knowledge graph enhanced retrieval augmented generation for automated functional requirements extraction. New Trends in Computer Sciences, 4(1), 1-19. https://doi.org/10.3846/ntcs.2026.27121
Vancouver
Rathnayake DS, Slotkienė A. Evaluating knowledge graph enhanced retrieval augmented generation for automated functional requirements extraction. New Trends in Computer Sciences. 2026;4(1):1-19. doi:10.3846/ntcs.2026.27121
BibTeX
@article{Rathnayake2026,
author = {Rathnayake, Dilki Sandunika and Slotkienė, Asta},
title = {Evaluating knowledge graph enhanced retrieval augmented generation for automated functional requirements extraction},
journal = {New Trends in Computer Sciences},
year = {2026},
volume = {4},
number = {1},
pages = {1--19},
doi = {10.3846/ntcs.2026.27121}
}
EUVIMED