EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Legal Query RAG

Rahman S. M. Wahidur, Sumin Kim, Haeung Choi, David S. Bhatti, Heung-No Lee

IEEE Access · 2025 · 13 · 36978-36994

DOI: 10.1109/access.2025.3542125 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Rahman S. M. Wahidur und 4 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information & communications Technology Planning & Evaluation, Korea Government (MSIT), IITP (Institute of Information & Communications Technology Planning & Evaluation)-ITRC.

AbstractBibliografische AngabenZitieren

Abstract (Originalsprache)

Recently, legal practice has seen a significant rise in the adoption of Artificial Intelligence (AI) for various core tasks. However, these technologies remain in their early stages and face challenges such as understanding complex legal reasoning, managing biased data, ensuring transparency, and avoiding misleading responses, commonly referred to as hallucinations. To address these limitations, this paper introduces Legal Query RAG (LQ-RAG), a novel Retrieval-Augmented Generation framework with a recursive feedback mechanism specifically designed to overcome the critical shortcomings of standard RAG implementations in legal applications. The proposed framework incorporates four key components: a custom evaluation agent, a specialized response generation model, a prompt engineering agent, and a fine-tuned legal embedding LLM. Together, these components effectively minimize hallucinations, improve domain-specific accuracy, and deliver precise, high-quality responses for complex queries. Experimental results demonstrate that the fine-tuned embedding LLM achieves a 13% improvement in Hit Rate and a 15% improvement in Mean Reciprocal Rank (MRR). Comparisons with general LLMs reveal a 24% performance gain when using the Hybrid Fine-Tuned Generative LLM (HFM), the specialized response generation model integrated into the LQ-RAG framework. Furthermore, LQ-RAG achieves a 23% improvement in relevance score over naive configurations and a 14% improvement over RAG with Fine-Tuned LLMs (FTM). These findings underscore the potential of domain-specific fine-tuned LLMs, combined with advanced RAG modules and feedback mechanisms, to significantly enhance the reliability and performance of AI in legal practice. The reliance of this study on a proprietary model as the evaluation agent, combined with the lack of feedback from human experts, highlights the need for improvement. Future efforts should focus on developing a specialized legal evaluation agent and enhancing its performance by incorporating feedback from domain experts.

Förderung

  • Institute of Information & communications Technology Planning & Evaluation
  • Korea Government (MSIT)
  • IITP (Institute of Information & Communications Technology Planning & Evaluation)-ITRC
  • Korea Government [Ministry of Science and Information and Communication Technology (ICT)]

Zitieren

APA

Wahidur, R. S. M., Kim, S., Choi, H., Bhatti, D. S., & Lee, H. (2025). Legal Query RAG. IEEE Access, 13, 36978-36994. https://doi.org/10.1109/access.2025.3542125

Vancouver

Wahidur RSM, Kim S, Choi H, Bhatti DS, Lee H. Legal Query RAG. IEEE Access. 2025;13:36978-36994. doi:10.1109/access.2025.3542125

BibTeX
@article{Wahidur2025,
  author = {Wahidur, Rahman S. M. and Kim, Sumin and Choi, Haeung and Bhatti, David S. and Lee, Heung-No},
  title = {Legal Query RAG},
  journal = {IEEE Access},
  year = {2025},
  volume = {13},
  pages = {36978--36994},
  doi = {10.1109/access.2025.3542125}
}
Kostenlos starten →