EUVIMEDEUVIMED entdecken
Crossref

Detecting and correcting Factual Error in LLM Text series

Anisha Soni Anisha Soni, Miss Pratibha Tiwari Miss Pratibha Tiwari

International Scientific Journal of Engineering and Management · 30.06.2026 · 05 (06) · 1-16

DOI: 10.55041/isjem08089 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Scientific Journal of Engineering and Management, online erschienen am 30.06.2026. Verfasst von Anisha Soni Anisha Soni und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This thesis delves into advanced modelling techniques, employing Titan Text Lite for news article summarization, a method that integrates BERT in the Encoder and GPT-2 in the Decoder. Transformer based models enhance the summarization process, ensuring a comprehensive and contextually accurate output. The evaluation of the generated summary is the key focus in this thesis. Initially, baseline ROUGE scores are calculated, serving as a fundamental metric for summarization quality. However, recognizing the limitations of automated metrics, the evaluation process is enriched by leveraging a Large Language Model (LLM). The LLM is instructed to critically scrutinize the generated summaries, aiming to ascertain whether supporting evidence can be inferred from the original article. This approach not only validates the coherence of the summaries but also ensures alignment with the source news article. To further refine the evaluation, the LLM is guided through specialized instructions for chain-of-thought reasoning, with a specific emphasis on noun entities and dates. This strategic emphasis addresses nuanced aspects of content understanding, contributing to a more nuanced evaluation of summarization effectiveness. The evaluation process is then replicated at the sentence level, offering a granular perspective on the model's performance. The outcomes of the evaluation are recorded as binary "Yes" or "No" responses, providing a tangible measure of the LLM's accuracy in assessing the summaries. This meticulous and comprehensive approach seeks to unravel the intricacies of the model's capabilities in generating coherent, contextually. Key Words: Natural Language Processing (NLP), Large Language Models (LLM), Chain of Thought (COT), Generative Pre-trained Transformers (GPT), Recall-Oriented Understudy

Zitieren

APA

Soni, A. S. A., & Tiwari, M. P. T. M. P. (2026). Detecting and correcting Factual Error in LLM Text series. International Scientific Journal of Engineering and Management, 05(06), 1-16. https://doi.org/10.55041/isjem08089

Vancouver

Soni ASA, Tiwari MPTMP. Detecting and correcting Factual Error in LLM Text series. International Scientific Journal of Engineering and Management. 2026;05(06):1-16. doi:10.55041/isjem08089

BibTeX
@article{Soni2026,
  author = {Soni, Anisha Soni Anisha and Tiwari, Miss Pratibha Tiwari Miss Pratibha},
  title = {Detecting and correcting Factual Error in LLM Text series},
  journal = {International Scientific Journal of Engineering and Management},
  year = {2026},
  volume = {05},
  number = {06},
  pages = {1--16},
  doi = {10.55041/isjem08089}
}
Kostenlos starten →