EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Decentralized Provenance Layer for Foundation Models: A Framework for Quantifying and Penalizing Synthetic Data Contamination in Recursive LLM Training

SyedTalib Zaheer Zaidi, Muhammad Zamin Ali Khan, Muhammad Usama Khan, Amad Asif, Khalid Bin Muhammad, Faigha Karim, Ammad Mallick

Kashf Journal of Multidisciplinary Research · 30.05.2026 · 3 (05) · 163-174

DOI: 10.71146/kjmr944 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Kashf Journal of Multidisciplinary Research, online erschienen am 30.05.2026. Verfasst von SyedTalib Zaheer Zaidi und 6 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid development of Large Language Models (LLMs) and other Foundation Models requires substantial amounts of high-quality, human-generated training data [1]. However, the global collection of original human-generated content, known as the 'internet corpus,' is experiencing a marked decline [1]. To train successive generations of models, increasing quantities of data are sourced from the internet, which often includes outputs generated by existing AI models [1]. "Model collapse" describes a progressive degradation in learning, initiated when models are trained on data produced by their predecessors, resulting in a diminished ability to capture the true underlying data distribution [1]. This degradation is exacerbated by the loss of long-tail information, which is rare, difficult to obtain, and often sensitive. Consequently, model outputs become increasingly similar, reducing diversity and quality [1]. This issue impairs performance and may render future AI systems unreliable and less effective [1]. Recent research by Shumailov et al. (2024) highlights the model collapse phenomenon resulting from continual training on synthetic data. Borji (2024) further examines this issue using distribution fitting and iterative sampling of generated data [2].

Zitieren

APA

Zaidi, S. Z., Khan, M. Z. A., Khan, M. U., Asif, A., Muhammad, K. B., Karim, F., & Mallick, A. (2026). Decentralized Provenance Layer for Foundation Models: A Framework for Quantifying and Penalizing Synthetic Data Contamination in Recursive LLM Training. Kashf Journal of Multidisciplinary Research, 3(05), 163-174. https://doi.org/10.71146/kjmr944

Vancouver

Zaidi SZ, Khan MZA, Khan MU, Asif A, Muhammad KB, Karim F, et al. Decentralized Provenance Layer for Foundation Models: A Framework for Quantifying and Penalizing Synthetic Data Contamination in Recursive LLM Training. Kashf Journal of Multidisciplinary Research. 2026;3(05):163-174. doi:10.71146/kjmr944

BibTeX
@article{Zaidi2026,
  author = {Zaidi, SyedTalib Zaheer and Khan, Muhammad Zamin Ali and Khan, Muhammad Usama and Asif, Amad and Muhammad, Khalid Bin and Karim, Faigha and Mallick, Ammad},
  title = {Decentralized Provenance Layer for Foundation Models: A Framework for Quantifying and Penalizing Synthetic Data Contamination in Recursive LLM Training},
  journal = {Kashf Journal of Multidisciplinary Research},
  year = {2026},
  volume = {3},
  number = {05},
  pages = {163--174},
  doi = {10.71146/kjmr944}
}
Kostenlos starten →