Physics of generative AI’s atom: Repetition, bias, and beyond
AIP Advances · 01.03.2026 · 16 (3)
DOI: 10.1063/5.0296911 ↗Kurz gefasst
Fachartikel in der Zeitschrift AIP Advances, online erschienen am 02.03.2026. Verfasst von Frank Yingjie Huo und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
We derive a first-principles physics theory of the individual “atom” at the heart of generative AI such as ChatGPT: the basic attention head. The theory shows how, when, and why its output can become repetitive or suddenly switch to potentially harmful content. In situations where a small subset of attention heads dominates generative AI’s output or multi-layer effects average out, such undesirable microscale behavior will emerge at the macroscale to threaten generative AI’s safety in medical, legal, and business settings. The theory also quantifies the impact of bias from training and fine-tuning. The theory’s 2-spin form suggests why generative AI such as ChatGPT can work so well but hints that a generalized 3-spin attention might be even better. The theory’s similarity to spin bath physics means existing physics expertise could be harnessed to help generative AI become more trustworthy and resilient to manipulation.
Zitieren
APA
Huo, F. Y., & Johnson, N. F. (2026). Physics of generative AI’s atom: Repetition, bias, and beyond. AIP Advances, 16(3). https://doi.org/10.1063/5.0296911
Vancouver
Huo FY, Johnson NF. Physics of generative AI’s atom: Repetition, bias, and beyond. AIP Advances. 2026;16(3). doi:10.1063/5.0296911
BibTeX
@article{Huo2026,
author = {Huo, Frank Yingjie and Johnson, Neil F.},
title = {Physics of generative AI’s atom: Repetition, bias, and beyond},
journal = {AIP Advances},
year = {2026},
volume = {16},
number = {3},
doi = {10.1063/5.0296911}
}
EUVIMED