EUVIMEDEUVIMED entdecken
Crossref

Memorization and Expressivity in Transformers: A Learning-Theoretic Perspective

Maxime Meyer

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (48) · 41066-41067

DOI: 10.1609/aaai.v40i48.42159 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Maxime Meyer.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformers have reshaped modern artificial intelligence, yet their theoretical foundations remain incomplete. This thesis investigates the approximation power and memory limitations of transformers. I combine tools from approximation theory and statistical learning theory to provide provable guarantees on expressivity, memorization capacity, and inherent architectural constraints. My contributions include the first rigorous proof of memory bottlenecks in prompt tuning and new results on the expressivity of transformers. The long-term goal of my doctoral research is to develop a principled theoretical framework that grounds the empirical behavior of large-scale transformer models in formal approximation-theoretic results.

Zitieren

APA

Meyer, M. (2026). Memorization and Expressivity in Transformers: A Learning-Theoretic Perspective. Proceedings of the AAAI Conference on Artificial Intelligence, 40(48), 41066-41067. https://doi.org/10.1609/aaai.v40i48.42159

Vancouver

Meyer M. Memorization and Expressivity in Transformers: A Learning-Theoretic Perspective. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(48):41066-41067. doi:10.1609/aaai.v40i48.42159

BibTeX
@article{Meyer2026,
  author = {Meyer, Maxime},
  title = {Memorization and Expressivity in Transformers: A Learning-Theoretic Perspective},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {48},
  pages = {41066--41067},
  doi = {10.1609/aaai.v40i48.42159}
}
Kostenlos starten →