EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FeynTune: large language models for high-energy theory

Paul Richmond, Constantinos Papageorgakis, Vasilis Niarchos, Borun Chowdhury, Prarit Agarwal

Machine Learning: Science and Technology · 01.04.2026 · 7 (2) · 025012

DOI: 10.1088/2632-2153/ae47bb ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machine Learning: Science and Technology, online erschienen am 27.02.2026. Verfasst von Paul Richmond und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: EPSRC, Science and Technology Facilities Council (STFC) Consolidated.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present specialized large language models (LLMs) for theoretical high-energy physics, obtained as 20 fine-tuned variants of the 8 billion parameter Llama-3.1 model. Each variant was trained on arXiv abstracts (through August 2024) from different combinations of hep-th, hep-ph and gr-qc. For a comparative study, we also trained models on datasets that contained abstracts from disparate fields such as the q-bio and cs categories. All models were fine-tuned using two distinct low-rank adaptation fine-tuning approaches and varying dataset sizes, and outperformed the base model on hep-th abstract completion tasks. We compare performance against leading commercial LLMs (ChatGPT, Claude, Gemini, DeepSeek) and derive insights for further developing specialized language models for high-energy theoretical physics.

Förderung

  • EPSRC
  • Science and Technology Facilities Council (STFC) Consolidated

Zitieren

APA

Richmond, P., Papageorgakis, C., Niarchos, V., Chowdhury, B., & Agarwal, P. (2026). FeynTune: large language models for high-energy theory. Machine Learning: Science and Technology, 7(2), 025012. https://doi.org/10.1088/2632-2153/ae47bb

Vancouver

Richmond P, Papageorgakis C, Niarchos V, Chowdhury B, Agarwal P. FeynTune: large language models for high-energy theory. Machine Learning: Science and Technology. 2026;7(2):025012. doi:10.1088/2632-2153/ae47bb

BibTeX
@article{Richmond2026,
  author = {Richmond, Paul and Papageorgakis, Constantinos and Niarchos, Vasilis and Chowdhury, Borun and Agarwal, Prarit},
  title = {FeynTune: large language models for high-energy theory},
  journal = {Machine Learning: Science and Technology},
  year = {2026},
  volume = {7},
  number = {2},
  pages = {025012},
  doi = {10.1088/2632-2153/ae47bb}
}
Kostenlos starten →