ExpeL: LLM Agents Are Experiential Learners
Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (17) · 19632-19642
DOI: 10.1609/aaai.v38i17.29936 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Andrew Zhao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 166-mal zitiert (Crossref).
Abstract (Originalsprache)
The recent surge in research interest in applying large language models (LLMs) to decision-making tasks has flourished by leveraging the extensive world knowledge embedded in LLMs. While there is a growing demand to tailor LLMs for custom decision-making tasks, finetuning them for specific tasks is resource-intensive and may diminish the model's generalization capabilities. Moreover, state-of-the-art language models like GPT-4 and Claude are primarily accessible through API calls, with their parametric weights remaining proprietary and unavailable to the public. This scenario emphasizes the growing need for new methodologies that allow learning from agent experiences without requiring parametric updates. To address these problems, we introduce the Experiential Learning (ExpeL) agent. Our agent autonomously gathers experiences and extracts knowledge using natural language from a collection of training tasks. At inference, the agent recalls its extracted insights and past experiences to make informed decisions. Our empirical results highlight the robust learning efficacy of the ExpeL agent, indicating a consistent enhancement in its performance as it accumulates experiences. We further explore the emerging capabilities and transfer learning potential of the ExpeL agent through qualitative observations and additional experiments.
Zitieren
APA
Zhao, A., Huang, D., Xu, Q., Lin, M., Liu, Y., & Huang, G. (2024). ExpeL: LLM Agents Are Experiential Learners. Proceedings of the AAAI Conference on Artificial Intelligence, 38(17), 19632-19642. https://doi.org/10.1609/aaai.v38i17.29936
Vancouver
Zhao A, Huang D, Xu Q, Lin M, Liu Y, Huang G. ExpeL: LLM Agents Are Experiential Learners. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(17):19632-19642. doi:10.1609/aaai.v38i17.29936
BibTeX
@article{Zhao2024,
author = {Zhao, Andrew and Huang, Daniel and Xu, Quentin and Lin, Matthieu and Liu, Yong-Jin and Huang, Gao},
title = {ExpeL: LLM Agents Are Experiential Learners},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2024},
volume = {38},
number = {17},
pages = {19632--19642},
doi = {10.1609/aaai.v38i17.29936}
}
EUVIMED