EUVIMEDEUVIMED entdecken
Crossref

Conformal Autoregressive Generation: Beam Search with Coverage Guarantees

Nicolas Deutschmann, Marvin Alberts, María Rodríguez Martínez

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (10) · 11775-11783

DOI: 10.1609/aaai.v38i10.29062 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Nicolas Deutschmann und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We introduce two new extensions to the beam search algorithm based on conformal predictions (CP) to produce sets of sequences with theoretical coverage guarantees. The first method is very simple and proposes dynamically-sized subsets of beam search results but, unlike typical CP proceedures, has an upper bound on the achievable guarantee depending on a post-hoc calibration measure. Our second algorithm introduces the conformal set prediction procedure as part of the decoding process, producing a variable beam width which adapts to the current uncertainty. While more complex, this procedure can achieve coverage guarantees selected a priori. We provide marginal coverage bounds as well as calibration-conditional guarantees for each method, and evaluate them empirically on a selection of tasks drawing from natural language processing and chemistry.

Zitieren

APA

Deutschmann, N., Alberts, M., & Martínez, M. R. (2024). Conformal Autoregressive Generation: Beam Search with Coverage Guarantees. Proceedings of the AAAI Conference on Artificial Intelligence, 38(10), 11775-11783. https://doi.org/10.1609/aaai.v38i10.29062

Vancouver

Deutschmann N, Alberts M, Martínez MR. Conformal Autoregressive Generation: Beam Search with Coverage Guarantees. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(10):11775-11783. doi:10.1609/aaai.v38i10.29062

BibTeX
@article{Deutschmann2024,
  author = {Deutschmann, Nicolas and Alberts, Marvin and Martínez, María Rodríguez},
  title = {Conformal Autoregressive Generation: Beam Search with Coverage Guarantees},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {10},
  pages = {11775--11783},
  doi = {10.1609/aaai.v38i10.29062}
}
Kostenlos starten →