EUVIMEDEUVIMED entdecken
Crossref

Validating Large Language Model Annotations

Anne Lundgaard Hansen

Finance and Economics Discussion Series · 2026-03 · (2026-020) · 1-1

DOI: 10.17016/feds.2026.020 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Finance and Economics Discussion Series, 2026-03. Verfasst von Anne Lundgaard Hansen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper proposes a validation framework for LLM-generated measurements when reliable benchmarks are unavailable. Validity is established by testing whether an LLM can reconstruct passages from annotated labels while maintaining semantic consistency with the original text. The framework avoids circular reasoning by establishing testable prerequisite properties that must be met for a validation to be considered successful. Application to news article data demonstrates that the framework serves as a practical alternative to human benchmarking, which offers advantages in objectivity, scalability, and cost-effectiveness while identifying cases where LLMs capture economic meaning that human evaluators miss.

Zitieren

APA

Hansen, A. L. (2026). Validating Large Language Model Annotations. Finance and Economics Discussion Series, 1-1. https://doi.org/10.17016/feds.2026.020

Vancouver

Hansen AL. Validating Large Language Model Annotations. Finance and Economics Discussion Series. 2026:1-1. doi:10.17016/feds.2026.020

BibTeX
@article{Hansen2026,
  author = {Hansen, Anne Lundgaard},
  title = {Validating Large Language Model Annotations},
  journal = {Finance and Economics Discussion Series},
  year = {2026},
  number = {2026-020},
  pages = {1--1},
  doi = {10.17016/feds.2026.020}
}
Kostenlos starten →