EUVIMEDEUVIMED entdecken
Crossref

Utilizing Pre-Trained Language Models and Large Language Models for 10-K Items Segmentation

Hsin-Min Lu, Yu-Tai Chien, Huan-Hsun Yen, Yen-Hsiu Chen

Journal of Information Systems · 07.05.2026 · 1-21

DOI: 10.2308/isys-2025-005 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Information Systems, online erschienen am 07.05.2026. Verfasst von Hsin-Min Lu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Extracting specific items from 10-K filings is challenging because of variations in document formats and item presentation. This study aims to improve traditional rule-based approaches by introducing and comparing two advanced item segmentation methods: (1) GPT4ItemSeg, employing a novel line-ID-based prompting mechanism to utilize a large language model, ChatGPT-4o, for item segmentation, and (2) BERT4ItemSeg, combining a pre-trained language model, BERT, with a Bi-LSTM model in a hierarchical structure to overcome context window constraints. Trained and evaluated on 3,737 annotated 10-K reports, BERT4ItemSeg achieves a macro-F1 of 0.9825, surpassing GPT4ItemSeg (0.9567), conditional random field (0.9818), and rule-based methods (0.9048) for core items (1, 1A, 3, and 7). These approaches enhance item segmentation performance, improving text analytics in accounting and finance. BERT4ItemSeg offers satisfactory item segmentation performance, whereas GPT4ItemSeg can easily adapt to regulatory changes. Together, they provide an extensible framework for 10-K item segmentation that supports reliable and reproducible results. Data Availability: Data are available for download at https://www.im.ntu.edu.tw/~lu/data/itemseg/itemseg10kdata.7z. Code is available from the authors upon request. JEL Classifications: M41; C81.

Zitieren

APA

Lu, H., Chien, Y., Yen, H., & Chen, Y. (2026). Utilizing Pre-Trained Language Models and Large Language Models for 10-K Items Segmentation. Journal of Information Systems, 1-21. https://doi.org/10.2308/isys-2025-005

Vancouver

Lu H, Chien Y, Yen H, Chen Y. Utilizing Pre-Trained Language Models and Large Language Models for 10-K Items Segmentation. Journal of Information Systems. 2026:1-21. doi:10.2308/isys-2025-005

BibTeX
@article{Lu2026,
  author = {Lu, Hsin-Min and Chien, Yu-Tai and Yen, Huan-Hsun and Chen, Yen-Hsiu},
  title = {Utilizing Pre-Trained Language Models and Large Language Models for 10-K Items Segmentation},
  journal = {Journal of Information Systems},
  year = {2026},
  pages = {1--21},
  doi = {10.2308/isys-2025-005}
}
Kostenlos starten →