Assessing the quality of crop variety data extraction from unstructured text sources using large language models
Agronomy Journal · 2026-03 · 118 (2)
DOI: 10.1002/agj2.70324 ↗Kurz gefasst
Fachartikel in der Zeitschrift Agronomy Journal, online erschienen am 05.03.2026. Verfasst von M. A. Soldatkina und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: Ministry of Science and Higher Education of the Russian Federation.
Abstract (Originalsprache)
A huge amount of agricultural information is on paper or electronic media in a non‐digitized and unstructured form. Obtaining detailed information about agricultural plants in a machine‐readable format is possible through extracting and analyzing data from unstructured text sources. This study evaluates the effectiveness of large language models (LLMs) in extracting crop variety data from Russian‐language agricultural registers, specifically the Russian State Register of Breeding Achievements (30,000+ varieties). GPT‐3.5 Turbo (where GPT is generative pretrained transformer), GPT‐4o, and GPT‐4o‐mini from OpenAI were selected as language models using few‐shot prompt‐tuning (FSPT) and fine‐tuning (FT) approaches. Human assessment of the data extraction quality was performed on 250 variety descriptions by three reviewers, who are specialists in the field of agriculture. The best result of data extraction was shown by the GPT‐4o model with FSPT (F1 = 0.967). The model led in recognizing the parameters “Morphological Properties,” “Yield and Production,” and “Abiotic Stress Tolerance,” but slightly lagged behind GPT‐4o‐mini with FT in the category “Tolerance to Diseases and Pests.” To scale the assessment of the quality of data extraction, a search for a relationship with the automatic metrics was carried out. Text Coverage demonstrated the strongest correlation with human assessment (cor = 0.405) and was set at 0.73 as the threshold for identifying unsatisfactory data extraction results. These results represent a significant advancement in automating the processing of agricultural data while maintaining high accuracy standards. This research contributes to the growing body of knowledge on applying LLMs to specialized agricultural domains and offers solution for large‐scale data extraction challenges.
Förderung
- Ministry of Science and Higher Education of the Russian Federation
Zitieren
APA
Soldatkina, M. A., Tsymbarovich, P. R., Fomin, D. S., & Ivanov, A. L. (2026). Assessing the quality of crop variety data extraction from unstructured text sources using large language models. Agronomy Journal, 118(2). https://doi.org/10.1002/agj2.70324
Vancouver
Soldatkina MA, Tsymbarovich PR, Fomin DS, Ivanov AL. Assessing the quality of crop variety data extraction from unstructured text sources using large language models. Agronomy Journal. 2026;118(2). doi:10.1002/agj2.70324
BibTeX
@article{Soldatkina2026,
author = {Soldatkina, M. A. and Tsymbarovich, P. R. and Fomin, D. S. and Ivanov, A. L.},
title = {Assessing the quality of crop variety data extraction from unstructured text sources using large language models},
journal = {Agronomy Journal},
year = {2026},
volume = {118},
number = {2},
doi = {10.1002/agj2.70324}
}
EUVIMED