EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Application of Multimodal Transformer Model in Intelligent Agricultural Disease Detection and Question-Answering Systems

Yuchun Lu, Xiaoyi Lu, Liping Zheng, Min Sun, Siyu Chen, Baiyan Chen, Tong Wang, Jiming Yang, Chunli Lv

Plants · 28.03.2024 · 13 (7) · 972

DOI: 10.3390/plants13070972 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Plants, online erschienen am 28.03.2024. Verfasst von Yuchun Lu und 8 weiteren Autor:innen. Beteiligte Einrichtung: China Agricultural University, Beijing 100083, China. Die Arbeit wurde bisher 66-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this study, an innovative approach based on multimodal data and the transformer model was proposed to address challenges in agricultural disease detection and question-answering systems. This method effectively integrates image, text, and sensor data, utilizing deep learning technologies to profoundly analyze and process complex agriculture-related issues. The study achieved technical breakthroughs and provides new perspectives and tools for the development of intelligent agriculture. In the task of agricultural disease detection, the proposed method demonstrated outstanding performance, achieving a precision, recall, and accuracy of 0.95, 0.92, and 0.94, respectively, significantly outperforming the other conventional deep learning models. These results indicate the method’s effectiveness in identifying and accurately classifying various agricultural diseases, particularly excelling in handling subtle features and complex data. In the task of generating descriptive text from agricultural images, the method also exhibited impressive performance, with a precision, recall, and accuracy of 0.92, 0.88, and 0.91, respectively. This demonstrates that the method can not only deeply understand the content of agricultural images but also generate accurate and rich descriptive texts. The object detection experiment further validated the effectiveness of our approach, where the method achieved a precision, recall, and accuracy of 0.96, 0.91, and 0.94. This achievement highlights the method’s capability for accurately locating and identifying agricultural targets, especially in complex environments. Overall, the approach in this study not only demonstrated exceptional performance in multiple tasks such as agricultural disease detection, image captioning, and object detection but also showcased the immense potential of multimodal data and deep learning technologies in the application of intelligent agriculture.

Schlagwörter

Stichwörter der Autor:innen

agricultural disease detectionagricultural large modeldeep learningsmart agriculturetransformer model

Autor:innen und Institutionen

  • China Agricultural University, Beijing 100083, China.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Lu, Y., Lu, X., Zheng, L., Sun, M., Chen, S., Chen, B., Wang, T., Yang, J., & Lv, C. (2024). Application of Multimodal Transformer Model in Intelligent Agricultural Disease Detection and Question-Answering Systems. Plants, 13(7), 972. https://doi.org/10.3390/plants13070972

Vancouver

Lu Y, Lu X, Zheng L, Sun M, Chen S, Chen B, et al. Application of Multimodal Transformer Model in Intelligent Agricultural Disease Detection and Question-Answering Systems. Plants. 2024;13(7):972. doi:10.3390/plants13070972

BibTeX
@article{Lu2024,
  author = {Lu, Yuchun and Lu, Xiaoyi and Zheng, Liping and Sun, Min and Chen, Siyu and Chen, Baiyan and Wang, Tong and Yang, Jiming and Lv, Chunli},
  title = {Application of Multimodal Transformer Model in Intelligent Agricultural Disease Detection and Question-Answering Systems},
  journal = {Plants},
  year = {2024},
  volume = {13},
  number = {7},
  pages = {972},
  doi = {10.3390/plants13070972}
}
Kostenlos starten →