EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness

Bocheng Zhou, Jinze Xie, Tiantian Chen, Bingyan Ning, Jingwen Cao, Yansong Dong, Manzhou Li

Sensors · 24.07.2026 · 26 (15) · 4708

DOI: 10.3390/s26154708 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 24.07.2026. Verfasst von Bocheng Zhou und 6 weiteren Autor:innen. Beteiligte Einrichtung: China Agricultural University, Beijing 100083, China. Die Arbeit nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of intelligent sensing systems, digital monitoring platforms, and multisource data acquisition technologies, accurate identification of operational states and potential risks from heterogeneous sensing signals has become an important research issue in artificial intelligence-driven sensing. Existing studies have primarily focused on either textual information understanding or behavioral data analysis, with limited attention paid to jointly modeling the consistency between textual declarations and executed behaviors. As a result, many potential risks that have not yet manifested as significant anomalies but already involve execution deviations are difficult to detect in a timely manner. To address this issue, a language–behavior consistency sensing framework for multisource sensing signals is proposed. Textual sensing signals and behavioral sensing signals are mapped into a shared state logic space, and intelligent perception and quantitative analysis of deviations between textual states and executed states are achieved through a textual state logic extraction module, an observed behavioral state modeling module, and a language–behavior consistency measurement module. Systematic experiments were conducted on a multisource sensing dataset containing public declaration texts, operation reports, behavioral logs, resource allocation records, and state-response information. The results show that the proposed method achieved the best performance in the baseline comparison experiment, with a language–behavior consistency score (LCS) of 0.742, an AUC of 0.846, an F1-score of 0.811, a Precision of 0.802, and an explanation consistency score (ECS) of 0.821, clearly outperforming advanced methods such as FinBERT, LSTM, Multimodal Transformer, and the Contrastive Multimodal Model. These results demonstrate that language–behavior consistency sensing can effectively fuse multisource sensing information and improve complex system state identification, anomaly early warning, and risk perception, providing an interpretable artificial intelligence-driven sensing framework with the potential to support industrial operation and maintenance, intelligent manufacturing, digital infrastructure management, and other intelligent monitoring scenarios.

Schlagwörter

Stichwörter der Autor:innen

explainable risk perceptionintelligent monitoring systemslanguage–behavior consistencylarge language modelsmultisource sensing signals

Autor:innen und Institutionen

  • China Agricultural University, Beijing 100083, China.
  • National School of Development, Peking University, Beijing 100871, China.
  • Beijing Forestry University, Beijing 100083, China.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhou, B., Xie, J., Chen, T., Ning, B., Cao, J., Dong, Y., & Li, M. (2026). Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness. Sensors, 26(15), 4708. https://doi.org/10.3390/s26154708

Vancouver

Zhou B, Xie J, Chen T, Ning B, Cao J, Dong Y, et al. Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness. Sensors. 2026;26(15):4708. doi:10.3390/s26154708

BibTeX
@article{Zhou2026,
  author = {Zhou, Bocheng and Xie, Jinze and Chen, Tiantian and Ning, Bingyan and Cao, Jingwen and Dong, Yansong and Li, Manzhou},
  title = {Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {15},
  pages = {4708},
  doi = {10.3390/s26154708}
}
Kostenlos starten →