Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness
Sensors · 24.07.2026 · 26 (15) · 4708
DOI: 10.3390/s26154708 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 24.07.2026. Verfasst von Bocheng Zhou und 6 weiteren Autor:innen. Beteiligte Einrichtung: China Agricultural University, Beijing 100083, China. Die Arbeit nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
With the rapid development of intelligent sensing systems, digital monitoring platforms, and multisource data acquisition technologies, accurate identification of operational states and potential risks from heterogeneous sensing signals has become an important research issue in artificial intelligence-driven sensing. Existing studies have primarily focused on either textual information understanding or behavioral data analysis, with limited attention paid to jointly modeling the consistency between textual declarations and executed behaviors. As a result, many potential risks that have not yet manifested as significant anomalies but already involve execution deviations are difficult to detect in a timely manner. To address this issue, a language–behavior consistency sensing framework for multisource sensing signals is proposed. Textual sensing signals and behavioral sensing signals are mapped into a shared state logic space, and intelligent perception and quantitative analysis of deviations between textual states and executed states are achieved through a textual state logic extraction module, an observed behavioral state modeling module, and a language–behavior consistency measurement module. Systematic experiments were conducted on a multisource sensing dataset containing public declaration texts, operation reports, behavioral logs, resource allocation records, and state-response information. The results show that the proposed method achieved the best performance in the baseline comparison experiment, with a language–behavior consistency score (LCS) of 0.742, an AUC of 0.846, an F1-score of 0.811, a Precision of 0.802, and an explanation consistency score (ECS) of 0.821, clearly outperforming advanced methods such as FinBERT, LSTM, Multimodal Transformer, and the Contrastive Multimodal Model. These results demonstrate that language–behavior consistency sensing can effectively fuse multisource sensing information and improve complex system state identification, anomaly early warning, and risk perception, providing an interpretable artificial intelligence-driven sensing framework with the potential to support industrial operation and maintenance, intelligent manufacturing, digital infrastructure management, and other intelligent monitoring scenarios.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- China Agricultural University, Beijing 100083, China.
- National School of Development, Peking University, Beijing 100871, China.
- Beijing Forestry University, Beijing 100083, China.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhou, B., Xie, J., Chen, T., Ning, B., Cao, J., Dong, Y., & Li, M. (2026). Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness. Sensors, 26(15), 4708. https://doi.org/10.3390/s26154708
Vancouver
Zhou B, Xie J, Chen T, Ning B, Cao J, Dong Y, et al. Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness. Sensors. 2026;26(15):4708. doi:10.3390/s26154708
BibTeX
@article{Zhou2026,
author = {Zhou, Bocheng and Xie, Jinze and Chen, Tiantian and Ning, Bingyan and Cao, Jingwen and Dong, Yansong and Li, Manzhou},
title = {Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness},
journal = {Sensors},
year = {2026},
volume = {26},
number = {15},
pages = {4708},
doi = {10.3390/s26154708}
}
EUVIMED