EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An AI-Driven Multimodal Sensor Fusion Framework for Fraud Perception in Short-Video and Live-Streaming Platforms

Ruixiang Zhao, Xuanhao Zhang, Jinfan Yang, Haofei Li, Zhengjia Lu, Wenrui Xu, Manzhou Li

Sensors · 28.02.2026 · 26 (5) · 1525

DOI: 10.3390/s26051525 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 28.02.2026. Verfasst von Ruixiang Zhao und 6 weiteren Autor:innen. Beteiligte Einrichtung: National School of Development, Peking University, Beijing 100871, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid proliferation of short-video platforms and live-streaming commerce ecosystems, marketing activities are increasingly manifested through complex multimodal sensing signals. These heterogeneous sensor data streams exhibit strong temporal dependency, high cross-modal coupling, and progressive evolutionary characteristics, making early-stage fraud perception particularly challenging for conventional unimodal or static analytical paradigms. Existing approaches often fail to effectively capture weak anomalous cues emerging across multimodal channels during the initial stages of fraudulent campaigns. To address these limitations, an artificial intelligence-driven multimodal sensor perception framework is proposed for temporal fraud detection in short-video environments. A multimodal temporal alignment module is first designed to synchronize heterogeneous sensor signals with inconsistent sampling granularities. Subsequently, a shared temporal encoding network is constructed to learn evolution-aware representations across multimodal sensor sequences. On this basis, a cross-modal temporal attention fusion mechanism is introduced to dynamically weight sensor contributions at different behavioral stages. Finally, a fraud evolution modeling and early risk prediction module is developed to characterize the progressive intensification of fraudulent activities and to enable risk assessment under incomplete temporal observations. Extensive experiments conducted on real-world datasets collected from multiple mainstream short-video platforms demonstrate the effectiveness of the proposed AI-driven sensing framework. The model achieves an overall accuracy of 0.941, precision of 0.865, recall of 0.812, and F1 score of 0.838, with the AUC further reaching 0.956, significantly outperforming text-based, vision-based, temporal, and conventional multimodal baselines. In early-stage detection scenarios utilizing only the first 30% of video content, the framework maintains stable performance advantages, achieving a precision of 0.812, recall of 0.704, and F1 score of 0.754, validating its capability for proactive fraud warning.

Schlagwörter

Stichwörter der Autor:innen

cross-modal temporal attentionmulti-sensor fusionmultimodal behavioral analyticsmultimodal perception modelingsequential signal processing

Autor:innen und Institutionen

  • National School of Development, Peking University, Beijing 100871, China.
  • College of Economics and Management, Beijing University of Technology, Beijing 100124, China.
  • College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhao, R., Zhang, X., Yang, J., Li, H., Lu, Z., Xu, W., & Li, M. (2026). An AI-Driven Multimodal Sensor Fusion Framework for Fraud Perception in Short-Video and Live-Streaming Platforms. Sensors, 26(5), 1525. https://doi.org/10.3390/s26051525

Vancouver

Zhao R, Zhang X, Yang J, Li H, Lu Z, Xu W, et al. An AI-Driven Multimodal Sensor Fusion Framework for Fraud Perception in Short-Video and Live-Streaming Platforms. Sensors. 2026;26(5):1525. doi:10.3390/s26051525

BibTeX
@article{Zhao2026,
  author = {Zhao, Ruixiang and Zhang, Xuanhao and Yang, Jinfan and Li, Haofei and Lu, Zhengjia and Xu, Wenrui and Li, Manzhou},
  title = {An AI-Driven Multimodal Sensor Fusion Framework for Fraud Perception in Short-Video and Live-Streaming Platforms},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {5},
  pages = {1525},
  doi = {10.3390/s26051525}
}
Kostenlos starten →