Multimodal Behavioral Sensors for Lie Detection: Integrating Visual, Auditory, and Generative Reasoning Cues
Sensors · 02.10.2025 · 25 (19) · 6086
DOI: 10.3390/s25196086 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 02.10.2025. Verfasst von Daniel Grabowski und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Computer Science, Białystok University of Technology, 15-351 Białystok, Poland. Hauptthemen laut MEDLINE: Lie Detection, Deception. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Advances in multimodal artificial intelligence enable new sensor-inspired approaches to lie detection by combining behavioral perception with generative reasoning. This study presents a deception detection framework that integrates deep video and audio processing with large language models guided by chain-of-thought (CoT) prompting. We interpret neural architectures such as ViViT (for video) and HuBERT (for speech) as digital behavioral sensors that extract implicit emotional and cognitive cues, including micro-expressions, vocal stress, and timing irregularities. We further incorporate a GPT-5-based prompt-level fusion approach for video–language–emotion alignment and zero-shot inference. This method jointly processes visual frames, textual transcripts, and emotion recognition outputs, enabling the system to generate interpretable deception hypotheses without any task-specific fine-tuning. Facial expressions are treated as high-resolution affective signals captured via visual sensors, while audio encodes prosodic markers of stress. Our experimental setup is based on the DOLOS dataset, which provides high-quality multimodal recordings of deceptive and truthful behavior. We also evaluate a continual learning setup that transfers emotional understanding to deception classification. Results indicate that multimodal fusion and CoT-based reasoning increase classification accuracy and interpretability. The proposed system bridges the gap between raw behavioral data and semantic inference, laying a foundation for AI-driven lie detection with interpretable sensor analogues.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Computer Science, Białystok University of Technology, 15-351 Białystok, Poland.
- Department of Computer Science and Electronics, Universidad de La Costa-CUC, Barranquilla 080002, Colombia.
ORCID-Profile: Daniel Grabowski, Khalid Saeed
Zitieren
APA
Grabowski, D., Łuczaj, K., & Saeed, K. (2025). Multimodal Behavioral Sensors for Lie Detection: Integrating Visual, Auditory, and Generative Reasoning Cues. Sensors, 25(19), 6086. https://doi.org/10.3390/s25196086
Vancouver
Grabowski D, Łuczaj K, Saeed K. Multimodal Behavioral Sensors for Lie Detection: Integrating Visual, Auditory, and Generative Reasoning Cues. Sensors. 2025;25(19):6086. doi:10.3390/s25196086
BibTeX
@article{Grabowski2025,
author = {Grabowski, Daniel and Łuczaj, Kamila and Saeed, Khalid},
title = {Multimodal Behavioral Sensors for Lie Detection: Integrating Visual, Auditory, and Generative Reasoning Cues},
journal = {Sensors},
year = {2025},
volume = {25},
number = {19},
pages = {6086},
doi = {10.3390/s25196086}
}
EUVIMED