An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations
International Journal of AI Electronics and Nexus Energy · 09.04.2026 · 2 (2) · 102-114
DOI: 10.64751/tkhpt493 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of AI Electronics and Nexus Energy, online erschienen am 09.04.2026. Verfasst von Kola Rishika und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
The in-vehicle environment produces a wide range of acoustic signals originating from driver actions, engine dynamics, road interactions, and surrounding traffic conditions. These audio cues provide valuable information related to driver behavior and vehicle safety. With the advancement of intelligent transportation systems, automated and real-time monitoring of driver alertness using in-vehicle audio has become increasingly important. To address these limitations, this study proposes a deep learning– based framework for in-vehicle audio event detection aimed at improving driver alertness monitoring. The system employs WavLM, a transformer-based architecture, to extract deep acoustic feature representations from raw audio signals. These features effectively capture temporal and contextual dependencies, enabling robust modeling of complex sound patterns within the vehicle environment. The extracted feature vectors are used to train multiple classifiers, including CatBoost Classifier, Histogram Gradient Boosting Classifier, Extra Trees Classifier, and a proposed Tree-Based Generalized Additive Model (TGAM). The framework supports both main-class and sub-class classification to accurately identify driver-related events such as distractions, alerts, and environmental sounds. Performance evaluation using accuracy, precision, recall, and F1-score demonstrates that the TGAM model achieves superior results, with 99.92% accuracy for main-class classification and 99.58% for sub-class classification. The proposed approach enhances the reliability and efficiency of in-vehicle audio analysis, contributing significantly to driver safety and intelligent monitoring systems.
Zitieren
APA
Rishika, K., Thalla, D., Gadapaka, K., Swathi, E., Vishnu, L., & Sushman, J. (2026). An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations. International Journal of AI Electronics and Nexus Energy, 2(2), 102-114. https://doi.org/10.64751/tkhpt493
Vancouver
Rishika K, Thalla D, Gadapaka K, Swathi E, Vishnu L, Sushman J. An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations. International Journal of AI Electronics and Nexus Energy. 2026;2(2):102-114. doi:10.64751/tkhpt493
BibTeX
@article{Rishika2026,
author = {Rishika, Kola and Thalla, Dayakar and Gadapaka, Kiran and Swathi, Emmadi and Vishnu, Lellela and Sushman, Jannu},
title = {An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations},
journal = {International Journal of AI Electronics and Nexus Energy},
year = {2026},
volume = {2},
number = {2},
pages = {102--114},
doi = {10.64751/tkhpt493}
}
EUVIMED