EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations

Kola Rishika, Dayakar Thalla, Kiran Gadapaka, Emmadi Swathi, Lellela Vishnu, Jannu Sushman

International Journal of AI Electronics and Nexus Energy · 09.04.2026 · 2 (2) · 102-114

DOI: 10.64751/tkhpt493 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of AI Electronics and Nexus Energy, online erschienen am 09.04.2026. Verfasst von Kola Rishika und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The in-vehicle environment produces a wide range of acoustic signals originating from driver actions, engine dynamics, road interactions, and surrounding traffic conditions. These audio cues provide valuable information related to driver behavior and vehicle safety. With the advancement of intelligent transportation systems, automated and real-time monitoring of driver alertness using in-vehicle audio has become increasingly important. To address these limitations, this study proposes a deep learning– based framework for in-vehicle audio event detection aimed at improving driver alertness monitoring. The system employs WavLM, a transformer-based architecture, to extract deep acoustic feature representations from raw audio signals. These features effectively capture temporal and contextual dependencies, enabling robust modeling of complex sound patterns within the vehicle environment. The extracted feature vectors are used to train multiple classifiers, including CatBoost Classifier, Histogram Gradient Boosting Classifier, Extra Trees Classifier, and a proposed Tree-Based Generalized Additive Model (TGAM). The framework supports both main-class and sub-class classification to accurately identify driver-related events such as distractions, alerts, and environmental sounds. Performance evaluation using accuracy, precision, recall, and F1-score demonstrates that the TGAM model achieves superior results, with 99.92% accuracy for main-class classification and 99.58% for sub-class classification. The proposed approach enhances the reliability and efficiency of in-vehicle audio analysis, contributing significantly to driver safety and intelligent monitoring systems.

Zitieren

APA

Rishika, K., Thalla, D., Gadapaka, K., Swathi, E., Vishnu, L., & Sushman, J. (2026). An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations. International Journal of AI Electronics and Nexus Energy, 2(2), 102-114. https://doi.org/10.64751/tkhpt493

Vancouver

Rishika K, Thalla D, Gadapaka K, Swathi E, Vishnu L, Sushman J. An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations. International Journal of AI Electronics and Nexus Energy. 2026;2(2):102-114. doi:10.64751/tkhpt493

BibTeX
@article{Rishika2026,
  author = {Rishika, Kola and Thalla, Dayakar and Gadapaka, Kiran and Swathi, Emmadi and Vishnu, Lellela and Sushman, Jannu},
  title = {An Interpretable Audio Intelligence Framework for Driver Vigilance Using WavLM-Based Deep Representations},
  journal = {International Journal of AI Electronics and Nexus Energy},
  year = {2026},
  volume = {2},
  number = {2},
  pages = {102--114},
  doi = {10.64751/tkhpt493}
}
Kostenlos starten →