Low-power and lightweight spiking transformer for EEG-based auditory attention detection
Neural Networks · 2025
DOI: 10.1016/j.neunet.2024.106977 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neural Networks, 2025. Verfasst von Yawen Lan und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China. Hauptthemen laut MEDLINE: Electroencephalography, Attention, Neural Networks, Computer, Auditory Perception. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
EEG signal analysis can be used to study brain activity and the function and structure of neural networks, helping to understand neural mechanisms such as cognition, emotion, and behavior. EEG-based auditory attention detection is using EEG signals to determine an individual's level of attention to specific auditory stimuli. In this technique, researchers record and analyze a subject's electrical activity to infer whether an individual is paying attention to a specific auditory stimulus. The model deployed in edge devices will be greatly convenient for subjects to use. However, most of the existing EEG-based auditory attention detection models use traditional neural network models, and their high computing load makes deployment on edge devices challenging. We present a pioneering approach in the form of a binarized spiking Transformer for EEG-based auditory attention detection, which is characterized by high accuracy, low power consumption, and lightweight design, making it highly suitable for deployment on edge devices. In terms of low power consumption, the network is constructed using spiking neurons, which emit sparse and binary spike sequences, which can effectively reduce computing power consumption. In terms of lightweight, we use a post-training quantization strategy to quantize the full-precision network weights into binary weights, which greatly reduces the model size. In addition, the structure of the Transformer ensures that the model can learn effective information and ensure its high performance. We verify the model through mainstream datasets, and experimental results show that our model performance can exceed the existing state-of-the-art models, and the model size can be reduced by more than 21 times compared with the original full-precision network counterpart.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China.
- Department of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China.
- School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China. Electronic address: zyp_002@163.com.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Lan, Y., Wang, Y., Zhang, Y., & Zhu, H. (2025). Low-power and lightweight spiking transformer for EEG-based auditory attention detection. Neural Networks. https://doi.org/10.1016/j.neunet.2024.106977
Vancouver
Lan Y, Wang Y, Zhang Y, Zhu H. Low-power and lightweight spiking transformer for EEG-based auditory attention detection. Neural Networks. 2025. doi:10.1016/j.neunet.2024.106977
BibTeX
@article{Lan2025,
author = {Lan, Yawen and Wang, Yuchen and Zhang, Yuping and Zhu, Hong},
title = {Low-power and lightweight spiking transformer for EEG-based auditory attention detection},
journal = {Neural Networks},
year = {2025},
doi = {10.1016/j.neunet.2024.106977}
}
EUVIMED