Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention
PLOS Computational Biology · 2024
DOI: 10.1371/journal.pcbi.1012376 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Keyvan Mahjoory und 2 weiteren Autor:innen. Beteiligte Einrichtung: Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany. Hauptthemen laut MEDLINE: Attention, Electroencephalography, Neural Networks, Computer, Brain. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Research Council, HORIZON EUROPE European Research Council, Max-Planck-Gesellschaft.
Abstract (Originalsprache)
Human listeners have the ability to direct their attention to a single speaker in a multi-talker environment. The neural correlates of selective attention can be decoded from a single trial of electroencephalography (EEG) data. In this study, leveraging the source-reconstructed and anatomically-resolved EEG data as inputs, we sought to employ CNN as an interpretable model to uncover task-specific interactions between brain regions, rather than simply to utilize it as a black box decoder. To this end, our CNN model was specifically designed to learn pairwise interaction representations for 10 cortical regions from five-second inputs. By exclusively utilizing these features for decoding, our model was able to attain a median accuracy of 77.56% for within-participant and 65.14% for cross-participant classification. Through ablation analysis together with dissecting the features of the models and applying cluster analysis, we were able to discern the presence of alpha-band-dominated inter-hemisphere interactions, as well as alpha- and beta-band dominant interactions that were either hemisphere-specific or were characterized by a contrasting pattern between the right and left hemispheres. These interactions were more pronounced in parietal and central regions for within-participant decoding, but in parietal, central, and partly frontal regions for cross-participant decoding. These findings demonstrate that our CNN model can effectively utilize features known to be important in auditory attention tasks and suggest that the application of domain knowledge inspired CNNs on source-reconstructed EEG data can offer a novel computational framework for studying task-relevant brain interactions.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.
- RheinMain University of Applied Sciences Campus Ruesselsheim, Wiesbaden, Germany.
- Department of Psychology, Toronto Metropolitan University, Toronto, Ontario, Canada.
ORCID-Profile: Keyvan Mahjoory
Förderung
- European Research Council
- HORIZON EUROPE European Research Council
- Max-Planck-Gesellschaft
Zitieren
APA
Mahjoory, K., Bahmer, A., & Henry, M. J. (2024). Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012376
Vancouver
Mahjoory K, Bahmer A, Henry MJ. Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1012376
BibTeX
@article{Mahjoory2024,
author = {Mahjoory, Keyvan and Bahmer, Andreas and Henry, Molly J},
title = {Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention},
journal = {PLOS Computational Biology},
year = {2024},
doi = {10.1371/journal.pcbi.1012376}
}
EUVIMED