EUVIMEDEUVIMED entdecken
Crossref

Scene Classification via Attention-Guided Integration of Visual and Auditory Data Streams

Yusuf Çelik

Türk Doğa ve Fen Dergisi · 01.07.2026 · 15 (2) · 207-214

DOI: 10.46810/tdfd.1828359 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Türk Doğa ve Fen Dergisi, online erschienen am 01.07.2026. Verfasst von Yusuf Çelik. Die Arbeit nennt 22 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study proposes a novel multi-source deep learning architecture, called the Gated Cross-Modal Fusion Transformer (GCM-FT), designed to more effectively integrate the complementary structure of visual and auditory information sources in scene classification. The proposed framework extracts deep representations from the visual stream using an EfficientNetV2 backbone, while processing the MFCC-based time–frequency features provided within the dataset for the auditory stream. The representation vectors obtained from both streams are dynamically unified through a gated attention mechanism. With its multi-headed loss function, auxiliary stream outputs, and attention-based fusion block, the model is able to learn the contributions of visual and auditory information in a stable and balanced manner. Extensive cross-validation experiments demonstrate that GCM-FT achieves higher accuracy, lower variance, and more consistent class-wise performance compared with single-stream models and existing fused-information approaches.These findings indicate that attention-guided fusion offers a powerful and generalizable information integration strategy for visual–auditory scene classification tasks.

Zitieren

APA

Çelik, Y. (2026). Scene Classification via Attention-Guided Integration of Visual and Auditory Data Streams. Türk Doğa ve Fen Dergisi, 15(2), 207-214. https://doi.org/10.46810/tdfd.1828359

Vancouver

Çelik Y. Scene Classification via Attention-Guided Integration of Visual and Auditory Data Streams. Türk Doğa ve Fen Dergisi. 2026;15(2):207-214. doi:10.46810/tdfd.1828359

BibTeX
@article{elik2026,
  author = {Çelik, Yusuf},
  title = {Scene Classification via Attention-Guided Integration of Visual and Auditory Data Streams},
  journal = {Türk Doğa ve Fen Dergisi},
  year = {2026},
  volume = {15},
  number = {2},
  pages = {207--214},
  doi = {10.46810/tdfd.1828359}
}
Kostenlos starten →