Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism
Buildings · 04.05.2025 · 15 (9) · 1552
DOI: 10.3390/buildings15091552 ↗Kurz gefasst
Fachartikel in der Zeitschrift Buildings, online erschienen am 04.05.2025. Verfasst von Kangen Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Guangdong Province Philosophy and Social Sciences 2023 Annual Discipline Co-construction Project.
Abstract (Originalsprache)
Parks are an important component of urban ecosystems, yet traditional research often relies on single-modal data, such as text or images alone, making it difficult to comprehensively and accurately capture the complex emotional experiences of visitors and their relationships with the environment. This study proposes a park perception and understanding model based on multimodal text–image data and a bidirectional attention mechanism. By integrating text and image data, the model incorporates a bidirectional encoder representations from transformers (BERT)-based text feature extraction module, a Swin Transformer-based image feature extraction module, and a bidirectional cross-attention fusion module, enabling a more precise assessment of visitors’ emotional experiences in parks. Experimental results show that compared to traditional methods such as residual network (ResNet), recurrent neural network (RNN), and long short-term memory (LSTM), the proposed model achieves significant advantages across multiple evaluation metrics, including mean squared error (MSE), mean absolute error (MAE), root mean squared error (RMSE), and the coefficient of determination (R2). Furthermore, using the SHapley Additive exPlanations (SHAP) method, this study identified the key factors influencing visitors’ emotional experiences, such as “water”, “green”, and “sky”, providing a scientific basis for park management and optimization.
Förderung
- Guangdong Province Philosophy and Social Sciences 2023 Annual Discipline Co-construction Project
Zitieren
APA
Chen, K., Lin, X., Xia, T., & Bai, R. (2025). Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism. Buildings, 15(9), 1552. https://doi.org/10.3390/buildings15091552
Vancouver
Chen K, Lin X, Xia T, Bai R. Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism. Buildings. 2025;15(9):1552. doi:10.3390/buildings15091552
BibTeX
@article{Chen2025,
author = {Chen, Kangen and Lin, Xiuhong and Xia, Tao and Bai, Rushan},
title = {Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism},
journal = {Buildings},
year = {2025},
volume = {15},
number = {9},
pages = {1552},
doi = {10.3390/buildings15091552}
}
EUVIMED