EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism

Kangen Chen, Xiuhong Lin, Tao Xia, Rushan Bai

Buildings · 04.05.2025 · 15 (9) · 1552

DOI: 10.3390/buildings15091552 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Buildings, online erschienen am 04.05.2025. Verfasst von Kangen Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Guangdong Province Philosophy and Social Sciences 2023 Annual Discipline Co-construction Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Parks are an important component of urban ecosystems, yet traditional research often relies on single-modal data, such as text or images alone, making it difficult to comprehensively and accurately capture the complex emotional experiences of visitors and their relationships with the environment. This study proposes a park perception and understanding model based on multimodal text–image data and a bidirectional attention mechanism. By integrating text and image data, the model incorporates a bidirectional encoder representations from transformers (BERT)-based text feature extraction module, a Swin Transformer-based image feature extraction module, and a bidirectional cross-attention fusion module, enabling a more precise assessment of visitors’ emotional experiences in parks. Experimental results show that compared to traditional methods such as residual network (ResNet), recurrent neural network (RNN), and long short-term memory (LSTM), the proposed model achieves significant advantages across multiple evaluation metrics, including mean squared error (MSE), mean absolute error (MAE), root mean squared error (RMSE), and the coefficient of determination (R2). Furthermore, using the SHapley Additive exPlanations (SHAP) method, this study identified the key factors influencing visitors’ emotional experiences, such as “water”, “green”, and “sky”, providing a scientific basis for park management and optimization.

Förderung

  • Guangdong Province Philosophy and Social Sciences 2023 Annual Discipline Co-construction Project

Zitieren

APA

Chen, K., Lin, X., Xia, T., & Bai, R. (2025). Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism. Buildings, 15(9), 1552. https://doi.org/10.3390/buildings15091552

Vancouver

Chen K, Lin X, Xia T, Bai R. Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism. Buildings. 2025;15(9):1552. doi:10.3390/buildings15091552

BibTeX
@article{Chen2025,
  author = {Chen, Kangen and Lin, Xiuhong and Xia, Tao and Bai, Rushan},
  title = {Research on Park Perception and Understanding Methods Based on Multimodal Text–Image Data and Bidirectional Attention Mechanism},
  journal = {Buildings},
  year = {2025},
  volume = {15},
  number = {9},
  pages = {1552},
  doi = {10.3390/buildings15091552}
}
Kostenlos starten →