Indoor Scene Recognition in Vision-and-Language Navigation
IEEE Transactions on Consumer Electronics · 2026-02 · 72 (1) · 1216-1222
DOI: 10.1109/tce.2025.3645249 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2026-02. Verfasst von Hongtao Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Scientific Research Platform and Project of Guangdong Provincial Education Department.
Abstract (Originalsprache)
Indoor scene recognition is a crucial component in vision-and-language navigation (VLN), which involves guiding an agent to navigate through unseen, photo-realistic environments using natural language instructions. However, existing researches have not yet endowed VLN agents with robust indoor scene recognition capabilities, which are essential for enhancing the agent’s spatial perception and environmental understanding. In this paper, we introduce the Room-to-Room Scene Recognition (R2R-SR) dataset, designed to enhance the spatial perception capabilities of agents in VLN. The R2R-SR dataset includes 7,283 images categorized into 10 room classes, sourced from the Matterport3D (MP3D) simulator. To alleviate the imbalance in training data distribution across room categories, we propose a panoramic environment generation technique using Llava and Stable Diffusion for data Augmentation (LSDA). Our proposed LSDA-based model achieves a Top-1 accuracy of 75.9%, outperforming the best competitors in the convolutional neural network (CNN) and vision transformer (ViT) domains. The qualitative results highlight the model’s proficiency in identifying distinct features across various room categories, showcasing its effectiveness in indoor scene recognition tasks.
Förderung
- National Natural Science Foundation of China
- Key Scientific Research Platform and Project of Guangdong Provincial Education Department
Zitieren
APA
Zhang, H., Qi, Y., Zhao, M., & Liu, Y. (2026). Indoor Scene Recognition in Vision-and-Language Navigation. IEEE Transactions on Consumer Electronics, 72(1), 1216-1222. https://doi.org/10.1109/tce.2025.3645249
Vancouver
Zhang H, Qi Y, Zhao M, Liu Y. Indoor Scene Recognition in Vision-and-Language Navigation. IEEE Transactions on Consumer Electronics. 2026;72(1):1216-1222. doi:10.1109/tce.2025.3645249
BibTeX
@article{Zhang2026,
author = {Zhang, Hongtao and Qi, Yuankai and Zhao, Mingbo and Liu, Yuping},
title = {Indoor Scene Recognition in Vision-and-Language Navigation},
journal = {IEEE Transactions on Consumer Electronics},
year = {2026},
volume = {72},
number = {1},
pages = {1216--1222},
doi = {10.1109/tce.2025.3645249}
}
EUVIMED