STOLA: Self-Adaptive Touch-Language Framework for Tactile Commonsense Reasoning in Open-Ended Scenarios
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (22) · 18198-18206
DOI: 10.1609/aaai.v40i22.38882 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Ning Cheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).
Abstract (Originalsprache)
This paper explores the challenges of integrating tactile sensing into intelligent systems for multimodal reasoning, particularly in enabling commonsense reasoning about the open-ended physical world. We identify two key challenges: modality discrepancy, where existing touch-language models often treat touch as a mere sub-modality of language without further addressing the semantic differences, and open-ended tactile data scarcity, where current datasets lack the diversity, open-endedness, and complexity needed for reasoning. To overcome these challenges, we introduce SToLa, a Self-Adaptive Touch-Language framework. SToLa utilizes Mixture of Experts (MoE) to dynamically process, unify, and manage tactile and language modalities, capturing their unique characteristics. Crucially, we also present a comprehensive tactile commonsense reasoning dataset and benchmark featuring free-form questions and responses, 8 physical properties, 4 interactive characteristics, and diverse commonsense knowledge. Experiments show SToLa exhibits competitive performance compared to existing models on the PHYSICLEAR benchmark and self-constructed datasets, proving the effectiveness of the Mixture of Experts architecture in multimodal management and the performance advantages for open-scenario tactile commonsense reasoning tasks.
Zitieren
APA
Cheng, N., Xu, J., Chen, J., Fang, B., & Han, W. (2026). STOLA: Self-Adaptive Touch-Language Framework for Tactile Commonsense Reasoning in Open-Ended Scenarios. Proceedings of the AAAI Conference on Artificial Intelligence, 40(22), 18198-18206. https://doi.org/10.1609/aaai.v40i22.38882
Vancouver
Cheng N, Xu J, Chen J, Fang B, Han W. STOLA: Self-Adaptive Touch-Language Framework for Tactile Commonsense Reasoning in Open-Ended Scenarios. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(22):18198-18206. doi:10.1609/aaai.v40i22.38882
BibTeX
@article{Cheng2026,
author = {Cheng, Ning and Xu, Jinan and Chen, Jialing and Fang, Bin and Han, Wenjuan},
title = {STOLA: Self-Adaptive Touch-Language Framework for Tactile Commonsense Reasoning in Open-Ended Scenarios},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {22},
pages = {18198--18206},
doi = {10.1609/aaai.v40i22.38882}
}
EUVIMED