EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Tactile Cognitive Model Based on Correlated Texture Information Entropy and Multimodal Fusion Learning

Si Chen iD, Chi Gao iD, Chen Chen, Weimin Ru, Ning Yang iD

Sensors · 17.09.2025 · 25 (18) · 5786

DOI: 10.3390/s25185786 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 17.09.2025. Verfasst von Si Chen und 4 weiteren Autor:innen. Beteiligte Einrichtung: Research Center of Fluid Machinery Engineering and Technology, Jiangsu University, Zhenjiang 212013, China. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation Funded Project, the Tribology Science Fund of State Key Laboratory of Tribology in Advanced Equipment.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

(1)

Background

Multimodal tactile cognition is paramount for robotic dexterity, yet its advancement is constrained by the limited realism of existing texture datasets and the difficulty of effectively fusing heterogeneous signals. This study introduces a comprehensive framework to overcome these limitations by integrating a parametrically designed dataset with a novel fusion architecture. (2)

Methods

To address the challenge of limited dataset realism, we developed a universal texture dataset that leverages information entropy and Perlin noise to simulate a wide spectrum of surfaces. To tackle the difficulty of signal fusion, we designed the Multimodal Fusion Attention Transformer Network (MFT-Net). This architecture strategically combines a Convolutional Neural Network (CNN) for local feature extraction with a Transformer for capturing global dependencies, and it utilizes a Squeeze-and-Excitation attention module for adaptive cross-modal weighting. (3)

Results

Evaluated on our custom-designed dataset, MFT-Net achieved a classification accuracy of 86.66%, surpassing traditional baselines by a significant margin of over 21.99%. Furthermore, an information-theoretic analysis confirmed the dataset’s efficacy by revealing a strong positive correlation between the textures’ physical information content and the model’s recognition performance. (4)

Conclusions

Our work establishes a novel design-verification paradigm that directly links physical information with machine perception. This approach provides a quantifiable methodology to enhance the generalization of tactile models, paving the way for improved robotic dexterity in complex, real-world environments.

Schlagwörter

Stichwörter der Autor:innen

information entropymultimodal signalstactile perceptiontexture recognitiontribologyvibroacoustics

Autor:innen und Institutionen

  • Research Center of Fluid Machinery Engineering and Technology, Jiangsu University, Zhenjiang 212013, China.
  • School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China.

ORCID-Profile: Si Chen, Chi Gao, Ning Yang

Förderung

  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation Funded Project
  • the Tribology Science Fund of State Key Laboratory of Tribology in Advanced Equipment
  • Tribology Science Fund of State Key Laboratory of Tribology in Advanced Equipment

Zitieren

APA

Chen, S., Gao, C., Chen, C., Ru, W., & Yang, N. (2025). A Tactile Cognitive Model Based on Correlated Texture Information Entropy and Multimodal Fusion Learning. Sensors, 25(18), 5786. https://doi.org/10.3390/s25185786

Vancouver

Chen S, Gao C, Chen C, Ru W, Yang N. A Tactile Cognitive Model Based on Correlated Texture Information Entropy and Multimodal Fusion Learning. Sensors. 2025;25(18):5786. doi:10.3390/s25185786

BibTeX
@article{Chen2025,
  author = {Chen, Si and Gao, Chi and Chen, Chen and Ru, Weimin and Yang, Ning},
  title = {A Tactile Cognitive Model Based on Correlated Texture Information Entropy and Multimodal Fusion Learning},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {18},
  pages = {5786},
  doi = {10.3390/s25185786}
}
Kostenlos starten →