EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?

Francisco Pastor, Da-Hui Lin-Yang, Alfonso J. García-Cerezo, Juan M. Gandarias

IEEE Sensors Journal · 01.06.2026 · 26 (11) · 17285-17293

DOI: 10.1109/jsen.2026.3684076 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Sensors Journal, erschienen am 01.06.2026. Verfasst von Francisco Pastor und 3 weiteren Autor:innen. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Málaga, Ministerio de Ciencia, Innovación y Universidades, Gobierno de España, CBUA.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Haptic perception arises from the integration of cutaneous and kinesthetic cues, yet achieving human-level tactile performance in robotic systems remains technically demanding and economically costly. This raises a fundamental question: how much does spatial resolution truly matter for robotic touch, and can kinesthetic inference compensate when tactile resolution is limited? To investigate this, we conduct a study on haptic object recognition using an underactuated, sensorized gripper equipped with a high-resolution tactile array and joint angle sensors. We evaluate a dataset of 36 objects collected under a squeeze-and-release exploratory procedure (EP). Tactile sequences are downsampled to four resolutions (100%, 75%, 50%, and 25%) using bicubic interpolation, and ConvLSTM-based models are trained to quantify accuracy degradation as spatial detail decreases. We then use two fusion strategies from our previous work: Bayesian inference and neural-based inference, which combine tactile and kinesthetic modalities, and assess whether kinesthetic cues can offset the loss of tactile precision. The results quantify the performance drop as tactile resolution decreases and uncover promising evidence that multimodal fusion can partially recover this lost capability. Interestingly, the two fusion methods exhibit distinct behaviors in terms of robustness and consistency. As discussed comprehensively in the article, these findings suggest that, under the right conditions, reliable object recognition may not depend solely on maintaining high tactile resolution, opening new possibilities for designing more scalable and cost-efficient haptic perception systems.

Förderung

  • University of Málaga, Ministerio de Ciencia, Innovación y Universidades, Gobierno de España
  • CBUA

Zitieren

APA

Pastor, F., Lin-Yang, D., García-Cerezo, A. J., & Gandarias, J. M. (2026). Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?. IEEE Sensors Journal, 26(11), 17285-17293. https://doi.org/10.1109/jsen.2026.3684076

Vancouver

Pastor F, Lin-Yang D, García-Cerezo AJ, Gandarias JM. Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?. IEEE Sensors Journal. 2026;26(11):17285-17293. doi:10.1109/jsen.2026.3684076

BibTeX
@article{Pastor2026,
  author = {Pastor, Francisco and Lin-Yang, Da-Hui and García-Cerezo, Alfonso J. and Gandarias, Juan M.},
  title = {Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?},
  journal = {IEEE Sensors Journal},
  year = {2026},
  volume = {26},
  number = {11},
  pages = {17285--17293},
  doi = {10.1109/jsen.2026.3684076}
}
Kostenlos starten →