EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Speckle Skin‐Based Multimodal Tactile Perception for Fine Robotic Manipulation

Jiayuan Zhang, Chong Wang, Yingao Xu, Shihan Wang, Houping Wu, Yulian Peng, Hongbo Wang

Advanced Intelligent Systems · 2026-07 · 8 (7)

DOI: 10.1002/aisy.70420 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 08.05.2026. Verfasst von Jiayuan Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundamental Research Funds for the Central Universities of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tactile sensing is crucial for providing physical interaction between the robotic hand and objects, enabling effective and safe grasping and manipulation. Vision‐based tactile sensors have gained increasing popularity due to their high spatial resolution and extensibility. Currently, most vision‐based tactile sensors utilize either the marker array tracking method or the photometric stereo method. Spatial resolution of the marker array is constrained by the density of markers, while the photometric stereo approach requires complex illumination. Herein, we propose a miniature vision‐based tactile sensor exploiting a speckle skin, namely, SpeckleTac . By applying a dense optical flow method with adaptive Kalman filtering and dynamic weight fusion, high‐resolution and accurate 2D displacement fields are obtained, and subsequently the reconstruction of the 3D surface. Then, contact object classification and pose estimation are realized through a ResNet‐based architecture, SPTacNet, integrated with squeeze‐and‐excitation (SE) residual blocks. Furthermore, by incorporating a TV‐regularized iFEM method, contact pressure distribution and 6‐axis force and torque are obtained. We demonstrate that the SpeckleTac can accurately locate the centroid of an unknown object, enabling stable grasping and facilitating safe handling of blood samples in glass tubes. This work provides a promising solution for multimodal tactile perception of robotic hands in “real‐world” applications.

Förderung

  • Fundamental Research Funds for the Central Universities of China

Zitieren

APA

Zhang, J., Wang, C., Xu, Y., Wang, S., Wu, H., Peng, Y., & Wang, H. (2026). Speckle Skin‐Based Multimodal Tactile Perception for Fine Robotic Manipulation. Advanced Intelligent Systems, 8(7). https://doi.org/10.1002/aisy.70420

Vancouver

Zhang J, Wang C, Xu Y, Wang S, Wu H, Peng Y, et al. Speckle Skin‐Based Multimodal Tactile Perception for Fine Robotic Manipulation. Advanced Intelligent Systems. 2026;8(7). doi:10.1002/aisy.70420

BibTeX
@article{Zhang2026,
  author = {Zhang, Jiayuan and Wang, Chong and Xu, Yingao and Wang, Shihan and Wu, Houping and Peng, Yulian and Wang, Hongbo},
  title = {Speckle Skin‐Based Multimodal Tactile Perception for Fine Robotic Manipulation},
  journal = {Advanced Intelligent Systems},
  year = {2026},
  volume = {8},
  number = {7},
  doi = {10.1002/aisy.70420}
}
Kostenlos starten →