EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

Yue Jiang, Lin Fan, Xilong Sun, Zehe Luo, Herong Wang, Rucong Lai, Jie Wang, Qiyang Gan, Ning Li iD, Jindong Tian iD

Advanced Science · 2024-11 · 11 (41)

DOI: 10.1002/advs.202402705 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Science, online erschienen am 09.09.2024. Verfasst von Yue Jiang und 9 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineeri…. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, National funded postdoctoral researcher program of China, Postdoctoral Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Humans recognize and manipulate objects relying on the multidimensional force features captured by the tactile sense of skin during the manipulation. Since the current sensors integrated in robots cannot support the robots to sense the multiple interaction states between manipulator and objects, achieving human‐like perception and analytical capabilities remains a major challenge for service robots. Prompted by the tactile perception involved in robots performing complex tasks, a multimodal tactile sensory system is presented to provide in situ simultaneous sensing for robots when approaching, touching, and manipulating objects. The system comprises a capacitive sensor owning the high sensitivity of 1.11E‐2 pF mm −1 , a triboelectricity nanogenerator with the fast response speed of 30 ms, and a pressure sensor array capable of 3D force detection. By Combining transfer learning models, which fuses multimodal tactile information to achieve high‐precision (up to 95%) recognition of the multi‐featured targets such as random hardness and texture information under random sampling conditions, including random grasp force and velocity. This sensory system is expected to enhance the intelligent recognition and behavior‐planning capabilities of autonomous robots when performing complex tasks in undefined surrounding environments.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsHumansTouchTouch PerceptionEquipment Design

Stichwörter der Autor:innen

MXeneinteraction state perceptionlotus nanofibermultimodal tactilemulti‐feature recognition

Autor:innen und Institutionen

  • Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, 518060, China.
  • College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518060, China.
  • Guangdong Laboratory of Artificial Intelligence and Digital Economy (Shenzhen), Shenzhen University, Shenzhen, 518132, China.
  • Institute of Applied Physics and Materials Engineering, University of Macau, Macao, 999078, China.

ORCID-Profile: Ning Li, Jindong Tian

Förderung

  • National Natural Science Foundation of China
  • National funded postdoctoral researcher program of China
  • Postdoctoral Science Foundation of China
  • Natural Science Foundation of Shenzhen Municipality

Zitieren

APA

Jiang, Y., Fan, L., Sun, X., Luo, Z., Wang, H., Lai, R., Wang, J., Gan, Q., Li, N., & Tian, J. (2024). A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception. Advanced Science, 11(41). https://doi.org/10.1002/advs.202402705

Vancouver

Jiang Y, Fan L, Sun X, Luo Z, Wang H, Lai R, et al. A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception. Advanced Science. 2024;11(41). doi:10.1002/advs.202402705

BibTeX
@article{Jiang2024,
  author = {Jiang, Yue and Fan, Lin and Sun, Xilong and Luo, Zehe and Wang, Herong and Lai, Rucong and Wang, Jie and Gan, Qiyang and Li, Ning and Tian, Jindong},
  title = {A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception},
  journal = {Advanced Science},
  year = {2024},
  volume = {11},
  number = {41},
  doi = {10.1002/advs.202402705}
}
Kostenlos starten →