EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision-Based Object Manipulation for Activities of Daily Living Assistance Using Assistive Robot

Md Tanzil Shahria, Jawhar Ghommam, Raouf Fareh, Mohammad Habibur Rahman

Automation · 15.04.2024 · 5 (2) · 68-89

DOI: 10.3390/automation5020006 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Automation, online erschienen am 15.04.2024. Verfasst von Md Tanzil Shahria und 3 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Institute on Disability, Independent Living, and Rehabilitation Research, NASA-Wisconsin Space Grant Consortium.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The increasing prevalence of upper and lower extremity (ULE) functional deficiencies presents a significant challenge, as it restricts individuals’ ability to perform daily tasks independently. Robotic devices are emerging as assistive devices to assist individuals with limited ULE functionalities in activities of daily living (ADLs). While assistive manipulators are available, manual control through traditional methods like joysticks can be cumbersome, particularly for individuals with severe hand impairments and vision limitations. Therefore, autonomous/semi-autonomous control of a robotic assistive device to perform any ADL task is open to research. This study addresses the necessity of fostering independence in ADLs by proposing a creative approach. We present a vision-based control system for a six-degrees-of-freedom (DoF) robotic manipulator designed for semi-autonomous “pick-and-place” tasks, one of the most common activities among ADLs. Our approach involves selecting and training a deep-learning-based object detection model with a dataset of 47 ADL objects, forming the base for a 3D ADL object localization algorithm. The proposed vision-based control system integrates this localization technique to identify and manipulate ADL objects (e.g., apples, oranges, capsicums, and cups) in real time, returning them to specific locations to complete the “pick-and-place” task. Experimental validation involving an xArm6 (six DoF) robot from UFACTORY in diverse settings demonstrates the system’s adaptability and effectiveness, achieving an overall 72.9% success rate in detecting, localizing, and executing ADL tasks. This research contributes to the growing field of autonomous assistive devices, enhancing independence for individuals with functional impairments.

Förderung

  • National Institute on Disability, Independent Living, and Rehabilitation Research
  • NASA-Wisconsin Space Grant Consortium

Zitieren

APA

Shahria, M. T., Ghommam, J., Fareh, R., & Rahman, M. H. (2024). Vision-Based Object Manipulation for Activities of Daily Living Assistance Using Assistive Robot. Automation, 5(2), 68-89. https://doi.org/10.3390/automation5020006

Vancouver

Shahria MT, Ghommam J, Fareh R, Rahman MH. Vision-Based Object Manipulation for Activities of Daily Living Assistance Using Assistive Robot. Automation. 2024;5(2):68-89. doi:10.3390/automation5020006

BibTeX
@article{Shahria2024,
  author = {Shahria, Md Tanzil and Ghommam, Jawhar and Fareh, Raouf and Rahman, Mohammad Habibur},
  title = {Vision-Based Object Manipulation for Activities of Daily Living Assistance Using Assistive Robot},
  journal = {Automation},
  year = {2024},
  volume = {5},
  number = {2},
  pages = {68--89},
  doi = {10.3390/automation5020006}
}
Kostenlos starten →