Constraint-Aware Multimodal Bin Grasping and Singulation in Cluttered Environments
AI · 03.11.2026 · 7 (11) · 455
DOI: 10.3390/ai7110455 ↗Kurz gefasst
Fachartikel in der Zeitschrift AI, online erschienen am 03.11.2026. Verfasst von Muhammad Arsalan und 5 weiteren Autor:innen. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Rigid container walls invalidate the open-workspace assumptions of tabletop manipulation, leaving three coupled gaps: unconstrained trajectories can be wall-unsafe, single-point grasp checks reject accessible offset positions, and occlusion-removal actions can ignore wall proximity. This paper treats bin wall geometry as a first-class constraint. A multimodal framework couples YOLO11 instance segmentation with a radial-basis-function support vector machine (SVM) and geometric rules to select among five modes—direct grasping, height-based grasping, two-dimensional singulation, and partial and full occlusion removal based on target visibility, relative height, grasp feasibility and wall proximity. Every trajectory passes a common wall-constraint validator before reaching the controller. Experiments used a UR5e with an overhead RGB-D camera. YOLOv11m-Segmentation model reached 0.992 box and 0.991 mask mAP@0.5 with an average inference time of 0.4350 ± 0.11 s. Task success was 100.0%, 93.3%, and 86.66% at low, medium, and high clutter (30 trials per condition). At high clutter, the ablation increased TSR from 66.66% for the single-point wall-unaware baseline to 83.33% with multi-point grasp selection and 86.66% with wall-aware singulation. The proposed system achieved a 90% Task Success Rate (TSR), compared with Target-Oriented VPG, which achieved 60% TSR, and GraspNet with bin-wall constraints, which achieved 40% TSR with 10 trials in a high-clutter environment. Across the 90 proposed-system trials, six task failures were observed, but none involved wall contact. Because container awareness sits in the planning layer rather than the end-effector, the method retrofits to installed cells using standard two-finger hardware.
Zitieren
APA
Arsalan, M., Imran, A., Khan, S. A., Ullah, I., Aqeel, K., & Siddique, M. F. (2026). Constraint-Aware Multimodal Bin Grasping and Singulation in Cluttered Environments. AI, 7(11), 455. https://doi.org/10.3390/ai7110455
Vancouver
Arsalan M, Imran A, Khan SA, Ullah I, Aqeel K, Siddique MF. Constraint-Aware Multimodal Bin Grasping and Singulation in Cluttered Environments. AI. 2026;7(11):455. doi:10.3390/ai7110455
BibTeX
@article{Arsalan2026,
author = {Arsalan, Muhammad and Imran, Abid and Khan, Saud Ahmed and Ullah, Ikram and Aqeel, Kamran and Siddique, Muhammad Farooq},
title = {Constraint-Aware Multimodal Bin Grasping and Singulation in Cluttered Environments},
journal = {AI},
year = {2026},
volume = {7},
number = {11},
pages = {455},
doi = {10.3390/ai7110455}
}
EUVIMED