EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Multimodal Autonomous Navigation by Fusing Visual and Tactile Perception for Deformable Obstacle Traversal

ZiTong Zhou

Academic Journal of Emerging Technologies · 20.05.2026 · 3 (1) · 83

DOI: 10.63313/ajet.9056 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Academic Journal of Emerging Technologies, online erschienen am 20.05.2026. Verfasst von ZiTong Zhou. Die Arbeit nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Autonomous mobile robots predominantly rely on visual perception for obstacle avoidance, which inherently treats all detected obstacles as rigid and impenetrable. However, in real-world environments, many obstacles such as curtains, vegetation, and flexible partitions are deformable and can be safely traversed with appropriate force control, yet visual appearance alone rarely provides reliable compliance information. This paper proposes a multimodal navigation framework that fuses exteroceptive visual sensing with proprioceptive tactile perception to assess the passability of ambiguous obstacles. A global visual planner generates an initial path, while a novel tactile-driven local passability classifier determines whether a frontal obstacle is rigid or soft. A custom CNN–LSTM network processes tactile time-series signals from a dedicated probing arm to output a haptic passability score. When a soft obstacle is identified, the navigation system activates an admittance controller to compliantly push through; otherwise, the obstacle is added to the costmap for re-planning. Simulations and real-robot experiments in environments containing curtains and artificial foliage demonstrate that the proposed visual–tactile fusion method reduces traveled distance by 22.3% and mission time by 18.7% compared to a pure vision-based detour approach, while maintaining a 100% hard-collision avoidance rate.

Zitieren

APA

Zhou, Z. (2026). Multimodal Autonomous Navigation by Fusing Visual and Tactile Perception for Deformable Obstacle Traversal. Academic Journal of Emerging Technologies, 3(1), 83. https://doi.org/10.63313/ajet.9056

Vancouver

Zhou Z. Multimodal Autonomous Navigation by Fusing Visual and Tactile Perception for Deformable Obstacle Traversal. Academic Journal of Emerging Technologies. 2026;3(1):83. doi:10.63313/ajet.9056

BibTeX
@article{Zhou2026,
  author = {Zhou, ZiTong},
  title = {Multimodal Autonomous Navigation by Fusing Visual and Tactile Perception for Deformable Obstacle Traversal},
  journal = {Academic Journal of Emerging Technologies},
  year = {2026},
  volume = {3},
  number = {1},
  pages = {83},
  doi = {10.63313/ajet.9056}
}
Kostenlos starten →