EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Human-swarm interaction for formation/flying control by enhanced vision-based hand gesture recognition system

Fatna Bent Ennebi Benabbou, Belkacem Khaldi, Sidi Mohammed Benslimane

Robotica · 2026-05 · 44 (5) · 1573-1607

DOI: 10.1017/s0263574726103725 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Robotica, online erschienen am 08.07.2026. Verfasst von Fatna Bent Ennebi Benabbou und 2 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study introduces an improved gesture-based human–swarm interaction control system for drone swarms that unifies motion and formation control while addressing the critical challenge of neglecting the impact of faulty robots on task performance. Unlike conventional approaches that treat these functionalities separately, our integrated framework enables robust task execution in challenging environments. Using 26 hand gestures (18 formations and 8 flight commands) processed by a variety of deep learning models, including convolutional neural networks (e.g., ResNet101 and MobileNetV2) and recurrent neural network-based approaches such as long short-term memory (LSTM), bidirectional LSTM, gated recurrent unit (GRU), and bidirectional GRU (BiGRU), the system provides comprehensive yet accessible control, notably through the BiGRU network with 99.4% accuracy in real-time gesture recognition tasks. Deployment testing conducted using the CrazyFlyt simulation platform demonstrated the system’s robustness in maintaining user-intended formations with low positional error and stable convergence times, even in the presence of sensor noise and faulty robots. Statistical analysis revealed highly significant main and interaction effects ( p less than 0.05 p < 0.05 $p\lt 0.05$ ) for swarm scale and scenario on performance metrics, indicating that the impact of swarm size is dynamically contingent upon environmental conditions. Post hoc evaluations predominantly highlighted significant performance degradation in faulty-robot scenarios compared to normal or noisy conditions, with swarm scale critically modulating these effects.

Zitieren

APA

Benabbou, F. B. E., Khaldi, B., & Benslimane, S. M. (2026). Human-swarm interaction for formation/flying control by enhanced vision-based hand gesture recognition system. Robotica, 44(5), 1573-1607. https://doi.org/10.1017/s0263574726103725

Vancouver

Benabbou FBE, Khaldi B, Benslimane SM. Human-swarm interaction for formation/flying control by enhanced vision-based hand gesture recognition system. Robotica. 2026;44(5):1573-1607. doi:10.1017/s0263574726103725

BibTeX
@article{Benabbou2026,
  author = {Benabbou, Fatna Bent Ennebi and Khaldi, Belkacem and Benslimane, Sidi Mohammed},
  title = {Human-swarm interaction for formation/flying control by enhanced vision-based hand gesture recognition system},
  journal = {Robotica},
  year = {2026},
  volume = {44},
  number = {5},
  pages = {1573--1607},
  doi = {10.1017/s0263574726103725}
}
Kostenlos starten →