EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization

Pedro Marques, Paulo Váz, José Silva, Pedro Martins, Maryam Abbasi

Electronics · 12.02.2025 · 14 (4) · 704

DOI: 10.3390/electronics14040704 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 12.02.2025. Verfasst von Pedro Marques und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Funds through the FCT—Foundation for Science and Technology, I.P., Research Center in Digital Services (CISeD), FCT—Foundation for Science and Technology, PI, through the institutional scientific employment program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Gesture recognition technology has emerged as a transformative solution for natural and intuitive human–computer interaction (HCI), offering touch-free operation across diverse fields such as healthcare, gaming, and smart home systems. In mobile contexts, where hygiene, convenience, and the ability to operate under resource constraints are critical, hand gesture recognition provides a compelling alternative to traditional touch-based interfaces. However, implementing effective gesture recognition in real-world mobile settings involves challenges such as limited computational power, varying environmental conditions, and the requirement for robust offline–online data management. In this study, we introduce ThumbsUp, which is a gesture-driven system, and employ a partially systematic literature review approach (inspired by core PRISMA guidelines) to identify the key research gaps in mobile gesture recognition. By incorporating insights from deep learning–based methods (e.g., CNNs and Transformers) while focusing on low resource consumption, we leverage Google’s MediaPipe in our framework for real-time detection of 21 hand landmarks and adaptive lighting pre-processing, enabling accurate recognition of a “thumbs-up” gesture. The system features a secure queue-based offline–cloud synchronization model, which ensures that the captured images and metadata (encrypted with AES-GCM) remain consistent and accessible even with intermittent connectivity. Experimental results under dynamic lighting, distance variations, and partially cluttered environments confirm the system’s superior low-light performance and decreased resource consumption compared to baseline camera applications. Additionally, we highlight the feasibility of extending ThumbsUp to incorporate AI-driven enhancements for abrupt lighting changes and, in the future, electromyographic (EMG) signals for users with motor impairments. Our comprehensive evaluation demonstrates that ThumbsUp maintains robust performance on typical mobile hardware, showing resilience to unstable network conditions and minimal reliance on high-end GPUs. These findings offer new perspectives for deploying gesture-based interfaces in the broader IoT ecosystem, thus paving the way toward secure, efficient, and inclusive mobile HCI solutions.

Förderung

  • National Funds through the FCT—Foundation for Science and Technology, I.P.
  • Research Center in Digital Services (CISeD)
  • FCT—Foundation for Science and Technology, PI, through the institutional scientific employment program

Zitieren

APA

Marques, P., Váz, P., Silva, J., Martins, P., & Abbasi, M. (2025). Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization. Electronics, 14(4), 704. https://doi.org/10.3390/electronics14040704

Vancouver

Marques P, Váz P, Silva J, Martins P, Abbasi M. Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization. Electronics. 2025;14(4):704. doi:10.3390/electronics14040704

BibTeX
@article{Marques2025,
  author = {Marques, Pedro and Váz, Paulo and Silva, José and Martins, Pedro and Abbasi, Maryam},
  title = {Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {4},
  pages = {704},
  doi = {10.3390/electronics14040704}
}
Kostenlos starten →