EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization

Pedro Marques, Paulo Váz, José Silva, Pedro Martins, Maryam Abbasi

Electronics · 2025-02-12 · 14 (4) · 704

DOI: 10.3390/electronics14040704 ↗

At a glance

Journal article in Electronics, published online on 2025-02-12. Written by Pedro Marques and 4 co-authors. Cited 11 times so far (Crossref); 35 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Funds through the FCT—Foundation for Science and Technology, I.P., Research Center in Digital Services (CISeD), FCT—Foundation for Science and Technology, PI, through the institutional scientific employment program.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Gesture recognition technology has emerged as a transformative solution for natural and intuitive human–computer interaction (HCI), offering touch-free operation across diverse fields such as healthcare, gaming, and smart home systems. In mobile contexts, where hygiene, convenience, and the ability to operate under resource constraints are critical, hand gesture recognition provides a compelling alternative to traditional touch-based interfaces. However, implementing effective gesture recognition in real-world mobile settings involves challenges such as limited computational power, varying environmental conditions, and the requirement for robust offline–online data management. In this study, we introduce ThumbsUp, which is a gesture-driven system, and employ a partially systematic literature review approach (inspired by core PRISMA guidelines) to identify the key research gaps in mobile gesture recognition. By incorporating insights from deep learning–based methods (e.g., CNNs and Transformers) while focusing on low resource consumption, we leverage Google’s MediaPipe in our framework for real-time detection of 21 hand landmarks and adaptive lighting pre-processing, enabling accurate recognition of a “thumbs-up” gesture. The system features a secure queue-based offline–cloud synchronization model, which ensures that the captured images and metadata (encrypted with AES-GCM) remain consistent and accessible even with intermittent connectivity. Experimental results under dynamic lighting, distance variations, and partially cluttered environments confirm the system’s superior low-light performance and decreased resource consumption compared to baseline camera applications. Additionally, we highlight the feasibility of extending ThumbsUp to incorporate AI-driven enhancements for abrupt lighting changes and, in the future, electromyographic (EMG) signals for users with motor impairments. Our comprehensive evaluation demonstrates that ThumbsUp maintains robust performance on typical mobile hardware, showing resilience to unstable network conditions and minimal reliance on high-end GPUs. These findings offer new perspectives for deploying gesture-based interfaces in the broader IoT ecosystem, thus paving the way toward secure, efficient, and inclusive mobile HCI solutions.

Funding

  • National Funds through the FCT—Foundation for Science and Technology, I.P.
  • Research Center in Digital Services (CISeD)
  • FCT—Foundation for Science and Technology, PI, through the institutional scientific employment program

Cite

APA

Marques, P., Váz, P., Silva, J., Martins, P., & Abbasi, M. (2025). Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization. Electronics, 14(4), 704. https://doi.org/10.3390/electronics14040704

Vancouver

Marques P, Váz P, Silva J, Martins P, Abbasi M. Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization. Electronics. 2025;14(4):704. doi:10.3390/electronics14040704

BibTeX
@article{Marques2025,
  author = {Marques, Pedro and Váz, Paulo and Silva, José and Martins, Pedro and Abbasi, Maryam},
  title = {Real-Time Gesture-Based Hand Landmark Detection for Optimized Mobile Photo Capture and Synchronization},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {4},
  pages = {704},
  doi = {10.3390/electronics14040704}
}
Start for free →