EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

A Luminous Pen for Air-Writing: Hybrid Approach with Computer Vision and Vision–Language Models

Luma T. L. de Souza, Rafael A. D. Caldeira, Sérgio D. C. Leal, Maria Clara P. de Souza, Thiago M. Paixão, Richard J. M. G. Tello

Revista de Informática Teórica e Aplicada · 10.03.2026 · 33 (2) · 52-57

DOI: 10.22456/2175-2745.150973 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Revista de Informática Teórica e Aplicada, online erschienen am 10.03.2026. Verfasst von Luma T. L. de Souza und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Air writing is a form of human–computer interaction that enables users to write in the air through different technological approaches, such as radio waves, wearable sensors, dedicated devices, and computer vision. In this work, we present a hybrid solution that combines the use of a luminous-tip pen with computer vision techniques to support pen detection and the air-writing process. The pen was designed and fabricated with a 3D printer and integrates an ESP32 microcontroller board, which provides Bluetooth connectivity for real-time communication with the computer. In addition to tracking movements for writing, the device can transmit specific commands to the system, such as starting or stopping the writing process and changing colors. This approach bridges the gap between wearable devices and vision-based methods, offering a practical and accessible alternative for air-writing applications. The system integrates vision–language models capable of recognizing both words and images. To determine which models were best suited for our system, we evaluated the performance of several candidates. Five participants contributed to the creation of the dataset. For drawing recognition, each participant produced images in the following classes: Tree, Moon, Cat, Heart, and Pen. For word recognition, the dataset included the following eight words: Purple, Window, Jungle, Pillow, Team, Doctor, Words, and Science. The results showed that the best-performing models achieved 76.00% accuracy with Kosmos-2 for image detection and 97.39% accuracy with Gemini 2.5 Flash for word detection, demonstrating satisfactory outcomes for the system implementation. The proposed system demonstrates the potential of combining electronic devices and advanced machine learning techniques for air-writing, with applications in education and assistive technologies.

Zitieren

APA

Souza, L. T. L. D., Caldeira, R. A. D., Leal, S. D. C., Souza, M. C. P. D., Paixão, T. M., & Tello, R. J. M. G. (2026). A Luminous Pen for Air-Writing: Hybrid Approach with Computer Vision and Vision–Language Models. Revista de Informática Teórica e Aplicada, 33(2), 52-57. https://doi.org/10.22456/2175-2745.150973

Vancouver

Souza LTLD, Caldeira RAD, Leal SDC, Souza MCPD, Paixão TM, Tello RJMG. A Luminous Pen for Air-Writing: Hybrid Approach with Computer Vision and Vision–Language Models. Revista de Informática Teórica e Aplicada. 2026;33(2):52-57. doi:10.22456/2175-2745.150973

BibTeX
@article{Souza2026,
  author = {Souza, Luma T. L. de and Caldeira, Rafael A. D. and Leal, Sérgio D. C. and Souza, Maria Clara P. de and Paixão, Thiago M. and Tello, Richard J. M. G.},
  title = {A Luminous Pen for Air-Writing: Hybrid Approach with Computer Vision and Vision–Language Models},
  journal = {Revista de Informática Teórica e Aplicada},
  year = {2026},
  volume = {33},
  number = {2},
  pages = {52--57},
  doi = {10.22456/2175-2745.150973}
}
Kostenlos starten →