EUVIMEDEUVIMED entdecken
Crossref

AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones

Qiuyang Zeng, Fan Li, Zhiyuan Zhao, Youqi Li, Yu Wang

IEEE Transactions on Mobile Computing · 2024-08 · 23 (8) · 8557-8568

DOI: 10.1109/tmc.2024.3351484 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-08. Verfasst von Qiuyang Zeng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 29 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Off-screen handwriting recognition enriches the handwriting interaction paradigm for mobile devices. However, the existing approaches are only applicable to the specific environment and equipment conditions. In this article, we propose AcouWrite, a general, scalable and real-time handwriting recognition system based on active acoustic sensing. In detail, AcouWrite relies on active acoustic sensing using only a pair of microphones and speakers on the smartphone to capture real-time handwriting input. Particularly, we extract the short-time dCIR (st-dCIR) to monitor the changes in the acoustic transmission channel resulting from finger movement. Technically, we use a CNN-GRU classifier to complete the recognition task in AcouWrite. Moreover, we use data augmentation and spelling error correction methods to improve AcouWrite's robustness. To improve the generalization of our AcouWrite for new characters, we incorporate the transfer learning module into our AcouWrite. In various real-world environments, experiments demonstrate that AcouWrite achieves a mean recognition accuracy of 97.62%, a word accuracy (WA) of 96.4% and a character error rate (CER) of 1.5% for 100 common words, and an average response time of 94 milliseconds.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zeng, Q., Li, F., Zhao, Z., Li, Y., & Wang, Y. (2024). AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones. IEEE Transactions on Mobile Computing, 23(8), 8557-8568. https://doi.org/10.1109/tmc.2024.3351484

Vancouver

Zeng Q, Li F, Zhao Z, Li Y, Wang Y. AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones. IEEE Transactions on Mobile Computing. 2024;23(8):8557-8568. doi:10.1109/tmc.2024.3351484

BibTeX
@article{Zeng2024,
  author = {Zeng, Qiuyang and Li, Fan and Zhao, Zhiyuan and Li, Youqi and Wang, Yu},
  title = {AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {8},
  pages = {8557--8568},
  doi = {10.1109/tmc.2024.3351484}
}
Kostenlos starten →