AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones
IEEE Transactions on Mobile Computing · 2024-08 · 23 (8) · 8557-8568
DOI: 10.1109/tmc.2024.3351484 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-08. Verfasst von Qiuyang Zeng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 29 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Off-screen handwriting recognition enriches the handwriting interaction paradigm for mobile devices. However, the existing approaches are only applicable to the specific environment and equipment conditions. In this article, we propose AcouWrite, a general, scalable and real-time handwriting recognition system based on active acoustic sensing. In detail, AcouWrite relies on active acoustic sensing using only a pair of microphones and speakers on the smartphone to capture real-time handwriting input. Particularly, we extract the short-time dCIR (st-dCIR) to monitor the changes in the acoustic transmission channel resulting from finger movement. Technically, we use a CNN-GRU classifier to complete the recognition task in AcouWrite. Moreover, we use data augmentation and spelling error correction methods to improve AcouWrite's robustness. To improve the generalization of our AcouWrite for new characters, we incorporate the transfer learning module into our AcouWrite. In various real-world environments, experiments demonstrate that AcouWrite achieves a mean recognition accuracy of 97.62%, a word accuracy (WA) of 96.4% and a character error rate (CER) of 1.5% for 100 common words, and an average response time of 94 milliseconds.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zeng, Q., Li, F., Zhao, Z., Li, Y., & Wang, Y. (2024). AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones. IEEE Transactions on Mobile Computing, 23(8), 8557-8568. https://doi.org/10.1109/tmc.2024.3351484
Vancouver
Zeng Q, Li F, Zhao Z, Li Y, Wang Y. AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones. IEEE Transactions on Mobile Computing. 2024;23(8):8557-8568. doi:10.1109/tmc.2024.3351484
BibTeX
@article{Zeng2024,
author = {Zeng, Qiuyang and Li, Fan and Zhao, Zhiyuan and Li, Youqi and Wang, Yu},
title = {AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones},
journal = {IEEE Transactions on Mobile Computing},
year = {2024},
volume = {23},
number = {8},
pages = {8557--8568},
doi = {10.1109/tmc.2024.3351484}
}
EUVIMED