EUVIMEDEUVIMED entdecken
Crossref

GLaLT: Global-Local Attention-Augmented Light Transformer for Scene Text Recognition

Hui Zhang, Guiyang Luo, Jian Kang, Shan Huang, Xiao Wang, Fei-Yue Wang

IEEE Transactions on Neural Networks and Learning Systems · 2024-07 · 35 (7) · 10145-10158

DOI: 10.1109/tnnls.2023.3239696 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Neural Networks and Learning Systems, 2024-07. Verfasst von Hui Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref). Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent years have witnessed the growing popularity of connectionist temporal classification (CTC) and attention mechanism in scene text recognition (STR). CTC-based methods consume less time with few computational burdens, while they are not as effective as attention-based methods. To retain computational efficiency and effectiveness, we propose the global-local attention-augmented light Transformer (GLaLT), which adopts a Transformer-based encoder-decoder structure to orchestrate CTC and attention mechanism. The encoder integrates the self-attention module with the convolution module to augment the attention, where the self-attention module pays more attention to capturing long-term global dependencies and the convolution module focuses on local context modeling. The decoder consists of two parallel modules: one is the Transformer-decoder-based attention module and the other is the CTC module. The first one is removed in the testing phase and can guide the second one to extract robust features in the training phase. Extensive experiments on standard benchmarks demonstrate that GLaLT achieves state-of-the-art performance for both regular and irregular STR. In terms of tradeoffs, the proposed GLaLT is at or near the frontiers for maximizing speed, accuracy, and computational efficiency at the same time.

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China

Zitieren

APA

Zhang, H., Luo, G., Kang, J., Huang, S., Wang, X., & Wang, F. Y. (2024). GLaLT: Global-Local Attention-Augmented Light Transformer for Scene Text Recognition. IEEE Transactions on Neural Networks and Learning Systems, 35(7), 10145-10158. https://doi.org/10.1109/tnnls.2023.3239696

Vancouver

Zhang H, Luo G, Kang J, Huang S, Wang X, Wang FY. GLaLT: Global-Local Attention-Augmented Light Transformer for Scene Text Recognition. IEEE Transactions on Neural Networks and Learning Systems. 2024;35(7):10145-10158. doi:10.1109/tnnls.2023.3239696

BibTeX
@article{Zhang2024,
  author = {Zhang, Hui and Luo, Guiyang and Kang, Jian and Huang, Shan and Wang, Xiao and Wang, Fei-Yue},
  title = {GLaLT: Global-Local Attention-Augmented Light Transformer for Scene Text Recognition},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2024},
  volume = {35},
  number = {7},
  pages = {10145--10158},
  doi = {10.1109/tnnls.2023.3239696}
}
Kostenlos starten →