EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MTSTR: Multi-task learning for low-resolution scene text recognition via dual attention mechanism and its application in logistics industry

Herui Heng iD, Si Li, Peiji Li, Qianfeng Lin, Yufen Chen, Lei Zhang

PLOS ONE · 12.12.2023 · 18 (12) · e0294943

DOI: 10.1371/journal.pone.0294943 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 12.12.2023. Verfasst von Herui Heng und 5 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai, China. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recognizing texts in images plays an important role in many applications, such as industrial intelligence, robot vision, automatic driving, command assistance, and scene understanding. Although great progress has been achieved in various fields, research on complex systems modeling using text recognition technology requires further attention. To address this, we propose a new end-to-end multi-task learning method, which includes a super-resolution branch (SRB) and a recognition branch. To effectively learn the semantic information of images, we utilize the feature pyramid network (FPN) to fuse high- and low-level semantic information. The feature map generated by FPN is then delivered separately to the super-resolution branch and the recognition branch. We introduce a novel super-resolution branch, the SRB based on the proposed dual attention mechanism (DAM), designed to enhance the capability of learning low-resolution text features. The DAM incorporates the residual channel attention to enhance channel dependencies and the character attention module to focus on context information. For the recognition branch, the feature map generated by FPN is fed into an RNN sequence module, and an attention-based decoder is constructed to predict the results. To address the issue of low-resolution text recognition in numerous Chinese scenes, we propose the Chinese super-resolution datasets instead of relying on traditional down-sampling techniques to generate training datasets. Experiments demonstrate that the proposed method performs robustly on low-resolution text images and achieves competitive results on benchmark datasets.

Autor:innen und Institutionen

  • Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai, China.
  • Institute of Logistics, Yunda Express Co., Ltd, Shanghai, China.
  • Department of Computer Engineering, Korea Maritime and Ocean University, Busan, South Korea.
  • School of Automation, Northwestern Polytechnical University, Shanxi, China.

ORCID-Profile: Herui Heng

Zitieren

APA

Heng, H., Li, S., Li, P., Lin, Q., Chen, Y., & Zhang, L. (2023). MTSTR: Multi-task learning for low-resolution scene text recognition via dual attention mechanism and its application in logistics industry. PLOS ONE, 18(12), e0294943. https://doi.org/10.1371/journal.pone.0294943

Vancouver

Heng H, Li S, Li P, Lin Q, Chen Y, Zhang L. MTSTR: Multi-task learning for low-resolution scene text recognition via dual attention mechanism and its application in logistics industry. PLOS ONE. 2023;18(12):e0294943. doi:10.1371/journal.pone.0294943

BibTeX
@article{Heng2023,
  author = {Heng, Herui and Li, Si and Li, Peiji and Lin, Qianfeng and Chen, Yufen and Zhang, Lei},
  title = {MTSTR: Multi-task learning for low-resolution scene text recognition via dual attention mechanism and its application in logistics industry},
  journal = {PLOS ONE},
  year = {2023},
  volume = {18},
  number = {12},
  pages = {e0294943},
  doi = {10.1371/journal.pone.0294943}
}
Kostenlos starten →