EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid CRNN with Seq2Seq Attention Mechanism for Handwriting Recognition

Bhagwan Prasai, Avishek Gautam, Shruti Sapkota, Biniv Maharjan, Nirajan Acharya

International Journal on Engineering Technology · 18.06.2026 · 3 (2) · 1-14

DOI: 10.3126/injet.v3i2.95148 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal on Engineering Technology, online erschienen am 18.06.2026. Verfasst von Bhagwan Prasai und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Handwritten Text Recognition (HTR) faces significant challenges including limited annotated data, high handwriting variability, and complex character formations. This paper proposes a hybrid CRNN with Seq2Seq Bahdanau attention for robust HTR. The encoder employs a ten-layer CNN with residual connections for spatial feature extraction and Bidirectional LSTM for temporal modeling. The decoder uses Bahdanau attention to dynamically generate context vectors by focusing on relevant image regions at each decoding step, combining character embeddings and context vectors to produce character probabilities via SoftMax. To prevent overfitting with limited data, comprehensive regularization is applied: dropout (0.3), weight decay (1e-4), label smoothing (0.1), stochastic depth (0.1), exponential moving average (EMA), stochastic weight averaging (SWA), adaptive teacher forcing decay, cosine annealing, and layer-wise learning rate decay, supplemented by light augmentation. Evaluation on the IAM handwriting dataset demonstrates 13.59% WER and 4.28% CER (86.41%-word level accuracy, 95.72%-character level accuracy), outperforming recent comparable CRNN-based methods. Attention visualizations confirm meaningful spatial-sequential alignment, with diagonal attention patterns indicating systematic left-to-right character progression. These results validate that attention-based sequence modeling combined with systematic regularization achieves robust HTR performance in data-limited scenarios without relying on synthetic data or external lexicons.

Zitieren

APA

Prasai, B., Gautam, A., Sapkota, S., Maharjan, B., & Acharya, N. (2026). Hybrid CRNN with Seq2Seq Attention Mechanism for Handwriting Recognition. International Journal on Engineering Technology, 3(2), 1-14. https://doi.org/10.3126/injet.v3i2.95148

Vancouver

Prasai B, Gautam A, Sapkota S, Maharjan B, Acharya N. Hybrid CRNN with Seq2Seq Attention Mechanism for Handwriting Recognition. International Journal on Engineering Technology. 2026;3(2):1-14. doi:10.3126/injet.v3i2.95148

BibTeX
@article{Prasai2026,
  author = {Prasai, Bhagwan and Gautam, Avishek and Sapkota, Shruti and Maharjan, Biniv and Acharya, Nirajan},
  title = {Hybrid CRNN with Seq2Seq Attention Mechanism for Handwriting Recognition},
  journal = {International Journal on Engineering Technology},
  year = {2026},
  volume = {3},
  number = {2},
  pages = {1--14},
  doi = {10.3126/injet.v3i2.95148}
}
Kostenlos starten →