EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Transformer-Based OCR System for Handwritten Signature Verification in Lawmaking Petitions: A Proof of Concept

Elena Sánchez-Nielsen, Ismael Martín-Herrera

IEEE Access · 2025 · 13 · 177573-177594

DOI: 10.1109/access.2025.3620686 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Elena Sánchez-Nielsen und 1 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia e Innovación.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Handwritten signature verification (HSV) is essential for validating lawmaking petitions, where each signatory provides a handwritten signature and a personal identifier (ID). Manual verification is slow and error-prone due to large petition volumes and handwriting variability. This paper presents a methodology for automated HSV: an end-to-end transformer-based OCR pipeline built on TrOCR, a state-of-the-art model for text recognition. While TrOCR focuses on cropped text segments, the proposed methodology extends it to full-document, integrated processing. It performs document structure detection, ID recognition, handwritten signature detection, and ID–signature pairing within a unified framework. As part of the methodology, we developed a synthetic handwriting generation method to create training data, addressing data scarcity and protecting privacy without using real personal information. The system was developed in collaboration with the Parliament of the Canary Islands, ensuring institutional alignment and practical applicability. Evaluation considered post-processing, model fine-tuning, and dataset scale. The pipeline achieved 98.9% character recognition and 90.5% complete ID recognition on synthetic data, and 84.3% character recognition and 80.0% ID recognition on real petition images. In comparison, a convolutional recurrent neural network (CRNN) baseline achieved 81.2% character recognition and 12.6% ID recognition on synthetic data, and 66.2% and 7.4% on real petitions. Post-processing improved recognition for non-fine-tuned models, while fine-tuning on larger datasets was crucial for high accuracy and generalization. In conclusion, this methodology demonstrates that extending TrOCR into a full-document, transformer-based pipeline provides a scalable and privacy-preserving solution for HSV in legislative processes, outperforming conventional neural networks and reducing manual verification workload.

Förderung

  • Ministerio de Ciencia e Innovación

Zitieren

APA

Sánchez-Nielsen, E., & Martín-Herrera, I. (2025). Transformer-Based OCR System for Handwritten Signature Verification in Lawmaking Petitions: A Proof of Concept. IEEE Access, 13, 177573-177594. https://doi.org/10.1109/access.2025.3620686

Vancouver

Sánchez-Nielsen E, Martín-Herrera I. Transformer-Based OCR System for Handwritten Signature Verification in Lawmaking Petitions: A Proof of Concept. IEEE Access. 2025;13:177573-177594. doi:10.1109/access.2025.3620686

BibTeX
@article{SnchezNielsen2025,
  author = {Sánchez-Nielsen, Elena and Martín-Herrera, Ismael},
  title = {Transformer-Based OCR System for Handwritten Signature Verification in Lawmaking Petitions: A Proof of Concept},
  journal = {IEEE Access},
  year = {2025},
  volume = {13},
  pages = {177573--177594},
  doi = {10.1109/access.2025.3620686}
}
Kostenlos starten →