EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Beyond Signatures: Leveraging Sensor Fusion for Contextual Handwriting Recognition

Alen Salkanovic iD, Diego Sušanj iD, Luka Batistić iD, Sandi Ljubic iD

Sensors · 2025

DOI: 10.3390/s25072290 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Alen Salkanovic und 3 weiteren Autor:innen. Beteiligte Einrichtung: University of Rijeka, Faculty of Engineering, Vukovarska 58, HR-51000 Rijeka, Croatia. Hauptthemen laut MEDLINE: Handwriting, Biometric Identification, Pattern Recognition, Automated. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Rijeka.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper deals with biometric identification based on unique patterns and characteristics of an individual’s handwriting, focusing on the dynamic writing process on a touchscreen device. Related work in this domain indicates the dominance of specific research approaches. Namely, in most cases, only the signature is analyzed, verification methods are more prevalent than recognition methods, and the provided solutions are mainly based on using a particular device or specific sensor for collecting biometric data. In this context, our work aims to fill the identified research gap by introducing a new handwriting-based user recognition technique. The proposed approach implements the concept of sensor fusion and does not rely exclusively on signatures for recognition but also includes other forms of handwriting, such as short sentences, words, or individual letters. Additionally, two different ways of handwriting input, using a stylus and a finger, are introduced into the analysis. In order to collect data on the dynamics of handwriting and signing, a specially designed apparatus was used with various sensors integrated into common smart devices, along with additional external sensors and accessories. A total of 60 participants took part in a controlled experiment to form a handwriting biometrics dataset for further analysis. To classify participants’ handwriting, custom architecture CNN models were utilized for feature extraction and classification tasks. The obtained results showed that the proposed handwriting recognition system achieves accuracies of 0.982, 0.927, 0.884, and 0.661 for signatures, words, short sentences, and individual letters, respectively. We further investigated the main effects of the input modality and the train set’s size on the system’s accuracy. Finally, an ablation study was carried out to analyze the impact of individual sensors within the fusion-based setup.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

HandwritingBiometric IdentificationPattern Recognition, AutomatedHumansMaleNeural Networks, ComputerFemaleAlgorithmsAdult

Stichwörter der Autor:innen

authenticationbiometricsdigital signatureshandwriting recognitionsensor fusion

Autor:innen und Institutionen

  • University of Rijeka, Faculty of Engineering, Vukovarska 58, HR-51000 Rijeka, Croatia.
  • Center for Artificial Intelligence and Cybersecurity, University of Rijeka, R. Matejcic 2, HR-51000 Rijeka, Croatia.
  • Faculty of Engineering, Juraj Dobrila University of Pula, Alga Negrija 6, HR-52100 Pula, Croatia.

ORCID-Profile: Alen Salkanovic, Diego Sušanj, Luka Batistić, Sandi Ljubic

Förderung

  • University of Rijeka

Zitieren

APA

Salkanovic, A., Sušanj, D., Batistić, L., & Ljubic, S. (2025). Beyond Signatures: Leveraging Sensor Fusion for Contextual Handwriting Recognition. Sensors. https://doi.org/10.3390/s25072290

Vancouver

Salkanovic A, Sušanj D, Batistić L, Ljubic S. Beyond Signatures: Leveraging Sensor Fusion for Contextual Handwriting Recognition. Sensors. 2025. doi:10.3390/s25072290

BibTeX
@article{Salkanovic2025,
  author = {Salkanovic, Alen and Sušanj, Diego and Batistić, Luka and Ljubic, Sandi},
  title = {Beyond Signatures: Leveraging Sensor Fusion for Contextual Handwriting Recognition},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25072290}
}
Kostenlos starten →