Spoken Spanish PoS tagging: gold standard dataset
Language Resources and Evaluation · 2025-06 · 59 (2) · 983-1012
DOI: 10.1007/s10579-024-09751-x ↗Kurz gefasst
Fachartikel in der Zeitschrift Language Resources and Evaluation, online erschienen am 02.07.2024. Verfasst von Johnatan E. Bonilla. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fonds Wetenschappelijk Onderzoek, Humboldt-Universität zu Berlin.
Abstract (Originalsprache)
The development of a benchmark for part-of-speech (PoS) tagging of spoken dialectal European Spanish is presented, which will serve as the foundation for a future treebank. The benchmark is constructed using transcriptions of the Corpus Oral y Sonoro del Español Rural (COSER;“Audible corpus of spoken rural Spanish”) and follows the Universal Dependencies project guidelines. We describe the methodology used to create a gold standard, which serves to evaluate different state-of-the-art PoS taggers (spaCy, Stanza NLP, and UDPipe), originally trained on written data and to fine-tune and evaluate a model for spoken Spanish. It is shown that the accuracy of these taggers drops from 0.98 $$-$$ - 0.99 to 0.94 $$-$$ - 0.95 when tested on spoken data. Of these three taggers, the spaCy’s trf (transformers) and Stanza NLP models performed the best. Finally, the spaCy trf model is fine-tuned using our gold standard, which resulted in an accuracy of 0.98 for coarse-grained tags (UPOS) and 0.97 for fine-grained tags (FEATS). Our benchmark will enable the development of more accurate PoS taggers for spoken Spanish and facilitate the construction of a treebank for European Spanish varieties.
Förderung
- Fonds Wetenschappelijk Onderzoek
- Humboldt-Universität zu Berlin
Zitieren
APA
Bonilla, J. E. (2025). Spoken Spanish PoS tagging: gold standard dataset. Language Resources and Evaluation, 59(2), 983-1012. https://doi.org/10.1007/s10579-024-09751-x
Vancouver
Bonilla JE. Spoken Spanish PoS tagging: gold standard dataset. Language Resources and Evaluation. 2025;59(2):983-1012. doi:10.1007/s10579-024-09751-x
BibTeX
@article{Bonilla2025,
author = {Bonilla, Johnatan E.},
title = {Spoken Spanish PoS tagging: gold standard dataset},
journal = {Language Resources and Evaluation},
year = {2025},
volume = {59},
number = {2},
pages = {983--1012},
doi = {10.1007/s10579-024-09751-x}
}
EUVIMED