EUVIMEDEUVIMED entdecken
Crossref

Formant-based vowel categorization for cross-lingual phone recognition

Marija Stepanović, Christian Hardmeier iD, Odette Scharenborg iD

The Journal of the Acoustical Society of America · 2025

DOI: 10.1121/10.0036222 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, 2025. Verfasst von Marija Stepanović und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, IT University of Copenhagen, 2300 Copenhagen, Denmark. Hauptthemen laut MEDLINE: Phonetics, Multilingualism, Speech Perception, Speech Acoustics. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 70 Literaturangaben. Gefördert von: IT-Universitetet i København.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multilingual phone recognition models can learn language-independent pronunciation patterns from large volumes of spoken data and recognize them across languages. This potential can be harnessed to improve speech technologies for underresourced languages. However, these models are typically trained on phonological representations of speech sounds, which do not necessarily reflect the phonetic realization of speech. A mismatch between a phonological symbol and its phonetic realizations can lead to phone confusions and reduce performance. This work introduces formant-based vowel categorization aimed at improving cross-lingual vowel recognition by uncovering a vowel's phonetic quality from its formant frequencies, and reorganizing the vowel categories in a multilingual speech corpus to increase their consistency across languages. The work investigates vowel categories obtained from a trilingual multi-dialect speech corpus of Danish, Norwegian, and Swedish using three categorization techniques. Cross-lingual phone recognition experiments reveal that uniting vowel categories of different languages into a set of shared formant-based categories improves cross-lingual recognition of the shared vowels, but also interferes with recognition of vowels not present in one or more training languages. Cross-lingual evaluation on regional dialects provides inconclusive results. Nevertheless, improved recognition of individual vowels can translate to improvements in overall phone recognition on languages unseen during training.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PhoneticsMultilingualismSpeech PerceptionSpeech AcousticsRecognition, PsychologyHumansMaleFemaleAdultYoung AdultLanguageVoice Quality

Autor:innen und Institutionen

  • Department of Computer Science, IT University of Copenhagen, 2300 Copenhagen, Denmark.
  • Multimedia Computing Group, Delft University of Technology, 2628 XE Delft, The Netherlands.

ORCID-Profile: Christian Hardmeier, Odette Scharenborg

Förderung

  • IT-Universitetet i København

Zitieren

APA

Stepanović, M., Hardmeier, C., & Scharenborg, O. (2025). Formant-based vowel categorization for cross-lingual phone recognition. The Journal of the Acoustical Society of America. https://doi.org/10.1121/10.0036222

Vancouver

Stepanović M, Hardmeier C, Scharenborg O. Formant-based vowel categorization for cross-lingual phone recognition. The Journal of the Acoustical Society of America. 2025. doi:10.1121/10.0036222

BibTeX
@article{Stepanovi2025,
  author = {Stepanović, Marija and Hardmeier, Christian and Scharenborg, Odette},
  title = {Formant-based vowel categorization for cross-lingual phone recognition},
  journal = {The Journal of the Acoustical Society of America},
  year = {2025},
  doi = {10.1121/10.0036222}
}
Kostenlos starten →