EUVIMEDEUVIMED entdecken
Crossref

OPTIMIZING SIMILARITY THRESHOLD FOR ABSTRACT SIMILARITY METRIC IN SPEECH DIARIZATION SYSTEMS: A MATHEMATICAL FORMULATION

Jagat Chaitanya Prabhala, Venkatnareshbabu K, Ragoju Ravi

Applied Mathematics and Sciences An International Journal (MathSJ) · 2023

DOI: 10.5121/mathsj.2023.10201 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Mathematics and Sciences An International Journal (MathSJ), 2023. Verfasst von Jagat Chaitanya Prabhala und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Speaker diarization is a critical task in speech processing that aims to identify "who spoke when?" in an audio or video recording that contains unknown amounts of speech from unknown speakers and unknown number of speakers. Diarization has numerous applications in speech recognition, speaker identification, and automatic captioning. Supervised and unsupervised algorithms are used to address speaker diarization problems, but providing exhaustive labeling for the training dataset can become costly in supervised learning, while accuracy can be compromised when using unsupervised approaches. This paper presents a novel approach to speaker diarization, which defines loosely labeled data and employs x-vector embedding and a formalized approach for threshold searching with a given abstract similarity metric to cluster temporal segments into unique user segments. The proposed algorithm uses concepts of graph theory, matrix algebra, and genetic algorithm to formulate and solve the optimization problem. Additionally, the algorithm is applied to English, Spanish, and Chinese audios, and the performance is evaluated using wellknown similarity metrics. The results demonstrate that the robustness of the proposed approach. The findings of this research have significant implications for speech processing, speaker identification including those with tonal differences. The proposed method offers a practical and efficient solution for speaker diarization in real-world scenarios where there are labeling time and cost constraints

Zitieren

APA

Prabhala, J. C., K, V., & Ravi, R. (2023). OPTIMIZING SIMILARITY THRESHOLD FOR ABSTRACT SIMILARITY METRIC IN SPEECH DIARIZATION SYSTEMS: A MATHEMATICAL FORMULATION. Applied Mathematics and Sciences An International Journal (MathSJ). https://doi.org/10.5121/mathsj.2023.10201

Vancouver

Prabhala JC, K V, Ravi R. OPTIMIZING SIMILARITY THRESHOLD FOR ABSTRACT SIMILARITY METRIC IN SPEECH DIARIZATION SYSTEMS: A MATHEMATICAL FORMULATION. Applied Mathematics and Sciences An International Journal (MathSJ). 2023. doi:10.5121/mathsj.2023.10201

BibTeX
@article{Prabhala2023,
  author = {Prabhala, Jagat Chaitanya and K, Venkatnareshbabu and Ravi, Ragoju},
  title = {OPTIMIZING SIMILARITY THRESHOLD FOR ABSTRACT SIMILARITY METRIC IN SPEECH DIARIZATION SYSTEMS: A MATHEMATICAL FORMULATION},
  journal = {Applied Mathematics and Sciences An International Journal (MathSJ)},
  year = {2023},
  doi = {10.5121/mathsj.2023.10201}
}
Kostenlos starten →