Integrating Whisper Transcription with Transformer and CNN Models for Indonesian Abusive Speech Detection
Journal of Artificial Intelligence and Data Science · 07.12.2025 · 1 (2) · 54-65
DOI: 10.67561/jaids.v1i2.1 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Artificial Intelligence and Data Science, online erschienen am 07.12.2025. Verfasst von Ainandita Riwipapusa und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
The growing popularity of audio social media in Indonesia has fueled the spread of profanity and hate speech, even though there are no regulations specifically covering its use. In this work, we propose an audio-based coarse word detection model by combining one Whisper model for transcription and another IndoBERT in a sentence context classifier to decode it along with a Convolutional Neural Network (CNN) for fine-grained coarse word prediction. The development of IDSS was based on a Knowledge Discovery in Database (KDD) process, consisting of the data selection, preprocessing, transformation, data mining and evaluation phases. The recovered dataset will be pre-processed through cleaning, tokenizing and stemming accordingly prior to labeling. To evaluate the data sharing strategies we used three proportions of shared information (80:20, 70:30 and 60:40) with 5-fold cross-validation. It was found that scenario 1 having data sharing ratio of 80:20 gave highest performance with 100% training accuracy, 98.71% validation accuracy and 99.57% test accuracy. The fusion of IndoBERT and CNN seems to be effective in finding broad sentences and certain words including rudeness. The proposed system would be a first line of defense in reducing the dissemination of hateful language content on auditory social media.
Zitieren
APA
Riwipapusa, A., Yustanti, W., Putra, C. D., & Widada, B. P. P. U. (2025). Integrating Whisper Transcription with Transformer and CNN Models for Indonesian Abusive Speech Detection. Journal of Artificial Intelligence and Data Science, 1(2), 54-65. https://doi.org/10.67561/jaids.v1i2.1
Vancouver
Riwipapusa A, Yustanti W, Putra CD, Widada BPPU. Integrating Whisper Transcription with Transformer and CNN Models for Indonesian Abusive Speech Detection. Journal of Artificial Intelligence and Data Science. 2025;1(2):54-65. doi:10.67561/jaids.v1i2.1
BibTeX
@article{Riwipapusa2025,
author = {Riwipapusa, Ainandita and Yustanti, Wiyli and Putra, Cendra Devayana and Widada, Bartolomeus Priya Perkasa Utama},
title = {Integrating Whisper Transcription with Transformer and CNN Models for Indonesian Abusive Speech Detection},
journal = {Journal of Artificial Intelligence and Data Science},
year = {2025},
volume = {1},
number = {2},
pages = {54--65},
doi = {10.67561/jaids.v1i2.1}
}
EUVIMED