EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Bridging the Gap: A Transformer-Based Chatbot Architecture for Low-Resource Brahui via Embedding Fusion and Transfer Learning

Naseer Ahmed, Mansoor Ahmed Khuhro, Asif Ali Laghari

Mehran University Research Journal of Engineering and Technology · 01.07.2026 · 45 (3) · 114-123

DOI: 10.22581/muet1982.0675 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mehran University Research Journal of Engineering and Technology, online erschienen am 01.07.2026. Verfasst von Naseer Ahmed und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models have transformed conversational artificial intelligence; however, their performance remains weak for languages with extreme resource scarcity. Brahui is a typologically distinct Dravidian language with limited annotated data and minimal representation in multilingual resources. This study presents a transformer-based chatbot architecture designed for Brahui and introduces an embedding fusion mechanism to address data scarcity. The mechanism combines multilingual embeddings with Brahui-specific embeddings, enabling the model to retain cross-lingual knowledge while learning language-specific semantic and morphological features. Experiments show substantial improvement over the baseline: semantic similarity increases from 79.91 to 98.23, perplexity decreases from 94.27 to 14.64, and the system achieves 76% accuracy in correctly answering questions. The proposed framework provides a robust and parameter-efficient approach for developing fluent generative dialogue systems in severely under-resourced linguistic contexts.

Zitieren

APA

Ahmed, N., Khuhro, M. A., & Laghari, A. A. (2026). Bridging the Gap: A Transformer-Based Chatbot Architecture for Low-Resource Brahui via Embedding Fusion and Transfer Learning. Mehran University Research Journal of Engineering and Technology, 45(3), 114-123. https://doi.org/10.22581/muet1982.0675

Vancouver

Ahmed N, Khuhro MA, Laghari AA. Bridging the Gap: A Transformer-Based Chatbot Architecture for Low-Resource Brahui via Embedding Fusion and Transfer Learning. Mehran University Research Journal of Engineering and Technology. 2026;45(3):114-123. doi:10.22581/muet1982.0675

BibTeX
@article{Ahmed2026,
  author = {Ahmed, Naseer and Khuhro, Mansoor Ahmed and Laghari, Asif Ali},
  title = {Bridging the Gap: A Transformer-Based Chatbot Architecture for Low-Resource Brahui via Embedding Fusion and Transfer Learning},
  journal = {Mehran University Research Journal of Engineering and Technology},
  year = {2026},
  volume = {45},
  number = {3},
  pages = {114--123},
  doi = {10.22581/muet1982.0675}
}
Kostenlos starten →