KAAN-GNN-BERT: A Knowledge-Aware Tripartite Graph-Integrated Transformer for Semi-Supervised Word Sense Disambiguation
ACM Transactions on Asian and Low-Resource Language Information Processing · 31.08.2026 · 25 (8) · 1-37
DOI: 10.1145/3829077 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Asian and Low-Resource Language Information Processing, online erschienen am 19.08.2026. Verfasst von Anil Ahmed und 4 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Foreign Cooperation Project of the Fujian Provincial Department of Science and Technology.
Abstract (Originalsprache)
Word Sense Disambiguation (WSD) is crucial in computational linguistics, particularly for languages with complex morphology such as Urdu. We introduce KAAN-GNN-BERT, an ensemble model that integrates Knowledge-Aware Attention Networks (KAAN), Graph Neural Networks (GNNs), and BERT transformer architecture within a semi-supervised learning framework. The model is evaluated on two benchmark Urdu datasets: ULS-WSD and UAW-WSD. KAAN-GNN-BERT leverages contextual embeddings from BERT to capture subtle semantic nuances, while GNNs infuse structured knowledge through a tripartite graph connecting pre-contexts, post-contexts, and sense identifiers. This structured representation provides rich relational insights. The KAAN mechanism aligns BERT embeddings with graph-based knowledge, enabling the model to highlight and assimilate the most relevant information. By operating in a semi-supervised manner, KAAN-GNN-BERT draws strength from both labeled and unlabeled data, improving generalizability and mitigating class imbalance issues. Experimental results demonstrate that KAAN-GNN-BERT significantly outperforms traditional supervised methods and current state-of-the-art models. It achieves F1 scores of 81.3% on ULS-WSD and 79.4% on UAW-WSD, reflecting over a 30% improvement compared to baseline models. Furthermore, the GNN component supports community detection, enhancing interpretability and providing insights into sense groupings. These findings underscore the robustness and precision of integrating transformer-based architectures with graph-driven relational knowledge and attention mechanisms. KAAN-GNN-BERT thus emerges as a powerful solution for WSD, offering strong performance even in resource-scarce linguistic contexts and paving the way for future advancements in semantic understanding.
Förderung
- Foreign Cooperation Project of the Fujian Provincial Department of Science and Technology
Zitieren
APA
Ahmed, A., Guo, L., Huang, D., Unar, S., & Nazar, M. (2026). KAAN-GNN-BERT: A Knowledge-Aware Tripartite Graph-Integrated Transformer for Semi-Supervised Word Sense Disambiguation. ACM Transactions on Asian and Low-Resource Language Information Processing, 25(8), 1-37. https://doi.org/10.1145/3829077
Vancouver
Ahmed A, Guo L, Huang D, Unar S, Nazar M. KAAN-GNN-BERT: A Knowledge-Aware Tripartite Graph-Integrated Transformer for Semi-Supervised Word Sense Disambiguation. ACM Transactions on Asian and Low-Resource Language Information Processing. 2026;25(8):1-37. doi:10.1145/3829077
BibTeX
@article{Ahmed2026,
author = {Ahmed, Anil and Guo, Lei and Huang, Degen and Unar, Salahuddin and Nazar, Mobeen},
title = {KAAN-GNN-BERT: A Knowledge-Aware Tripartite Graph-Integrated Transformer for Semi-Supervised Word Sense Disambiguation},
journal = {ACM Transactions on Asian and Low-Resource Language Information Processing},
year = {2026},
volume = {25},
number = {8},
pages = {1--37},
doi = {10.1145/3829077}
}
EUVIMED