EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DPRM: DeBERTa-based potential relationship multi-headed self-attention joint extraction model

Songjiang Li, Jinming Cao, Jiao Yang, Yunjiangcan He, Peng Wang iD

PLOS One · 2025

DOI: 10.1371/journal.pone.0329120 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2025. Verfasst von Songjiang Li und 4 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Technology, Changchun University of Science and Technology, Changchun, China. Hauptthemen laut MEDLINE: Data Mining, Models, Theoretical. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Technology of the People's Republic of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional entity-relationship joint extraction models are typically designed to address generic domain data, which limits their effectiveness when applied to domain-specific applications such as manufacturing. This study presents the DeBERTa-based Potential Relationship Multi-Headed Self-Attention Joint Extraction Model (DPRM), which has been specifically designed to enhance the accuracy and efficiency of entity-relationship extraction in manufacturing knowledge graphs. The model is comprised of three core components: a semantic representation module, a relationship extraction and entity recognition module, and a global entity pairing module. In the semantic representation module, a DeBERTa encoder is employed to train the input sentences, thereby generating word embeddings. The capture of word dependencies is achieved through the utilization of Bi-GRU and Multi-Headed Self-Attention mechanisms, which serve to enhance the overall representation of the sentence. The relationship extraction and entity recognition module is responsible for identifying potential relationships within the sentences and integrating a relational gated mechanism to minimize the interference of irrelevant information during the entity recognition process. The global entity pairing module simplifies the model’s architecture by extracting potential relationships and constructing a matrix of global pairing entity pairs based on fault-specific data. The efficacy of the proposed model is validated through experiments conducted on fault datasets. The results demonstrate that the DPRM achieves superior performance, with an F1 score that surpasses that of existing models, thereby highlighting its effectiveness in the fault domain.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data MiningModels, TheoreticalSemanticsHumansAlgorithms

Autor:innen und Institutionen

  • College of Computer Science and Technology, Changchun University of Science and Technology, Changchun, China.
  • Chongqing Research Institute, Changchun University of Science and Technolo-gy, Chongqing, China.

ORCID-Profile: Peng Wang

Förderung

  • Ministry of Science and Technology of the People's Republic of China

Zitieren

APA

Li, S., Cao, J., Yang, J., He, Y., & Wang, P. (2025). DPRM: DeBERTa-based potential relationship multi-headed self-attention joint extraction model. PLOS One. https://doi.org/10.1371/journal.pone.0329120

Vancouver

Li S, Cao J, Yang J, He Y, Wang P. DPRM: DeBERTa-based potential relationship multi-headed self-attention joint extraction model. PLOS One. 2025. doi:10.1371/journal.pone.0329120

BibTeX
@article{Li2025,
  author = {Li, Songjiang and Cao, Jinming and Yang, Jiao and He, Yunjiangcan and Wang, Peng},
  title = {DPRM: DeBERTa-based potential relationship multi-headed self-attention joint extraction model},
  journal = {PLOS One},
  year = {2025},
  doi = {10.1371/journal.pone.0329120}
}
Kostenlos starten →