EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Analogical Reasoning with Multimodal Knowledge Graphs: Fine-Tuning Model Performance Based on LoRA

Zhenglong Zhang, Sijia Zhang, Zongshi An, Zhenglin Li, Chun Zhang

Electronics · 2025-08-06 · 14 (15) · 3140

DOI: 10.3390/electronics14153140 ↗

At a glance

Journal article in Electronics, published online on 2025-08-06. Written by Zhenglong Zhang and 4 co-authors. Cited 3 times so far (Crossref); 21 references. The full text is freely available (open access, CC BY 4.0). Funded by: Research on the derecycle number of network topology structure graph and its algorithm, Liaoning Province key research and development plan project.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Multimodal knowledge graphs have recently been successfully applied to tasks such as those relating to information retrieval, question and answer, and recommender systems. In this study, we propose a dual-path fine-tuning mechanism technique with a low-rank adapter and an embedded cueing layer, aiming to improve the generalization and accuracy of the model in analogical reasoning tasks. The low-rank fine-tuning (LoRA) technique with rank-stable scaling factor is used to fine-tune the MKGformer model, and a cue-embedding layer is innovatively added to the input layer, which enables the model to better grasp the scale of the relationship between entities according to the dynamic cue vectors during the fine-tuning process and ensures that the model achieves the best results during training. The experimental results show that the R-MKG model improves several evaluation indexes by more than 20%, which is significantly better than the traditional DoRA and FA-LoRA methods. This research provides technical support for multimodal knowledge graph analogical reasoning. We hope that our work will bring benefits and inspire future research.

Funding

  • Research on the derecycle number of network topology structure graph and its algorithm
  • Liaoning Province key research and development plan project

Cite

APA

Zhang, Z., Zhang, S., An, Z., Li, Z., & Zhang, C. (2025). Analogical Reasoning with Multimodal Knowledge Graphs: Fine-Tuning Model Performance Based on LoRA. Electronics, 14(15), 3140. https://doi.org/10.3390/electronics14153140

Vancouver

Zhang Z, Zhang S, An Z, Li Z, Zhang C. Analogical Reasoning with Multimodal Knowledge Graphs: Fine-Tuning Model Performance Based on LoRA. Electronics. 2025;14(15):3140. doi:10.3390/electronics14153140

BibTeX
@article{Zhang2025,
  author = {Zhang, Zhenglong and Zhang, Sijia and An, Zongshi and Li, Zhenglin and Zhang, Chun},
  title = {Analogical Reasoning with Multimodal Knowledge Graphs: Fine-Tuning Model Performance Based on LoRA},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {15},
  pages = {3140},
  doi = {10.3390/electronics14153140}
}
Start for free →