Multimodal Large Model Guided Diffusion Model for Transformer Oil Leakage Image Generation
Journal of Computer Science and Artificial Intelligence · 29.06.2026 · 7 (3) · 11-17
DOI: 10.54097/wx2t2298 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computer Science and Artificial Intelligence, online erschienen am 29.06.2026. Verfasst von Wenqing Zhao und 11 weiteren Autor:innen. Die Arbeit nennt 13 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Transformer oil leakage is a critical defect in power equipment inspection, yet its automatic detection remains challenging because real leakage samples are scarce, highly irregular in shape, variable in color, and easily confused with water stains, rust, shadows, and complex structural backgrounds. To alleviate the data scarcity problem and improve downstream segmentation performance, this paper proposes a multimodal semantic-heuristic diffusion framework, termed MSH-Diff, for automatic transformer oil-leakage image synthesis. The proposed framework exploits the visual reasoning capability and prior industrial knowledge of a multimodal large language model to identify potential leakage-prone components, such as flanges, valves, and radiator fin roots, through expert-role prompt engineering. The recognized component semantics are further mapped to spatial Gaussian anchors by analyzing cross-attention responses in the latent diffusion model, enabling leakage-center localization without manually drawn masks or key-point annotations. In addition, MSH-Diff automatically constructs dense scene descriptions involving illumination, viewpoint, and surface material, which are encoded as semantic constraints to enhance structural consistency and physical realism during diffusion sampling. Experimental results demonstrate that MSH-Diff achieves competitive image quality and diversity, with an FID of 38.14 and an IC-L score of 0.29. When the generated samples are incorporated into downstream semantic segmentation training, the mIoU of DeepLabV3+ increases from 60.09% to 62.31%, confirming the effectiveness of the proposed framework for industrial defect data augmentation.
Zitieren
APA
Zhao, W., Yang, C., Chen, X., Shi, J., An, B., Ji, Z., Ma, C., Teng, J., Zuo, L., Qi, S., Liang, S., & Zhang, D. (2026). Multimodal Large Model Guided Diffusion Model for Transformer Oil Leakage Image Generation. Journal of Computer Science and Artificial Intelligence, 7(3), 11-17. https://doi.org/10.54097/wx2t2298
Vancouver
Zhao W, Yang C, Chen X, Shi J, An B, Ji Z, et al. Multimodal Large Model Guided Diffusion Model for Transformer Oil Leakage Image Generation. Journal of Computer Science and Artificial Intelligence. 2026;7(3):11-17. doi:10.54097/wx2t2298
BibTeX
@article{Zhao2026,
author = {Zhao, Wenqing and Yang, Cen and Chen, Xi and Shi, Jian and An, Bo and Ji, Zenghua and Ma, Congcong and Teng, Jing and Zuo, Leipeng and Qi, Shijie and Liang, Shuang and Zhang, Dongyang},
title = {Multimodal Large Model Guided Diffusion Model for Transformer Oil Leakage Image Generation},
journal = {Journal of Computer Science and Artificial Intelligence},
year = {2026},
volume = {7},
number = {3},
pages = {11--17},
doi = {10.54097/wx2t2298}
}
EUVIMED