SGTP-Net: Semantic Guidance and Texture Priors-Based Dual-Branch Segmentation Network for Surface Defect Detection
IEEE Transactions on Automation Science and Engineering · 2026 · 23 · 417-432
DOI: 10.1109/tase.2025.3639293 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Automation Science and Engineering, 2026. Verfasst von Shijie Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 76 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Program of Jiangxi Province, Major Research and Development Project of Jiangxi Province.
Abstract (Originalsprache)
Deep learning-based surface defect segmentation approaches have shown promising performance in recent years. However, segmenting defects with complex shapes, large variations in size, and weakly textured defects with indistinct characteristics still poses significant challenges. In this article, a novel semantic guidance and texture priors based dual-branch surface defect segmentation network (SGTP-Net) is proposed for those issues. Firstly, we construct a feature extraction network combines semantic and texture branches. The semantic branch establishes global contextual relationships, while the texture branch captures local features of defects, this dual-branch ensured the network to extract features from various complex defects. Secondly, we design a feature fusion strategy based on semantic guidance and texture priors. The semantic information is used to guides the output of texture branch. After that, the guided texture information provides valuable edge texture priors for each layer’s output in semantic branch. The two branches mutually guide each other for improving ability of weak textures feature extraction. Finally, we run our method on the NEU-Seg, MT-Defect and MSD datasets to conduct a comprehensive comparison with some state-of-the-art general object segmentation models and specialized surface defect segmentation methods. The experimental results show that our SGTP-Net performs well in surface defect detection, offering excellent semantic segmentation accuracy and exhibiting good stability and robustness in detecting various surface defects. Note to Practitioners—This paper was motivated by the problem of surface defect segmentation. Segmentation is foundation of industrial automation testing, surface defect recognition, component size measurement, etc. can all be achieved after segmentation. The existing machine learning based defect segmentation methods rely solely on semantic or texture information for defect representation resulting in poor performance in certain specific scenarios. This paper suggests a new approach combined semantic and texture information. It is not simply a combination of the two, but a dual branch structure that guides each other. Texture information guides the extraction of semantic information, and semantic information re enhances texture information. Finally, those two will be fused for surface defect segmentation. Experiments have shown that our method consistently outperforms other state-of-the-art methods in terms of mean Recall, while also achieving high detection accuracy. It meets the needs of industrial applications. In future research, we will further lightweight the model while maintaining its performance, facilitating its deployment on embedded or mobile devices.
Förderung
- National Natural Science Foundation of China
- Key Research and Development Program of Jiangxi Province
- Major Research and Development Project of Jiangxi Province
- Jiangxi Provincial Key Laboratory of Image Processing and Pattern Recognition
Zitieren
APA
Zhang, S., Jiang, L., Ge, L., Wu, C., Wang, Y., Lu, K., & Zhang, C. (2026). SGTP-Net: Semantic Guidance and Texture Priors-Based Dual-Branch Segmentation Network for Surface Defect Detection. IEEE Transactions on Automation Science and Engineering, 23, 417-432. https://doi.org/10.1109/tase.2025.3639293
Vancouver
Zhang S, Jiang L, Ge L, Wu C, Wang Y, Lu K, et al. SGTP-Net: Semantic Guidance and Texture Priors-Based Dual-Branch Segmentation Network for Surface Defect Detection. IEEE Transactions on Automation Science and Engineering. 2026;23:417-432. doi:10.1109/tase.2025.3639293
BibTeX
@article{Zhang2026,
author = {Zhang, Shijie and Jiang, Leqi and Ge, Liyue and Wu, Chengzhong and Wang, Yaonan and Lu, Ke and Zhang, Congxuan},
title = {SGTP-Net: Semantic Guidance and Texture Priors-Based Dual-Branch Segmentation Network for Surface Defect Detection},
journal = {IEEE Transactions on Automation Science and Engineering},
year = {2026},
volume = {23},
pages = {417--432},
doi = {10.1109/tase.2025.3639293}
}
EUVIMED