EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An One-step Triple Enhanced weakly supervised semantic segmentation using image-level labels

Longjie Quan, Dandan Huang iD, Zhi Liu, Kai Gao, Xiaohong Mi

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0309126 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Longjie Quan und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronics and Information Engineering, Changchun University of Science and Technology, Changchun, People's Republic of China. Hauptthemen laut MEDLINE: Semantics, Algorithms, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jilin Provincial Key Research and Development Plan Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Weakly supervised semantic segmentation, based on image-level labels, abandons the pixel-level labels relied upon by traditional semantic segmentation algorithms. It only utilizes images as supervision information, thereby reducing the time cost and human resources required for marking pixel data. The prevailing approach in weakly supervised segmentation involves two-step method, introducing an additional network and numerous parameters, thereby complicating the model structure. Furthermore, image-level labels typically furnishes only category information for the entire image, lacking specific location details and accurate target boundaries during model training. We propose an innovative One-Step Triple Enhanced weakly supervised semantic segmentation network(OSTE). OSTE streamlines the model structure, which can accomplish both pseudo-labels generation and semantic segmentation tasks in just one step. Furthermore, we augment the weakly supervised semantic segmentation network in three key aspects based on the class activation map construction method, thereby enhancing segmentation accuracy: Firstly, by integrating local information from the activation map with the image, we can enhance the network’s localization and expansion capabilities to obtain more accurate and rich location information. Then, we refine the seed areas of the class activation map by exploiting the correlation between multi-level feature. Finally, we incorporate conditional random field theory to generate pseudo-labels with higher confidence and richer boundary information. In comparison to the prevailing two-step weakly supervised semantic segmentation schemes, the segmentation network proposed in this paper achieves a more competitive mean Intersection over Union (mIoU) score of 58.47% on Pascal VOC. Additionally, it enhances the mIoU score by at least 5.03% when compared to existing end-to-end schemes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SemanticsAlgorithmsImage Processing, Computer-AssistedHumansNeural Networks, Computer

Autor:innen und Institutionen

  • School of Electronics and Information Engineering, Changchun University of Science and Technology, Changchun, People's Republic of China.
  • National and Local Joint Engineering Research Center of Space Photoelectric Technology, Changchun University of Science and Technology, Changchun, People's Republic of China.
  • School of Business, Henan University of Science and Technology, Luoyang, People's Republic of China.

ORCID-Profile: Dandan Huang

Förderung

  • Jilin Provincial Key Research and Development Plan Project

Zitieren

APA

Quan, L., Huang, D., Liu, Z., Gao, K., & Mi, X. (2024). An One-step Triple Enhanced weakly supervised semantic segmentation using image-level labels. PLOS ONE. https://doi.org/10.1371/journal.pone.0309126

Vancouver

Quan L, Huang D, Liu Z, Gao K, Mi X. An One-step Triple Enhanced weakly supervised semantic segmentation using image-level labels. PLOS ONE. 2024. doi:10.1371/journal.pone.0309126

BibTeX
@article{Quan2024,
  author = {Quan, Longjie and Huang, Dandan and Liu, Zhi and Gao, Kai and Mi, Xiaohong},
  title = {An One-step Triple Enhanced weakly supervised semantic segmentation using image-level labels},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0309126}
}
Kostenlos starten →