DCT-Based Transparent Object Segmentation Network with Cooperative CNN–Transformer Branches
Sensors · 02.11.2026 · 26 (21) · 6935
DOI: 10.3390/s26216935 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 02.11.2026. Verfasst von Jianfeng Liu und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Marine Science and Technology, Tianjin University, Tianjin 300072, China. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, Key Science and Technology Program Project of the Ministry of Emergency Management, General Program of National Natural Science Foundation of China.
Abstract (Originalsprache)
Transparent object segmentation is a critical computer vision task for industrial and mobile robotic perception, which is widely deployed in intelligent cleaning robots and unmanned aerial vehicles (UAVs) equipped with visual image sensors. However, the perception performance of mainstream image sensors is severely hindered by the unique optical characteristics of transparent objects, including light transmission, complex reflective noise and indistinct object textures, resulting in inaccurate segmentation results in actual robot sensing scenarios. Precise extraction of transparent object boundaries and suppression of background semantic interference are essential for high-quality segmentation. Existing transparent object segmentation methods either focus on semantic or boundary information independently, or they extract boundary features merely from shallow layers during joint modeling, which always causes incomplete boundary feature extraction. Considering that transparent object boundaries correspond to high-frequency features while low-frequency components carry dominant semantic information, we develop a DCT-based segmentation network with cooperative CNN–Transformer branches. DCT decomposes input images into high- and low-frequency components, where CNN and Transformer branches learn frequency-specific features separately. We embed an interactive information module (IIM) in dual encoders to realize bidirectional cross-frequency feature interaction, strengthen weak boundaries, eliminate incomplete target regions caused by reflection noise, and reduce false edges. In decoders, the hybrid adaptive calibration module (HACM) fuses dual-branch semantic and boundary features, alleviates feature distribution discrepancies, and optimizes object positional information. A cascaded head further achieves effective coarse-to-fine multi-scale feature aggregation to adapt to multi-distance sensing scenarios for robots. Our experimental results on five public datasets verify that our method outperforms current mainstream state-of-the-art segmentation methods, effectively compensating for the limitation of traditional image sensors in transparent object recognition and offering a promising development in the environmental perception robustness of cleaning robots and UAVs.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Marine Science and Technology, Tianjin University, Tianjin 300072, China.
- China-Belarus Belt and Road Joint Laboratory on Intelligent Perception in Extreme Environments, Tianjin 300072, China.
- School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin 300072, China.
ORCID-Profile: Jianfeng Liu
Förderung
- National Key Research and Development Program of China
- Key Science and Technology Program Project of the Ministry of Emergency Management
- General Program of National Natural Science Foundation of China
- Natural Science Foundation of Tianjin Science and Technology Correspondent Project
- China Postdoctoral Science Foundation
Zitieren
APA
Liu, J., Liu, H., & Hu, H. (2026). DCT-Based Transparent Object Segmentation Network with Cooperative CNN–Transformer Branches. Sensors, 26(21), 6935. https://doi.org/10.3390/s26216935
Vancouver
Liu J, Liu H, Hu H. DCT-Based Transparent Object Segmentation Network with Cooperative CNN–Transformer Branches. Sensors. 2026;26(21):6935. doi:10.3390/s26216935
BibTeX
@article{Liu2026,
author = {Liu, Jianfeng and Liu, Hedong and Hu, Haofeng},
title = {DCT-Based Transparent Object Segmentation Network with Cooperative CNN–Transformer Branches},
journal = {Sensors},
year = {2026},
volume = {26},
number = {21},
pages = {6935},
doi = {10.3390/s26216935}
}
EUVIMED