A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems
Applied Sciences · 19.11.2026 · 16 (22) · 11486
DOI: 10.3390/app162211486 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 19.11.2026. Verfasst von Esther Gascó und 3 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accurate vegetation-soil segmentation is essential for agricultural vision systems operating under variable field conditions. This study evaluates a hybrid CNN-Transformer architecture combining a convolutional pre-encoder, hierarchical shifted-window attention, and a U-Net-like decoder for segmentation in structured crop-row environments. A 13-channel input representation incorporating ten RGB-derived vegetation descriptors was investigated without requiring additional spectral sensors. Model development systematically examined input representation, optimizer, Transformer depth, loss function, and patch size. The final configuration was evaluated across five independent training runs and compared with conventional CNN, lightweight, Transformer-based, and hybrid segmentation architectures. On the internal test set, Hybrid-13Ch achieved 95.9 ± 0.22% Global Accuracy, 96.3 ± 0.76% Mean Accuracy, 89.1 ± 0.37% mean Intersection over Union (mIoU), and 96.6 ± 0.53% Mean BFScore. On an external test set comprising 300 annotated frames from two previously unseen video sequences, it achieved 87.3 ± 0.39% mIoU and 94.3 ± 0.58% Mean BFScore. Incremental and subtractive ablation experiments assessed the contributions of the convolutional pre-encoder, shifted-window attention, and MLP processing. These findings support the proposed architecture and RGB-derived representation for agricultural semantic segmentation.
Zitieren
APA
Gascó, E., López-González, C. I., Besada-Portas, E., & Pajares, G. (2026). A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems. Applied Sciences, 16(22), 11486. https://doi.org/10.3390/app162211486
Vancouver
Gascó E, López-González CI, Besada-Portas E, Pajares G. A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems. Applied Sciences. 2026;16(22):11486. doi:10.3390/app162211486
BibTeX
@article{Gasc2026,
author = {Gascó, Esther and López-González, Clara I. and Besada-Portas, Eva and Pajares, Gonzalo},
title = {A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {22},
pages = {11486},
doi = {10.3390/app162211486}
}
EUVIMED