EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems

Esther Gascó, Clara I. López-González, Eva Besada-Portas, Gonzalo Pajares

Applied Sciences · 19.11.2026 · 16 (22) · 11486

DOI: 10.3390/app162211486 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 19.11.2026. Verfasst von Esther Gascó und 3 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate vegetation-soil segmentation is essential for agricultural vision systems operating under variable field conditions. This study evaluates a hybrid CNN-Transformer architecture combining a convolutional pre-encoder, hierarchical shifted-window attention, and a U-Net-like decoder for segmentation in structured crop-row environments. A 13-channel input representation incorporating ten RGB-derived vegetation descriptors was investigated without requiring additional spectral sensors. Model development systematically examined input representation, optimizer, Transformer depth, loss function, and patch size. The final configuration was evaluated across five independent training runs and compared with conventional CNN, lightweight, Transformer-based, and hybrid segmentation architectures. On the internal test set, Hybrid-13Ch achieved 95.9 ± 0.22% Global Accuracy, 96.3 ± 0.76% Mean Accuracy, 89.1 ± 0.37% mean Intersection over Union (mIoU), and 96.6 ± 0.53% Mean BFScore. On an external test set comprising 300 annotated frames from two previously unseen video sequences, it achieved 87.3 ± 0.39% mIoU and 94.3 ± 0.58% Mean BFScore. Incremental and subtractive ablation experiments assessed the contributions of the convolutional pre-encoder, shifted-window attention, and MLP processing. These findings support the proposed architecture and RGB-derived representation for agricultural semantic segmentation.

Zitieren

APA

Gascó, E., López-González, C. I., Besada-Portas, E., & Pajares, G. (2026). A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems. Applied Sciences, 16(22), 11486. https://doi.org/10.3390/app162211486

Vancouver

Gascó E, López-González CI, Besada-Portas E, Pajares G. A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems. Applied Sciences. 2026;16(22):11486. doi:10.3390/app162211486

BibTeX
@article{Gasc2026,
  author = {Gascó, Esther and López-González, Clara I. and Besada-Portas, Eva and Pajares, Gonzalo},
  title = {A Hybrid CNN-Transformer with Window-Based Attention for Vegetation-Soil Semantic Segmentation in Agricultural Vision Systems},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {22},
  pages = {11486},
  doi = {10.3390/app162211486}
}
Kostenlos starten →