EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MTRD-Net: An RGB-NIR Multimodal Fusion Network for Tomato Ripeness Detection in Complex Greenhouse Environments

Xin Li, Xingang Miao, Zijian Yao, Wenhui Wu

Applied Sciences · 30.10.2026 · 16 (21) · 10792

DOI: 10.3390/app162110792 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 30.10.2026. Verfasst von Xin Li und 3 weiteren Autor:innen. Die Arbeit nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Research and Development Program of Anhui Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tomato ripeness detection is critical for intelligent greenhouse management and automated harvesting. However, complex backgrounds, severe occlusion, scale variation with numerous small objects, and lighting-induced feature degradation make single-modality detection less robust. To overcome these obstacles, a multimodal tomato ripeness detection network (MTRD-Net) is proposed that fuses red-green-blue (RGB) and near-infrared (NIR) imagery (RGB-NIR) through a dual-path framework with feature fusion at the P4 and P5 scales. First, a C3k2-DEDR module combining Cross-Stage Partial with Kernel Size 2 (C3k2) and a Dynamic Extraction and Dual Refinement (DEDR) Block (DEDRBlock) enhances discriminative feature capture in complex backgrounds. Second, we design a Multi-Scale-Aware Cross-Modal Transformer Fusion (MACTF) module. It improves target representation against scale changes and occlusions, while simultaneously integrating cross-modal cues in spatial and semantic domains. Third, a Small-Object Feature Enhancement Neck (SOFEN) enhances fine-grained feature preservation for small tomatoes. Experimental results on the public multimodal tomato ripeness detection dataset validate the effectiveness of MTRD-Net, which surpasses several mainstream models by achieving 76.7% precision, 81.0% recall, and mAP values of 84.8% (at IoU = 0.5) and 70.2% (at IoU = 0.5:0.95). Additional evaluation on Multi-Scenario Multi-Modality Benchmark (M3FD) further demonstrates the general applicability of the proposed multimodal architecture to generic object detection tasks.

Förderung

  • Key Research and Development Program of Anhui Province

Zitieren

APA

Li, X., Miao, X., Yao, Z., & Wu, W. (2026). MTRD-Net: An RGB-NIR Multimodal Fusion Network for Tomato Ripeness Detection in Complex Greenhouse Environments. Applied Sciences, 16(21), 10792. https://doi.org/10.3390/app162110792

Vancouver

Li X, Miao X, Yao Z, Wu W. MTRD-Net: An RGB-NIR Multimodal Fusion Network for Tomato Ripeness Detection in Complex Greenhouse Environments. Applied Sciences. 2026;16(21):10792. doi:10.3390/app162110792

BibTeX
@article{Li2026,
  author = {Li, Xin and Miao, Xingang and Yao, Zijian and Wu, Wenhui},
  title = {MTRD-Net: An RGB-NIR Multimodal Fusion Network for Tomato Ripeness Detection in Complex Greenhouse Environments},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {21},
  pages = {10792},
  doi = {10.3390/app162110792}
}
Kostenlos starten →