EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross-Modal Complementarity Learning for Fish Feeding Intensity Recognition via Audio–Visual Fusion

Jian Li, Yanan Wei, Wenkai Ma, Tan Wang iD

Animals · 31.07.2025 · 15 (15) · 2245

DOI: 10.3390/ani15152245 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Animals, online erschienen am 31.07.2025. Verfasst von Jian Li und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Biology and Food Engineering, Fuyang Normal University, Fuyang 236037, China. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Biological and Medical Sciences of Applied Summit Nurturing Disciplines in Anhui Province(Anhui Education Secretary Department [2023]13), Fuyang Normal University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate evaluation of fish feeding intensity is crucial for optimizing aquaculture efficiency and the healthy growth of fish. Previous methods mainly rely on single-modal approaches (e.g., audio or visual). However, the complex underwater environment makes single-modal monitoring methods face significant challenges: visual systems are severely affected by water turbidity, lighting conditions, and fish occlusion, while acoustic systems suffer from background noise. Although existing studies have attempted to combine acoustic and visual information, most adopt simple feature-level fusion strategies, which fail to fully explore the complementary advantages of the two modalities under different environmental conditions and lack dynamic evaluation mechanisms for modal reliability. To address these problems, we propose the Adaptive Cross-modal Attention Fusion Network (ACAF-Net), a cross-modal complementarity learning framework with a two-stage attention fusion mechanism: (1) a cross-modal enhancement stage that enriches individual representations through Low-rank Bilinear Pooling and learnable fusion weights; (2) an adaptive attention fusion stage that dynamically weights acoustic and visual features based on complementarity and environmental reliability. Our framework incorporates dimension alignment strategies and attention mechanisms to capture temporal–spatial complementarity between acoustic feeding signals and visual behavioral patterns. Extensive experiments demonstrate superior performance compared to single-modal and conventional fusion approaches, with 6.4% accuracy improvement. The results validate the effectiveness of exploiting cross-modal complementarity for underwater behavioral analysis and establish a foundation for intelligent aquaculture monitoring systems.

Schlagwörter

Stichwörter der Autor:innen

aquaculture monitoringattention mechanismaudio–visualcross-modal fusionfish feeding behavior

Autor:innen und Institutionen

  • School of Biology and Food Engineering, Fuyang Normal University, Fuyang 236037, China.
  • Provincial Key Laboratory of Embryo Development and Reproductive Regulation, Fuyang 236037, China.
  • School of Information and Artificial Intelligence, Anhui Agricultural University, Hefei 230036, China.
  • Key Laboratory of Agricultural Sensors, Ministry of Agriculture and Rural Affairs, Hefei 230036, China.

ORCID-Profile: Tan Wang

Förderung

  • Biological and Medical Sciences of Applied Summit Nurturing Disciplines in Anhui Province(Anhui Education Secretary Department [2023]13)
  • Fuyang Normal University

Zitieren

APA

Li, J., Wei, Y., Ma, W., & Wang, T. (2025). Cross-Modal Complementarity Learning for Fish Feeding Intensity Recognition via Audio–Visual Fusion. Animals, 15(15), 2245. https://doi.org/10.3390/ani15152245

Vancouver

Li J, Wei Y, Ma W, Wang T. Cross-Modal Complementarity Learning for Fish Feeding Intensity Recognition via Audio–Visual Fusion. Animals. 2025;15(15):2245. doi:10.3390/ani15152245

BibTeX
@article{Li2025,
  author = {Li, Jian and Wei, Yanan and Ma, Wenkai and Wang, Tan},
  title = {Cross-Modal Complementarity Learning for Fish Feeding Intensity Recognition via Audio–Visual Fusion},
  journal = {Animals},
  year = {2025},
  volume = {15},
  number = {15},
  pages = {2245},
  doi = {10.3390/ani15152245}
}
Kostenlos starten →