EUVIMEDEUVIMED entdecken
Crossref

ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS

Serigne Modou Kara Samb, Okangondo Loshima Junior, Thierno Birame Sambe, Idy Diop, Moussa Dethie Sarr

International Journal of Advanced Research · 30.11.2026 · 14 (11) · 247-255

DOI: 10.21474/ijar01/24529 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Advanced Research, online erschienen am 30.11.2026. Verfasst von Serigne Modou Kara Samb und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Automated surveillance of disease vectors is a major public health need in low-resource settings, where annotated data are scarce, low-cost sensors produce noisy signals and acoustic and visual streams are rarely synchronised. Supervised multimodal approaches assume abundant labels and precise temporal alignment, two conditions seldom met in the field.

Methods

We propose a self-supervised audio-visual fusion framework that tolerates temporal asynchrony and accounts for sensor reliability. A Res Net-18 audio encoder processes Mel spectrograms of mosquito wingbeats and a Mobile NetV2 visual encoder processes RGB images. Both are trained without labels using an Info NCE contrastive objective in which every visual segment falling within a temporal window of an audio segment is treated as a positive match. An uncertainty module attached to each branch drives an adaptive fusion that down-weights the less reliable modality. Representations were evaluated by linear probing against unimodal and supervised multimodal baselines, and under acoustic noise, low light and audio-visual time shifts.

Zitieren

APA

Samb, S. M. K., Junior, O. L., Sambe, T. B., Diop, I., & Sarr, M. D. (2026). ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS. International Journal of Advanced Research, 14(11), 247-255. https://doi.org/10.21474/ijar01/24529

Vancouver

Samb SMK, Junior OL, Sambe TB, Diop I, Sarr MD. ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS. International Journal of Advanced Research. 2026;14(11):247-255. doi:10.21474/ijar01/24529

BibTeX
@article{Samb2026,
  author = {Samb, Serigne Modou Kara and Junior, Okangondo Loshima and Sambe, Thierno Birame and Diop, Idy and Sarr, Moussa Dethie},
  title = {ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS},
  journal = {International Journal of Advanced Research},
  year = {2026},
  volume = {14},
  number = {11},
  pages = {247--255},
  doi = {10.21474/ijar01/24529}
}
Kostenlos starten →