ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS
International Journal of Advanced Research · 30.11.2026 · 14 (11) · 247-255
DOI: 10.21474/ijar01/24529 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Advanced Research, online erschienen am 30.11.2026. Verfasst von Serigne Modou Kara Samb und 4 weiteren Autor:innen.
Abstract (Originalsprache)
Background
Automated surveillance of disease vectors is a major public health need in low-resource settings, where annotated data are scarce, low-cost sensors produce noisy signals and acoustic and visual streams are rarely synchronised. Supervised multimodal approaches assume abundant labels and precise temporal alignment, two conditions seldom met in the field.
Methods
We propose a self-supervised audio-visual fusion framework that tolerates temporal asynchrony and accounts for sensor reliability. A Res Net-18 audio encoder processes Mel spectrograms of mosquito wingbeats and a Mobile NetV2 visual encoder processes RGB images. Both are trained without labels using an Info NCE contrastive objective in which every visual segment falling within a temporal window of an audio segment is treated as a positive match. An uncertainty module attached to each branch drives an adaptive fusion that down-weights the less reliable modality. Representations were evaluated by linear probing against unimodal and supervised multimodal baselines, and under acoustic noise, low light and audio-visual time shifts.
Zitieren
APA
Samb, S. M. K., Junior, O. L., Sambe, T. B., Diop, I., & Sarr, M. D. (2026). ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS. International Journal of Advanced Research, 14(11), 247-255. https://doi.org/10.21474/ijar01/24529
Vancouver
Samb SMK, Junior OL, Sambe TB, Diop I, Sarr MD. ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS. International Journal of Advanced Research. 2026;14(11):247-255. doi:10.21474/ijar01/24529
BibTeX
@article{Samb2026,
author = {Samb, Serigne Modou Kara and Junior, Okangondo Loshima and Sambe, Thierno Birame and Diop, Idy and Sarr, Moussa Dethie},
title = {ASYNCHRONOUS, SELF-SUPERVISED AND UNCERTAINTY-AWARE AUDIO-VISUAL FUSION FOR VECTOR SURVEILLANCE IN RESOURCE-CONSTRAINED ENVIRONMENTS},
journal = {International Journal of Advanced Research},
year = {2026},
volume = {14},
number = {11},
pages = {247--255},
doi = {10.21474/ijar01/24529}
}
EUVIMED