EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Marine Mammal Acoustic Species Recognition via Metric Embedding Learning With Audio Spectrogram Transformer

Vincenzo Lipari, Giuseppe Brancatelli, Edy Forlin

IEEE Access · 2026 · 14 · 109452-109465

DOI: 10.1109/access.2026.3714099 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Vincenzo Lipari und 2 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated classification of marine mammal vocalizations from passive acoustic monitoring data is essential for ecological research, biodiversity assessment, and the management of anthropogenic impacts on marine ecosystems. Existing deep learning approaches achieve high accuracy on predefined species sets but operate within a closed-set paradigm: they cannot accommodate previously unseen species without complete retraining, which limits their practical deployment in the field. In this work, we propose a metric embedding framework for marine mammal acoustic species classification. Our approach combines an Audio Spectrogram Transformer (AST) backbone, pre-trained on the large-scale AudioSet dataset, with a projection head trained using a combined ArcFace and online triplet loss. The model learns a 256-dimensional embedding space in which species similarity is captured by cosine distance, enabling closed-set classification, open-set detection of unseen species, and few-shot learning of novel classes from a limited number of reference recordings. We evaluate our method on the Watkins Marine Mammal Sound Database across 25 known species and 6 species held out for open-set and few-shot evaluation. Averaged over three independent training runs, the model attains $92.4 \pm 0.5\%$ closed-set accuracy and a macro F1-score of $0.926 \pm 0.005$ , statistically indistinguishable from a fine-tuned softmax classifier on the same backbone (McNemar test, p = 0.625). The same embedding additionally detects unseen species with an AUROC of $0.891 \pm 0.026$ under a genuine leave-N-species-out protocol, and discovers new species with a macro F1-score of 0.791 at K = 10 under a leakage-free, validation-tuned threshold. These results demonstrate that metric embedding learning provides a flexible and scalable paradigm for marine mammal acoustic monitoring, supporting the integration of new species into deployed systems without retraining.

Zitieren

APA

Lipari, V., Brancatelli, G., & Forlin, E. (2026). Marine Mammal Acoustic Species Recognition via Metric Embedding Learning With Audio Spectrogram Transformer. IEEE Access, 14, 109452-109465. https://doi.org/10.1109/access.2026.3714099

Vancouver

Lipari V, Brancatelli G, Forlin E. Marine Mammal Acoustic Species Recognition via Metric Embedding Learning With Audio Spectrogram Transformer. IEEE Access. 2026;14:109452-109465. doi:10.1109/access.2026.3714099

BibTeX
@article{Lipari2026,
  author = {Lipari, Vincenzo and Brancatelli, Giuseppe and Forlin, Edy},
  title = {Marine Mammal Acoustic Species Recognition via Metric Embedding Learning With Audio Spectrogram Transformer},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {109452--109465},
  doi = {10.1109/access.2026.3714099}
}
Kostenlos starten →