EUVIMEDEUVIMED entdecken
Open Access

Learning the sound inventory of a complex vocal skill via an intrinsic reward

Hazem Toutounji iD, Anja T Zai iD, Ofer Tchernichovski iD, Richard H R Hahnloser iD, Dina Lipkind iD

Science Advances · 2024

DOI: 10.1126/sciadv.adj3824 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Science Advances, 2024. Verfasst von Hazem Toutounji und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Sheffield, Sheffield S1 4DP, UK. Hauptthemen laut MEDLINE: Finches. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning (RL) is thought to underlie the acquisition of vocal skills like birdsong and speech, where sounding like one’s “tutor” is rewarding. However, what RL strategy generates the rich sound inventories for song or speech? We find that the standard actor-critic model of birdsong learning fails to explain juvenile zebra finches’ efficient learning of multiple syllables. However, when we replace a single actor with multiple independent actors that jointly maximize a common intrinsic reward, then birds’ empirical learning trajectories are accurately reproduced. The influence of each actor (syllable) on the magnitude of global reward is competitively determined by its acoustic similarity to target syllables. This leads to each actor matching the target it is closest to and, occasionally, to the competitive exclusion of an actor from the learning process (i.e., the learned song). We propose that a competitive-cooperative multi-actor RL (MARL) algorithm is key for the efficient learning of the action inventory of a complex skill.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FinchesAnimalsVocalization, AnimalLearningSoundReward

Autor:innen und Institutionen

  • Department of Psychology, University of Sheffield, Sheffield S1 4DP, UK.
  • Insigneo Institute for in silico Medicine, University of Sheffield, Sheffield S1 3JD, UK.
  • The Neuroscience Institute, University of Sheffield, Sheffield S10 2HQ, UK.
  • Institute of Neuroinformatics, University of Zurich/ETH Zurich, Zurich CH-8057, Switzerland.
  • Neuroscience Center Zurich (ZNZ), Zurich CH-8057, Switzerland.
  • Department of Psychology, Hunter College, The City University of New York, New York, NY 10065, USA.

ORCID-Profile: Hazem Toutounji, Anja T Zai, Ofer Tchernichovski, Richard H R Hahnloser, Dina Lipkind

Zitieren

APA

Toutounji, H., Zai, A. T., Tchernichovski, O., Hahnloser, R. H. R., & Lipkind, D. (2024). Learning the sound inventory of a complex vocal skill via an intrinsic reward. Science Advances. https://doi.org/10.1126/sciadv.adj3824

Vancouver

Toutounji H, Zai AT, Tchernichovski O, Hahnloser RHR, Lipkind D. Learning the sound inventory of a complex vocal skill via an intrinsic reward. Science Advances. 2024. doi:10.1126/sciadv.adj3824

BibTeX
@article{Toutounji2024,
  author = {Toutounji, Hazem and Zai, Anja T and Tchernichovski, Ofer and Hahnloser, Richard H R and Lipkind, Dina},
  title = {Learning the sound inventory of a complex vocal skill via an intrinsic reward},
  journal = {Science Advances},
  year = {2024},
  doi = {10.1126/sciadv.adj3824}
}
Kostenlos starten →