EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An improved saliency model of visual attention dependent on image content

Shabnam Novin, Ali Fallah, Saeid Rashidi, Mohammad Reza Daliri

Frontiers in Human Neuroscience · 28.02.2023 · 16

DOI: 10.3389/fnhum.2022.862588 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Human Neuroscience, online erschienen am 28.02.2023. Verfasst von Shabnam Novin und 3 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Biomedical Engineering, Amirkabir University of Technology (AUT), Tehran, Iran. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Many visual attention models have been presented to obtain the saliency of a scene, i.e., the visually significant parts of a scene. However, some mechanisms are still not taken into account in these models, and the models do not fit the human data accurately. These mechanisms include which visual features are informative enough to be incorporated into the model, how the conspicuity of different features and scales of an image may integrate to obtain the saliency map of the image, and how the structure of an image affects the strategy of our attention system. We integrate such mechanisms in the presented model more efficiently compared to previous models. First, besides low-level features commonly employed in state-of-the-art models, we also apply medium-level features as the combination of orientations and colors based on the visual system behavior. Second, we use a variable number of center-surround difference maps instead of the fixed number used in the other models, suggesting that human visual attention operates differently for diverse images with different structures. Third, we integrate the information of different scales and different features based on their weighted sum, defining the weights according to each component's contribution, and presenting both the local and global saliency of the image. To test the model's performance in fitting human data, we compared it to other models using the CAT2000 dataset and the Area Under Curve (AUC) metric. Our results show that the model has high performance compared to the other models (AUC = 0.79 and sAUC = 0.58) and suggest that the proposed mechanisms can be applied to the existing models to improve them.

Schlagwörter

Stichwörter der Autor:innen

center-surround difference mapeye fixationsmedium-level featuressaliency modelvisual attention

Autor:innen und Institutionen

  • Faculty of Biomedical Engineering, Amirkabir University of Technology (AUT), Tehran, Iran.
  • Faculty of Medical Sciences and Technologies, Science and Research Branch, Islamic Azad University, Tehran, Iran.
  • Neuroscience and Neuroengineering Research Laboratory, Biomedical Engineering Department, School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran.
  • School of Cognitive Sciences (SCS), Institute for Research in Fundamental Sciences (IPM), Tehran, Iran.

Zitieren

APA

Novin, S., Fallah, A., Rashidi, S., & Daliri, M. R. (2023). An improved saliency model of visual attention dependent on image content. Frontiers in Human Neuroscience, 16. https://doi.org/10.3389/fnhum.2022.862588

Vancouver

Novin S, Fallah A, Rashidi S, Daliri MR. An improved saliency model of visual attention dependent on image content. Frontiers in Human Neuroscience. 2023;16. doi:10.3389/fnhum.2022.862588

BibTeX
@article{Novin2023,
  author = {Novin, Shabnam and Fallah, Ali and Rashidi, Saeid and Daliri, Mohammad Reza},
  title = {An improved saliency model of visual attention dependent on image content},
  journal = {Frontiers in Human Neuroscience},
  year = {2023},
  volume = {16},
  doi = {10.3389/fnhum.2022.862588}
}
Kostenlos starten →