EUVIMEDEUVIMED entdecken
Open Access

Reconstructing visual illusory experiences from human brain activity

Fan L Cheng iD, Tomoyasu Horikawa iD, Kei Majima iD, Misato Tanaka iD, Mohamed Abdelhack iD, Shuntaro C Aoki iD, Jin Hirano iD, Yukiyasu Kamitani iD

Science Advances · 2023

DOI: 10.1126/sciadv.adj3906 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Science Advances, 2023. Verfasst von Fan L Cheng und 7 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Informatics, Kyoto University, Sakyo-ku, Kyoto 606-8501, Japan. Hauptthemen laut MEDLINE: Illusions, Form Perception, Visual Cortex. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 71 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual illusions provide valuable insights into the brain’s interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here, we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding light on the brain’s internal representations of the world.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

IllusionsForm PerceptionVisual CortexHumansBrainNeural Networks, ComputerVisual Perception

Autor:innen und Institutionen

  • Graduate School of Informatics, Kyoto University, Sakyo-ku, Kyoto 606-8501, Japan.
  • ATR Computational Neuroscience Laboratories, Soraku, Kyoto 619-0288, Japan.

ORCID-Profile: Fan L Cheng, Tomoyasu Horikawa, Kei Majima, Misato Tanaka, Mohamed Abdelhack, Shuntaro C Aoki, Jin Hirano, Yukiyasu Kamitani

Zitieren

APA

Cheng, F. L., Horikawa, T., Majima, K., Tanaka, M., Abdelhack, M., Aoki, S. C., Hirano, J., & Kamitani, Y. (2023). Reconstructing visual illusory experiences from human brain activity. Science Advances. https://doi.org/10.1126/sciadv.adj3906

Vancouver

Cheng FL, Horikawa T, Majima K, Tanaka M, Abdelhack M, Aoki SC, et al. Reconstructing visual illusory experiences from human brain activity. Science Advances. 2023. doi:10.1126/sciadv.adj3906

BibTeX
@article{Cheng2023,
  author = {Cheng, Fan L and Horikawa, Tomoyasu and Majima, Kei and Tanaka, Misato and Abdelhack, Mohamed and Aoki, Shuntaro C and Hirano, Jin and Kamitani, Yukiyasu},
  title = {Reconstructing visual illusory experiences from human brain activity},
  journal = {Science Advances},
  year = {2023},
  doi = {10.1126/sciadv.adj3906}
}
Kostenlos starten →