EUVIMEDOpdag EUVIMED
Open access

Reconstructing visual illusory experiences from human brain activity

Fan L Cheng iD, Tomoyasu Horikawa iD, Kei Majima iD, Misato Tanaka iD, Mohamed Abdelhack iD, Shuntaro C Aoki iD, Jin Hirano iD, Yukiyasu Kamitani iD

Science Advances · 2023

DOI: 10.1126/sciadv.adj3906 ↗

At a glance

Journal article in Science Advances, 2023. Written by Fan L Cheng and 7 co-authors. Institution: Graduate School of Informatics, Kyoto University, Sakyo-ku, Kyoto 606-8501, Japan. Major MEDLINE topics: Illusions, Form Perception, Visual Cortex. Cited 25 times so far (Crossref); 71 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Visual illusions provide valuable insights into the brain’s interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here, we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding light on the brain’s internal representations of the world.

Subjects

MeSH terms (MEDLINE)

IllusionsForm PerceptionVisual CortexHumansBrainNeural Networks, ComputerVisual Perception

Authors and institutions

  • Graduate School of Informatics, Kyoto University, Sakyo-ku, Kyoto 606-8501, Japan.
  • ATR Computational Neuroscience Laboratories, Soraku, Kyoto 619-0288, Japan.

ORCID profiles: Fan L Cheng, Tomoyasu Horikawa, Kei Majima, Misato Tanaka, Mohamed Abdelhack, Shuntaro C Aoki, Jin Hirano, Yukiyasu Kamitani

Cite

APA

Cheng, F. L., Horikawa, T., Majima, K., Tanaka, M., Abdelhack, M., Aoki, S. C., Hirano, J., & Kamitani, Y. (2023). Reconstructing visual illusory experiences from human brain activity. Science Advances. https://doi.org/10.1126/sciadv.adj3906

Vancouver

Cheng FL, Horikawa T, Majima K, Tanaka M, Abdelhack M, Aoki SC, et al. Reconstructing visual illusory experiences from human brain activity. Science Advances. 2023. doi:10.1126/sciadv.adj3906

BibTeX
@article{Cheng2023,
  author = {Cheng, Fan L and Horikawa, Tomoyasu and Majima, Kei and Tanaka, Misato and Abdelhack, Mohamed and Aoki, Shuntaro C and Hirano, Jin and Kamitani, Yukiyasu},
  title = {Reconstructing visual illusory experiences from human brain activity},
  journal = {Science Advances},
  year = {2023},
  doi = {10.1126/sciadv.adj3906}
}
Start for free →