EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Projection-Free CLIP-Scale EEG Latents via a U-Net-Style Autoencoder

Jeyoung Lee iD, Jaekwan Ahn, Jaeseung Sim, Hochul Kang iD

Sensors · 20.07.2026 · 26 (14) · 4583

DOI: 10.3390/s26144583 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 20.07.2026. Verfasst von Jeyoung Lee und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Engineering, Soongsil University, 369 Sangdo-ro, Dongjak-gu, Seoul 06978, Republic of Korea. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Technology and Information Promotion Agency for SMEs.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Electroencephalography is emerging as a promising conditioning modality for generative visual models. However, existing representation learning approaches often rely on high-capacity masked autoencoders and complex projection networks. When constrained to compact embedding dimensions to match vision-language models, these heavy transformer-based bottlenecks frequently suffer from representation collapse and lose critical signal dynamics. To address this, we propose a lightweight and projection-free autoencoder that directly outputs compact, Contrastive Language–Image Pre-training (CLIP)-scale latent vectors trained toward the CLIP embedding space. Our model adopts a U-Net-style architecture combining one-dimensional convolutional residual blocks for temporal dynamics and inter-channel attention modules for spatial dependencies, alongside skip connections to ensure stable reconstruction. Extensive experiments on visual perception datasets demonstrate that our approach successfully tracks complex signal amplitudes without collapsing. Under strict dimensional constraints, the proposed model achieves superior signal reconstruction fidelity across time and frequency domains using significantly fewer parameters than traditional masked autoencoder baselines. Furthermore, latent space visualizations and zero-shot retrieval tasks reveal that while the baseline collapses toward unstructured, near-chance representations, our architecture preserves emerging, partial semantic organization and retrieves several times above chance. This indicates that the proposed design preserves signal structure while exhibiting preliminary, above-chance semantic alignment, enabling integration into brain-driven generative pipelines.

Schlagwörter

Stichwörter der Autor:innen

U-Netcross-modal alignmentelectroencephalography (EEG)generative AIrepresentation learningsignal reconstruction

Autor:innen und Institutionen

  • School of Computer Science and Engineering, Soongsil University, 369 Sangdo-ro, Dongjak-gu, Seoul 06978, Republic of Korea.
  • Sweetndata Inc., Seoul 06224, Republic of Korea.
  • Department of Digital Media Engineering, The Catholic University of Korea, Bucheon-si 14662, Republic of Korea.

ORCID-Profile: Jeyoung Lee, Hochul Kang

Förderung

  • Korea Technology and Information Promotion Agency for SMEs

Zitieren

APA

Lee, J., Ahn, J., Sim, J., & Kang, H. (2026). Projection-Free CLIP-Scale EEG Latents via a U-Net-Style Autoencoder. Sensors, 26(14), 4583. https://doi.org/10.3390/s26144583

Vancouver

Lee J, Ahn J, Sim J, Kang H. Projection-Free CLIP-Scale EEG Latents via a U-Net-Style Autoencoder. Sensors. 2026;26(14):4583. doi:10.3390/s26144583

BibTeX
@article{Lee2026,
  author = {Lee, Jeyoung and Ahn, Jaekwan and Sim, Jaeseung and Kang, Hochul},
  title = {Projection-Free CLIP-Scale EEG Latents via a U-Net-Style Autoencoder},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {14},
  pages = {4583},
  doi = {10.3390/s26144583}
}
Kostenlos starten →