EUVIMEDEUVIMED entdecken
Crossref

Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models

Longtao Jiang, Jie Huang, Mingfei Han, Lei Chen, Yongqiang Yu, Feng Zhao, Xiaojun Chang, Zhihui Li

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (7) · 5397-5405

DOI: 10.1609/aaai.v40i7.37456 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Longtao Jiang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text-guided image inpainting aims to inpaint masked image regions based on a textual prompt while preserving the background. Although diffusion-based methods have become dominant, their property of modeling the entire image in latent space makes it challenging for the results to align well with prompt details and maintain a consistent background. To address these issues, we explore Mask AutoRegressive (MAR) models for this task. MAR naturally supports image inpainting by generating latent tokens corresponding to mask regions, enabling better local controllability without altering the background. However, directly applying MAR to this task makes the inpainting content either ignore the prompts or be disharmonious with the background context. Through analysis of the attention maps from the inpainting images, we identify the impact of background tokens on text tokens during the MAR generation, and leverage this to designToken Painter, a training-free text-guided image inpainting method based on MAR. Our approach introduces two key components: (1) Dual-Stream Encoder Information Fusion (DEIF), which fuses the semantic and context information from text and background in frequency domain to produce novel guidance tokens, allowing MAR to generate text-faithful inpainting content while keeping harmonious with background context. (2) Adaptive Decoder Attention Score Enhancing (ADAE), which adaptively enhances attention scores on guidance tokens and inpainting tokens to further enhance the alignment of prompt details and the content visual quality. Extensive experiments demonstrate that our training-free method outperforms prior state-of-the-art methods across almost all metrics.

Zitieren

APA

Jiang, L., Huang, J., Han, M., Chen, L., Yu, Y., Zhao, F., Chang, X., & Li, Z. (2026). Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(7), 5397-5405. https://doi.org/10.1609/aaai.v40i7.37456

Vancouver

Jiang L, Huang J, Han M, Chen L, Yu Y, Zhao F, et al. Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(7):5397-5405. doi:10.1609/aaai.v40i7.37456

BibTeX
@article{Jiang2026,
  author = {Jiang, Longtao and Huang, Jie and Han, Mingfei and Chen, Lei and Yu, Yongqiang and Zhao, Feng and Chang, Xiaojun and Li, Zhihui},
  title = {Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {7},
  pages = {5397--5405},
  doi = {10.1609/aaai.v40i7.37456}
}
Kostenlos starten →