Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (7) · 5397-5405
DOI: 10.1609/aaai.v40i7.37456 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Longtao Jiang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).
Abstract (Originalsprache)
Text-guided image inpainting aims to inpaint masked image regions based on a textual prompt while preserving the background. Although diffusion-based methods have become dominant, their property of modeling the entire image in latent space makes it challenging for the results to align well with prompt details and maintain a consistent background. To address these issues, we explore Mask AutoRegressive (MAR) models for this task. MAR naturally supports image inpainting by generating latent tokens corresponding to mask regions, enabling better local controllability without altering the background. However, directly applying MAR to this task makes the inpainting content either ignore the prompts or be disharmonious with the background context. Through analysis of the attention maps from the inpainting images, we identify the impact of background tokens on text tokens during the MAR generation, and leverage this to designToken Painter, a training-free text-guided image inpainting method based on MAR. Our approach introduces two key components: (1) Dual-Stream Encoder Information Fusion (DEIF), which fuses the semantic and context information from text and background in frequency domain to produce novel guidance tokens, allowing MAR to generate text-faithful inpainting content while keeping harmonious with background context. (2) Adaptive Decoder Attention Score Enhancing (ADAE), which adaptively enhances attention scores on guidance tokens and inpainting tokens to further enhance the alignment of prompt details and the content visual quality. Extensive experiments demonstrate that our training-free method outperforms prior state-of-the-art methods across almost all metrics.
Zitieren
APA
Jiang, L., Huang, J., Han, M., Chen, L., Yu, Y., Zhao, F., Chang, X., & Li, Z. (2026). Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(7), 5397-5405. https://doi.org/10.1609/aaai.v40i7.37456
Vancouver
Jiang L, Huang J, Han M, Chen L, Yu Y, Zhao F, et al. Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(7):5397-5405. doi:10.1609/aaai.v40i7.37456
BibTeX
@article{Jiang2026,
author = {Jiang, Longtao and Huang, Jie and Han, Mingfei and Chen, Lei and Yu, Yongqiang and Zhao, Feng and Chang, Xiaojun and Li, Zhihui},
title = {Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Models},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {7},
pages = {5397--5405},
doi = {10.1609/aaai.v40i7.37456}
}
EUVIMED