EUVIMEDEUVIMED entdecken
Crossref

IAM-Edit: Localized Image Editing via Instruction Attention Maps

Shucheng Mao, Hua Cheng, Zehong Qian, Yingying Ding, Shibo Luo, Yiquan Fang

The European Journal on Artificial Intelligence · 18.06.2026

DOI: 10.1177/30504554261450837 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The European Journal on Artificial Intelligence, online erschienen am 18.06.2026. Verfasst von Shucheng Mao und 5 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Diffusion models have demonstrated impressive performance in text-to-image generation and image editing. However, in instruction-based image editing, they often encounter two challenges: (1) inaccurate localization of the editing targets and (2) unintended modifications in nontarget regions. These issues stem from the global processing of diffusion models due to attention mechanisms. To address these limitations, we conduct a systematic analysis of attention maps under editing instructions and design localization instructions to obtain the desired attention. We propose Instruction Attention Maps (IAM)-Edit, a localized image editing framework that explicitly decouples an editing pipeline into two stages: region localization followed by region-aware editing. Specifically, to localize the editing region, a mask is generated by clustering patches of self-attention maps and combining them with the focal points of cross-attention maps under the editing instruction. To preserve nonediting regions, we apply an attention modulation method that adjusts cross-attention weights at each denoising step based on the generated mask, enabling the denoising process to focus on the editing region. Experiments show that IAM-Edit outperforms state-of-the-art methods both qualitatively and quantitatively.

Zitieren

APA

Mao, S., Cheng, H., Qian, Z., Ding, Y., Luo, S., & Fang, Y. (2026). IAM-Edit: Localized Image Editing via Instruction Attention Maps. The European Journal on Artificial Intelligence. https://doi.org/10.1177/30504554261450837

Vancouver

Mao S, Cheng H, Qian Z, Ding Y, Luo S, Fang Y. IAM-Edit: Localized Image Editing via Instruction Attention Maps. The European Journal on Artificial Intelligence. 2026. doi:10.1177/30504554261450837

BibTeX
@article{Mao2026,
  author = {Mao, Shucheng and Cheng, Hua and Qian, Zehong and Ding, Yingying and Luo, Shibo and Fang, Yiquan},
  title = {IAM-Edit: Localized Image Editing via Instruction Attention Maps},
  journal = {The European Journal on Artificial Intelligence},
  year = {2026},
  doi = {10.1177/30504554261450837}
}
Kostenlos starten →