EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Implicit–Explicit Decoupling and Mixture-of-Experts Fusion for Subject-Driven Text-to-Image Generation

Wenqi Ren, Kewen Chen, Xiaobin Hu, Jianhou Gan, Xiaocheng Zhang, Shangfeng Guo, Guoli Yang

IEEE Transactions on Image Processing · 2026 · 35 · 11202-11215

DOI: 10.1109/tip.2026.3741659 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Wenqi Ren und 6 weiteren Autor:innen. Die Arbeit nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Scientific Research Innovation Capability Support Project for Young Faculty.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in large-scale text-to-image (T2I) models have spurred the development of subject-driven T2I generation, which aims to synthesize customized images that align with textual prompts while preserving subject identity. However, existing approaches still struggle to disentangle identity-related information from identity-irrelevant details, leading to overfitting or inadequate preservation of subject identity. In this work, we propose a novel method that enhances the separation of identity-related and identity-irrelevant features, and introduces a feature fusion mechanism to improve image quality and text alignment. Our method consists of two key components: an implicit-explicit foreground-background decoupling module (IEDM) and a feature fusion module (FFM) based on a Mixture of Experts. IEDM uses a learnable adapter for implicit feature-level decoupling and an inpainting technique for explicit foreground-background separation. This decoupling process is facilitated by three complementary loss functions. FFM adaptively integrates identity-irrelevant and identity-related features, enabling more refined feature representations. Extensive experiments demonstrate the effectiveness of our method in improving image quality, enhancing scene adaptability, and increasing the diversity of outputs across various textual prompts.

Förderung

  • National Natural Science Foundation of China
  • Scientific Research Innovation Capability Support Project for Young Faculty

Zitieren

APA

Ren, W., Chen, K., Hu, X., Gan, J., Zhang, X., Guo, S., & Yang, G. (2026). Implicit–Explicit Decoupling and Mixture-of-Experts Fusion for Subject-Driven Text-to-Image Generation. IEEE Transactions on Image Processing, 35, 11202-11215. https://doi.org/10.1109/tip.2026.3741659

Vancouver

Ren W, Chen K, Hu X, Gan J, Zhang X, Guo S, et al. Implicit–Explicit Decoupling and Mixture-of-Experts Fusion for Subject-Driven Text-to-Image Generation. IEEE Transactions on Image Processing. 2026;35:11202-11215. doi:10.1109/tip.2026.3741659

BibTeX
@article{Ren2026,
  author = {Ren, Wenqi and Chen, Kewen and Hu, Xiaobin and Gan, Jianhou and Zhang, Xiaocheng and Guo, Shangfeng and Yang, Guoli},
  title = {Implicit–Explicit Decoupling and Mixture-of-Experts Fusion for Subject-Driven Text-to-Image Generation},
  journal = {IEEE Transactions on Image Processing},
  year = {2026},
  volume = {35},
  pages = {11202--11215},
  doi = {10.1109/tip.2026.3741659}
}
Kostenlos starten →