EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval

Asmaa Alsayed Mohamed Abd-Elsalam, Aliaa A. A. Youssif, Radwa Fathalla

IEEE Access · 2026 · 14 · 114661-114674

DOI: 10.1109/access.2026.3715404 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Asmaa Alsayed Mohamed Abd-Elsalam und 2 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text-driven face understanding fundamentally depends on the quality of semantic descriptions; however, most existing face datasets provide only coarse or generic captions, limiting both retrieval accuracy and controllable face synthesis. Despite recent advances in multimodal generative models, face-centric applications continue to suffer from two critical challenges: reliable image retrieval from textual descriptions and identity-preserving semantic editing. In this work, we propose a modular yet unified framework that jointly addresses these challenges through enhanced semantic grounding and controlled generative modeling. First, we leverage LLaVA to automatically transform basic annotations in the dataset into rich, fine-grained facial descriptions through a multimodal semantic distillation process, significantly strengthening text–image alignment and improving large-scale text-based face retrieval. Building upon this semantic foundation, we introduce CITA-Net, a novel identity-aware face editing architecture based on Stable Diffusion XL (SDXL). CITA-Net employs an attribute-inversion data construction strategy derived from CelebAMask-HQ, enabling precise semantic disentanglement and controllable facial edits while preserving subject identity. Extensive experiments demonstrate that CITA-Net achieves a superior balance between editability, identity preservation, and visual fidelity, outperforming competitive diffusion-based baselines. In particular, our model attains lower identity loss, enhanced semantic alignment, and improved image quality. By unifying enhanced retrieval with photorealistic, identity-preserving face editing within a single framework, this work establishes a strong foundation for prompt-driven face understanding and enables practical applications such as forensic retrieval, semantic face editing, and natural language-based image search.

Zitieren

APA

Abd-Elsalam, A. A. M., Youssif, A. A. A., & Fathalla, R. (2026). CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval. IEEE Access, 14, 114661-114674. https://doi.org/10.1109/access.2026.3715404

Vancouver

Abd-Elsalam AAM, Youssif AAA, Fathalla R. CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval. IEEE Access. 2026;14:114661-114674. doi:10.1109/access.2026.3715404

BibTeX
@article{AbdElsalam2026,
  author = {Abd-Elsalam, Asmaa Alsayed Mohamed and Youssif, Aliaa A. A. and Fathalla, Radwa},
  title = {CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {114661--114674},
  doi = {10.1109/access.2026.3715404}
}
Kostenlos starten →