CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval
IEEE Access · 2026 · 14 · 114661-114674
DOI: 10.1109/access.2026.3715404 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Asmaa Alsayed Mohamed Abd-Elsalam und 2 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Text-driven face understanding fundamentally depends on the quality of semantic descriptions; however, most existing face datasets provide only coarse or generic captions, limiting both retrieval accuracy and controllable face synthesis. Despite recent advances in multimodal generative models, face-centric applications continue to suffer from two critical challenges: reliable image retrieval from textual descriptions and identity-preserving semantic editing. In this work, we propose a modular yet unified framework that jointly addresses these challenges through enhanced semantic grounding and controlled generative modeling. First, we leverage LLaVA to automatically transform basic annotations in the dataset into rich, fine-grained facial descriptions through a multimodal semantic distillation process, significantly strengthening text–image alignment and improving large-scale text-based face retrieval. Building upon this semantic foundation, we introduce CITA-Net, a novel identity-aware face editing architecture based on Stable Diffusion XL (SDXL). CITA-Net employs an attribute-inversion data construction strategy derived from CelebAMask-HQ, enabling precise semantic disentanglement and controllable facial edits while preserving subject identity. Extensive experiments demonstrate that CITA-Net achieves a superior balance between editability, identity preservation, and visual fidelity, outperforming competitive diffusion-based baselines. In particular, our model attains lower identity loss, enhanced semantic alignment, and improved image quality. By unifying enhanced retrieval with photorealistic, identity-preserving face editing within a single framework, this work establishes a strong foundation for prompt-driven face understanding and enables practical applications such as forensic retrieval, semantic face editing, and natural language-based image search.
Zitieren
APA
Abd-Elsalam, A. A. M., Youssif, A. A. A., & Fathalla, R. (2026). CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval. IEEE Access, 14, 114661-114674. https://doi.org/10.1109/access.2026.3715404
Vancouver
Abd-Elsalam AAM, Youssif AAA, Fathalla R. CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval. IEEE Access. 2026;14:114661-114674. doi:10.1109/access.2026.3715404
BibTeX
@article{AbdElsalam2026,
author = {Abd-Elsalam, Asmaa Alsayed Mohamed and Youssif, Aliaa A. A. and Fathalla, Radwa},
title = {CITA-Net: A Unified Multimodal Pipeline for Identity-Preserving Face Editing, Enhanced Captioning, and Text-Based Retrieval},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {114661--114674},
doi = {10.1109/access.2026.3715404}
}
EUVIMED