EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

IE-MAS: Internal–External Multi-Agent Steering for Controllable Image Captioning

Tiecheng Cai iD, Chao Chen, Shanshan Lin, Sibo Ju iD, Xiangwen Liao

Entropy · 07.12.2025 · 27 (12) · 1237

DOI: 10.3390/e27121237 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 07.12.2025. Verfasst von Tiecheng Cai und 4 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer and Data Science, Fuzhou University, Fuzhou 350108, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Controllable Image Captioning (CIC) aims to generate coherent and semantically faithful textual descriptions of images while adhering to user-specified constraints. Existing methods have achieved promising results under individual constraints such as sentimental style or sentence length. However, they typically fail to handle and satisfy multiple constraints simultaneously, as the controls often interact and interfere with one another. To overcome these challenges, we propose Internal–External Multi-Agent Steering (IE-MAS) for CIC. IE-MAS introduces an internal multimodal steering (IMS) strategy to control affective coherence within the caption, and an external multi-agent collaboration system (EMCS) to guide visual grounding and contextual alignment. From an information-theoretic view, IMS reduces uncertainty in the generation process, while EMCS strengthens the dependency between captions and visual inputs, converting the length and sentiment constraints into information gains. Together, they produce a stable balance among semantic consistency, affective expression, and length control through an adaptive steering process that dynamically balances internal linguistic control and external perceptual grounding. Experimental results demonstrate that IE-MAS effectively coordinates multiple constraints, producing captions that satisfy the length constraint and are sentimental expressive and visually faithful.

Schlagwörter

Stichwörter der Autor:innen

affective analysiscontrollable image captioninginformation theorymulti-agent systems

Autor:innen und Institutionen

  • College of Computer and Data Science, Fuzhou University, Fuzhou 350108, China.
  • School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China.

ORCID-Profile: Tiecheng Cai, Sibo Ju

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Cai, T., Chen, C., Lin, S., Ju, S., & Liao, X. (2025). IE-MAS: Internal–External Multi-Agent Steering for Controllable Image Captioning. Entropy, 27(12), 1237. https://doi.org/10.3390/e27121237

Vancouver

Cai T, Chen C, Lin S, Ju S, Liao X. IE-MAS: Internal–External Multi-Agent Steering for Controllable Image Captioning. Entropy. 2025;27(12):1237. doi:10.3390/e27121237

BibTeX
@article{Cai2025,
  author = {Cai, Tiecheng and Chen, Chao and Lin, Shanshan and Ju, Sibo and Liao, Xiangwen},
  title = {IE-MAS: Internal–External Multi-Agent Steering for Controllable Image Captioning},
  journal = {Entropy},
  year = {2025},
  volume = {27},
  number = {12},
  pages = {1237},
  doi = {10.3390/e27121237}
}
Kostenlos starten →