EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Semantic-Structural Alignment for Generative Pictorial Charts

Zhida Sun, Yulin Zhang, Zheng Gu, Min Lu, Bongshin Lee, Daniel Cohen-Or, Hui Huang

ACM Transactions on Graphics · 03.07.2026 · 45 (4) · 1-11

DOI: 10.1145/3811313 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 03.07.2026. Verfasst von Zhida Sun und 6 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ICFCRT, Guangdong Basic and Applied Basic Research Foundation, Guangdong Natural Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional statistical graphics are precise but often lack the visual appeal, memorability, and engagement of pictorial charts. We present a generative framework for the automated synthesis of pictorial charts that bridges the gap between semantic expression and structural faithfulness. Rather than treating charts merely as images to be stylized, we frame the problem as a dual-conditioned generation task guided by two parallel external control signals: a text prompt capturing the semantic context of the editing intent, and a context image providing the abstract statistical chart's global structure. To reinforce these controls within a Multi-Modal Diffusion Transformer, we introduce two complementary feature-level mechanisms: structural alignment to anchor spatial layouts to the input chart, and semantic alignment to transfer expressive textures from reference images. Generalizing across major visual channels (i.e., length, area, angle, and position) and diverse semantic domains, our method produces pictorial charts that are both artistically compelling and structurally consistent. Extensive quantitative evaluations and perceptual user studies demonstrate that our framework outperforms traditional controllable generation and image editing baselines, providing a foundation for high-fidelity, data-driven generative modeling in expressive visual storytelling. Project page: https://ssalign.github.io/.

Förderung

  • ICFCRT
  • Guangdong Basic and Applied Basic Research Foundation
  • Guangdong Natural Science Foundation
  • Shenzhen Science and Technology Program

Zitieren

APA

Sun, Z., Zhang, Y., Gu, Z., Lu, M., Lee, B., Cohen-Or, D., & Huang, H. (2026). Semantic-Structural Alignment for Generative Pictorial Charts. ACM Transactions on Graphics, 45(4), 1-11. https://doi.org/10.1145/3811313

Vancouver

Sun Z, Zhang Y, Gu Z, Lu M, Lee B, Cohen-Or D, et al. Semantic-Structural Alignment for Generative Pictorial Charts. ACM Transactions on Graphics. 2026;45(4):1-11. doi:10.1145/3811313

BibTeX
@article{Sun2026,
  author = {Sun, Zhida and Zhang, Yulin and Gu, Zheng and Lu, Min and Lee, Bongshin and Cohen-Or, Daniel and Huang, Hui},
  title = {Semantic-Structural Alignment for Generative Pictorial Charts},
  journal = {ACM Transactions on Graphics},
  year = {2026},
  volume = {45},
  number = {4},
  pages = {1--11},
  doi = {10.1145/3811313}
}
Kostenlos starten →