EUVIMEDEUVIMED entdecken
Crossref

Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset

Shuguang Dou, Xinyang Jiang, Lu Liu, Lu Ying, Caihua Shan, Yifei Shen, Xuanyi Dong, Yun Wang, Dongsheng Li, Cairong Zhao

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-12 · 46 (12) · 7556-7573

DOI: 10.1109/tpami.2024.3394298 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-12. Verfasst von Shuguang Dou und 9 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 68 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities and State Key Laboratory of Integrated Services Networks, Shanghai Innovation Action Project of Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The conventional approach to image recognition has been based on raster graphics, which can suffer from aliasing and information loss when scaled up or down. In this paper, we propose a novel approach that leverages the benefits of vector graphics for object localization and classification. Our method, called YOLaT (You Only Look at Text), takes the textual document of vector graphics as input, rather than rendering it into pixels. YOLaT builds multi-graphs to model the structural and spatial information in vector graphics and utilizes a dual-stream graph neural network (GNN) to detect objects from the graph. However, for real-world vector graphics, YOLaT only models in flat GNN with vertexes as nodes ignore higher-level information of vector data. Therefore, we propose YOLaT++ to learn Multi-level Abstraction Feature Learning from a new perspective: Primitive Shapes to Curves and Points. On the other hand, given few public datasets focus on vector graphics, data-driven learning cannot exert its full power on this format. We provide a large-scale and challenging dataset for Chart-based Vector Graphics Detection and Chart Understanding, termed VG-DCU, with vector graphics, raster graphics, annotations, and raw data drawn for creating these vector charts. Experiments show that the YOLaT series outperforms both vector graphics and raster graphics-based object detection methods on both subsets of VG-DCU in terms of both accuracy and efficiency, showcasing the potential of vector graphics for image recognition tasks.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities and State Key Laboratory of Integrated Services Networks
  • Shanghai Innovation Action Project of Science and Technology
  • Natural Science Foundation of Shanghai Municipality

Zitieren

APA

Dou, S., Jiang, X., Liu, L., Ying, L., Shan, C., Shen, Y., Dong, X., Wang, Y., Li, D., & Zhao, C. (2024). Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(12), 7556-7573. https://doi.org/10.1109/tpami.2024.3394298

Vancouver

Dou S, Jiang X, Liu L, Ying L, Shan C, Shen Y, et al. Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(12):7556-7573. doi:10.1109/tpami.2024.3394298

BibTeX
@article{Dou2024,
  author = {Dou, Shuguang and Jiang, Xinyang and Liu, Lu and Ying, Lu and Shan, Caihua and Shen, Yifei and Dong, Xuanyi and Wang, Yun and Li, Dongsheng and Zhao, Cairong},
  title = {Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2024},
  volume = {46},
  number = {12},
  pages = {7556--7573},
  doi = {10.1109/tpami.2024.3394298}
}
Kostenlos starten →