Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-12 · 46 (12) · 7556-7573
DOI: 10.1109/tpami.2024.3394298 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-12. Verfasst von Shuguang Dou und 9 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 68 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities and State Key Laboratory of Integrated Services Networks, Shanghai Innovation Action Project of Science and Technology.
Abstract (Originalsprache)
The conventional approach to image recognition has been based on raster graphics, which can suffer from aliasing and information loss when scaled up or down. In this paper, we propose a novel approach that leverages the benefits of vector graphics for object localization and classification. Our method, called YOLaT (You Only Look at Text), takes the textual document of vector graphics as input, rather than rendering it into pixels. YOLaT builds multi-graphs to model the structural and spatial information in vector graphics and utilizes a dual-stream graph neural network (GNN) to detect objects from the graph. However, for real-world vector graphics, YOLaT only models in flat GNN with vertexes as nodes ignore higher-level information of vector data. Therefore, we propose YOLaT++ to learn Multi-level Abstraction Feature Learning from a new perspective: Primitive Shapes to Curves and Points. On the other hand, given few public datasets focus on vector graphics, data-driven learning cannot exert its full power on this format. We provide a large-scale and challenging dataset for Chart-based Vector Graphics Detection and Chart Understanding, termed VG-DCU, with vector graphics, raster graphics, annotations, and raw data drawn for creating these vector charts. Experiments show that the YOLaT series outperforms both vector graphics and raster graphics-based object detection methods on both subsets of VG-DCU in terms of both accuracy and efficiency, showcasing the potential of vector graphics for image recognition tasks.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities and State Key Laboratory of Integrated Services Networks
- Shanghai Innovation Action Project of Science and Technology
- Natural Science Foundation of Shanghai Municipality
Zitieren
APA
Dou, S., Jiang, X., Liu, L., Ying, L., Shan, C., Shen, Y., Dong, X., Wang, Y., Li, D., & Zhao, C. (2024). Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(12), 7556-7573. https://doi.org/10.1109/tpami.2024.3394298
Vancouver
Dou S, Jiang X, Liu L, Ying L, Shan C, Shen Y, et al. Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(12):7556-7573. doi:10.1109/tpami.2024.3394298
BibTeX
@article{Dou2024,
author = {Dou, Shuguang and Jiang, Xinyang and Liu, Lu and Ying, Lu and Shan, Caihua and Shen, Yifei and Dong, Xuanyi and Wang, Yun and Li, Dongsheng and Zhao, Cairong},
title = {Hierarchically Recognizing Vector Graphics and A New Chart-Based Vector Graphics Dataset},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {12},
pages = {7556--7573},
doi = {10.1109/tpami.2024.3394298}
}
EUVIMED