Learned Data-aware Image Representations of Line Charts for Similarity Search
Proceedings of the ACM on Management of Data · 26.05.2023 · 1 (1) · 1-29
DOI: 10.1145/3588942 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 30.05.2023. Verfasst von Yuyu Luo und 5 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 88 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Zhejiang Labðs International Talent Fund for Young Professionals, Huawei Technologies.
Abstract (Originalsprache)
Finding line-chart images similar to a given line-chart image query is a common task in data exploration and image query systems, e.g. finding similar trends in stock markets or medical Electroencephalography images. The state-of-the-art approaches consider either data-level similarity (when the underlying data is present) or image-level similarity (when the underlying data is absent). In this paper, we study the scenario that during query time, only line-chart images are available. Our goal is to train a neural network that can turn these line-chart images into representations that are aware of the data used to generate these line charts, so as to learn better representations. Our key idea is that we can collect both data and line-chart images to learn such a neural network (at training step), while during query (or inference) time, we support the case that only line-chart images are provided. To this end, we present LineNet, a Vision Transformer-based Triplet Autoencoder model to learn data-aware image representations of line charts for similarity search. We design a novel pseudo labels selection mechanism to guide LineNet to capture both data-aware and image-level similarity of line charts. We further propose a diversified training samples selection strategy to optimize the learning process and improve the performance. We conduct both quantitative evaluation and case studies, showing that LineNet significantly outperforms the state-of-the-art methods for searching similar line-chart images.
Förderung
- National Natural Science Foundation of China
- Zhejiang Labðs International Talent Fund for Young Professionals
- Huawei Technologies
- TAL Education
Zitieren
APA
Luo, Y., Zhou, Y., Tang, N., Li, G., Chai, C., & Shen, L. (2023). Learned Data-aware Image Representations of Line Charts for Similarity Search. Proceedings of the ACM on Management of Data, 1(1), 1-29. https://doi.org/10.1145/3588942
Vancouver
Luo Y, Zhou Y, Tang N, Li G, Chai C, Shen L. Learned Data-aware Image Representations of Line Charts for Similarity Search. Proceedings of the ACM on Management of Data. 2023;1(1):1-29. doi:10.1145/3588942
BibTeX
@article{Luo2023,
author = {Luo, Yuyu and Zhou, Yihui and Tang, Nan and Li, Guoliang and Chai, Chengliang and Shen, Leixian},
title = {Learned Data-aware Image Representations of Line Charts for Similarity Search},
journal = {Proceedings of the ACM on Management of Data},
year = {2023},
volume = {1},
number = {1},
pages = {1--29},
doi = {10.1145/3588942}
}
EUVIMED