A Multimodal Vision-Language Framework for Financial Anomaly Detection
Proceedings of the International Conference on Business Excellence · 01.07.2026 · 20 (1) · 191-201
DOI: 10.2478/picbe-2026-0020 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the International Conference on Business Excellence, online erschienen am 15.07.2026. Verfasst von Siang-Li JHENG und 3 weiteren Autor:innen. Die Arbeit nennt 13 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Financial markets are complex systems where state estimation typically relies on either quantitative time-series models or subjective technical analysis. A gap remains in bridging scalable quantitative methods with the pattern-recognition intuition of human experts. In this work, we introduce a multimodal vision-language framework for financial anomaly detection that explores reframing market regime classification as a visual recognition task using advanced multimodal AI. We propose a methodology to project high-dimensional market indicators onto a standardized, multi-panel image format. We leverage the zero-shot capability of state-of-the-art Vision Language Models (VLMs), specifically GPT-4.1. We employ a rolling quantile-based approach for programmatic data labelling to reduce subjectivity. Furthermore, to address the need for transparency, our framework extracts structured natural language rationales directly from the model, offering interpretable insights alongside classifications. Our results, validated through out-of-sample testing on the S&P500, suggest that this multimodal prompting approach achieves promising fidelity in detecting systemic anomalies, indicating its potential as a reliable and interpretable framework for financial AI.
Zitieren
APA
JHENG, S., PELE, D. T., TAK, R., & GAMAN, Ş. (2026). A Multimodal Vision-Language Framework for Financial Anomaly Detection. Proceedings of the International Conference on Business Excellence, 20(1), 191-201. https://doi.org/10.2478/picbe-2026-0020
Vancouver
JHENG S, PELE DT, TAK R, GAMAN Ş. A Multimodal Vision-Language Framework for Financial Anomaly Detection. Proceedings of the International Conference on Business Excellence. 2026;20(1):191-201. doi:10.2478/picbe-2026-0020
BibTeX
@article{JHENG2026,
author = {JHENG, Siang-Li and PELE, Daniel Traian and TAK, Rahul and GAMAN, Ştefan},
title = {A Multimodal Vision-Language Framework for Financial Anomaly Detection},
journal = {Proceedings of the International Conference on Business Excellence},
year = {2026},
volume = {20},
number = {1},
pages = {191--201},
doi = {10.2478/picbe-2026-0020}
}
EUVIMED