EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Multimodal Vision-Language Framework for Financial Anomaly Detection

Siang-Li JHENG, Daniel Traian PELE, Rahul TAK, Ştefan GAMAN

Proceedings of the International Conference on Business Excellence · 01.07.2026 · 20 (1) · 191-201

DOI: 10.2478/picbe-2026-0020 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the International Conference on Business Excellence, online erschienen am 15.07.2026. Verfasst von Siang-Li JHENG und 3 weiteren Autor:innen. Die Arbeit nennt 13 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Financial markets are complex systems where state estimation typically relies on either quantitative time-series models or subjective technical analysis. A gap remains in bridging scalable quantitative methods with the pattern-recognition intuition of human experts. In this work, we introduce a multimodal vision-language framework for financial anomaly detection that explores reframing market regime classification as a visual recognition task using advanced multimodal AI. We propose a methodology to project high-dimensional market indicators onto a standardized, multi-panel image format. We leverage the zero-shot capability of state-of-the-art Vision Language Models (VLMs), specifically GPT-4.1. We employ a rolling quantile-based approach for programmatic data labelling to reduce subjectivity. Furthermore, to address the need for transparency, our framework extracts structured natural language rationales directly from the model, offering interpretable insights alongside classifications. Our results, validated through out-of-sample testing on the S&P500, suggest that this multimodal prompting approach achieves promising fidelity in detecting systemic anomalies, indicating its potential as a reliable and interpretable framework for financial AI.

Zitieren

APA

JHENG, S., PELE, D. T., TAK, R., & GAMAN, Ş. (2026). A Multimodal Vision-Language Framework for Financial Anomaly Detection. Proceedings of the International Conference on Business Excellence, 20(1), 191-201. https://doi.org/10.2478/picbe-2026-0020

Vancouver

JHENG S, PELE DT, TAK R, GAMAN Ş. A Multimodal Vision-Language Framework for Financial Anomaly Detection. Proceedings of the International Conference on Business Excellence. 2026;20(1):191-201. doi:10.2478/picbe-2026-0020

BibTeX
@article{JHENG2026,
  author = {JHENG, Siang-Li and PELE, Daniel Traian and TAK, Rahul and GAMAN, Ştefan},
  title = {A Multimodal Vision-Language Framework for Financial Anomaly Detection},
  journal = {Proceedings of the International Conference on Business Excellence},
  year = {2026},
  volume = {20},
  number = {1},
  pages = {191--201},
  doi = {10.2478/picbe-2026-0020}
}
Kostenlos starten →