EUVIMEDEUVIMED entdecken
Crossref

Beyond Zero-Shot Business Process Diagram Extraction: Supervised Adaptation and Reliability Limits of Vision-Language Models

Pritam Deka, Ruixi Wang

ACM SIGAPP Applied Computing Review · 01.09.2026 · 26 (3) · 50-67

DOI: 10.1145/3856766.3856770 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGAPP Applied Computing Review, online erschienen am 02.11.2026. Verfasst von Pritam Deka und 1 weiteren Autor:innen. Die Arbeit nennt 69 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Business Process Model and Notation (BPMN) is widely used to represent complex workflows, yet many process diagrams survive only as images, limiting their use in computational analysis, model migration, and workflow tools. This study investigates direct image-to-JSON reconstruction with vision-language models (VLMs) through two complementary experimental stages. The first evaluates fourteen proprietary and open VLMs under zero-shot, optical-character-recognition-enriched, and prompt-ablation conditions using an aligned 202-diagram benchmark. The second adapts four open multimodal checkpoints using 3,478 English-translated BPMN image/XML pairs and low-rank adaptation. Canonical JSON targets are generated deterministically from the XML, and the adapted models are evaluated across three seeds for output validity, entity and relation extraction, prompt robustness, structural complexity, and external generalisation. To account for the loss of original scenario provenance, exact graph overlap is audited across the frozen dataset splits, and internal evaluation is distinguished from evaluation on a separate benchmark. Together, these stages provide a unified framework for studying zero-shot extraction and supervised adaptation while treating structural accuracy, output validity, dataset provenance, and diagram complexity as essential dimensions of BPMN reconstruction.

Zitieren

APA

Deka, P., & Wang, R. (2026). Beyond Zero-Shot Business Process Diagram Extraction: Supervised Adaptation and Reliability Limits of Vision-Language Models. ACM SIGAPP Applied Computing Review, 26(3), 50-67. https://doi.org/10.1145/3856766.3856770

Vancouver

Deka P, Wang R. Beyond Zero-Shot Business Process Diagram Extraction: Supervised Adaptation and Reliability Limits of Vision-Language Models. ACM SIGAPP Applied Computing Review. 2026;26(3):50-67. doi:10.1145/3856766.3856770

BibTeX
@article{Deka2026,
  author = {Deka, Pritam and Wang, Ruixi},
  title = {Beyond Zero-Shot Business Process Diagram Extraction: Supervised Adaptation and Reliability Limits of Vision-Language Models},
  journal = {ACM SIGAPP Applied Computing Review},
  year = {2026},
  volume = {26},
  number = {3},
  pages = {50--67},
  doi = {10.1145/3856766.3856770}
}
Kostenlos starten →