Real-Time Anomaly Detection on Edge Devices via VLM Prompt Optimization
Electronics · 27.07.2026 · 15 (15) · 3305
DOI: 10.3390/electronics15153305 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 27.07.2026. Verfasst von Sungmin Yu und 2 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Korea Planning & Evaluation Institute of Industrial Technology, the Korean government.
Abstract (Originalsprache)
Real-time video anomaly detection (VAD) under realistic edge constraints—sub-second latency, ≤25 W power, no cloud dependency, and human-interpretable output—remains an open problem. Existing lightweight video convolutional neural networks (X3D, MoViNets) are bound to closed-set training distributions, while recent vision–language-model-based VAD methods (LAVAD, VERA, Holmes-VAD) achieve 80–89% area under the curve (AUC) but rely on datacenter-grade GPUs and Chain-of-Thought (CoT) reasoning that pushes per-segment latency well above one second. This paper reframes the design target from peak accuracy to practical edge deployability and contributes two tightly coupled designs: (i) an edge-optimized inference stack that compresses Qwen3-VL-2B with 4-bit Activation-aware Weight Quantization (INT4 AWQ) and serves it through a TensorRT-LLM C++ runtime on NVIDIA Jetson Orin NX (16 GB, 25 W); and (ii) a fully automatic, CoT-free verbalized prompt optimization in which an 8B optimizer iteratively refines a natural-language definition block Dt using class-balanced (stratified) development batches on a disjoint development subset, with no human editing and no runtime cost on the edge device. Three findings support this framing: (a) the inference stack reduces per-segment latency to 0.25 s, a 7.4× speed-up and 55% memory reduction over a Python/PyTorch baseline; (b) verbalized prompt optimization improves zero-shot AUC from 71.82% (manual prompt) to 76.39%, outperforming GPT-4- and Gemini-Pro-generated prompts (74.12% and 74.35%) under the same edge backbone; and (c) single-frame input attains the highest mean AUC among one-, five-, and eight-frame windows—statistically comparable to the five-frame setting—while offering the lowest latency, making it the preferred operating point under the edge budget. While the absolute AUC (76.39%) is below recent server-side methods (CLIP-TSA 87.58%, VadCLIP 88.02%, Holmes-VAD 89.51%), our framework is the only one in this comparison that operates entirely on a ≤25 W edge device, providing a deployment-oriented operating point on the accuracy–feasibility frontier of VLM-based VAD.
Förderung
- the Korea Planning & Evaluation Institute of Industrial Technology
- the Korean government
Zitieren
APA
Yu, S., Moon, J., & Yoon, H. (2026). Real-Time Anomaly Detection on Edge Devices via VLM Prompt Optimization. Electronics, 15(15), 3305. https://doi.org/10.3390/electronics15153305
Vancouver
Yu S, Moon J, Yoon H. Real-Time Anomaly Detection on Edge Devices via VLM Prompt Optimization. Electronics. 2026;15(15):3305. doi:10.3390/electronics15153305
BibTeX
@article{Yu2026,
author = {Yu, Sungmin and Moon, Jongwon and Yoon, Hosub},
title = {Real-Time Anomaly Detection on Edge Devices via VLM Prompt Optimization},
journal = {Electronics},
year = {2026},
volume = {15},
number = {15},
pages = {3305},
doi = {10.3390/electronics15153305}
}
EUVIMED