Identifying knowledge gaps on the edge for visual question answering
Frontiers in Computer Science · 17.06.2026 · 8
DOI: 10.3389/fcomp.2026.1817034 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 17.06.2026. Verfasst von Sarikaa Sridhar und 4 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Human Cognition is complex and highly sophisticated system capable of accomplishing astonishing feats, partly due to our ability to seek out and overcome “unknowns,” or gaps in our knowledge, skills, and capabilities. Artificial Intelligence (AI) systems often draw inspiration from human intelligence, however, they often lack the ability to recognize when their knowledge is insufficient, leading them to provide answers even when incorrect. This limitation poses significant challenges, particularly in human-AI teaming and edge AI scenarios, where systems may lack requisite knowledge of the environment. To address this, we propose Tiny Knowledge Gap Identification (TinyKGI), a lightweight framework for automatically identifying plausible cognitive skills that the model lacks (i.e., Knowledge Gaps; KGs), which could lead to incorrect predictions. Our framework leverages human cognitive skills to structure how AI models reason and to define the types of Knowledge Gaps they may plausibly exhibit. By identifying insufficient cognitive capabilities, TinyKGI enables the development of more reliable and robust AI systems. TinyKGI uses a deep learning approach to classify different types of KGs for multimodal reasoning tasks while enabling efficient inference in resource-constrained environments. Through model quantization, we significantly reduce the memory footprint and execution time, resulting in a compact and lightweight model. Evaluated on three datasets, TinyKGI improves Macro-F1 scores by up to 10% over the previous state-of-the-art, while achieving up to a 1.8 × speedup and a 4× reduction in memory usage. We further evaluate TinyKGI on an edge device (Jetson Nano), where it achieves a 1.7× speedup and a 3.9× reduction in memory with only a 0.1% degradation in Macro-F1 score.
Zitieren
APA
Sridhar, S., Ganesh, S. S., Bajaj, G., Myers, C., & Parthasarathy, S. (2026). Identifying knowledge gaps on the edge for visual question answering. Frontiers in Computer Science, 8. https://doi.org/10.3389/fcomp.2026.1817034
Vancouver
Sridhar S, Ganesh SS, Bajaj G, Myers C, Parthasarathy S. Identifying knowledge gaps on the edge for visual question answering. Frontiers in Computer Science. 2026;8. doi:10.3389/fcomp.2026.1817034
BibTeX
@article{Sridhar2026,
author = {Sridhar, Sarikaa and Ganesh, Sriram Sai and Bajaj, Goonmeet and Myers, Christopher and Parthasarathy, Srinivasan},
title = {Identifying knowledge gaps on the edge for visual question answering},
journal = {Frontiers in Computer Science},
year = {2026},
volume = {8},
doi = {10.3389/fcomp.2026.1817034}
}
EUVIMED