EUVIMEDEUVIMED entdecken
Crossref

Nano-jev: Calibrated Cross-Encoder Micro-Decisions for Retrieval-Augmented Generation with Confidence Cascading

Subham Divakar, Rojalina Priyadarshini

ICCK Transactions on Intelligent Systematics · 16.11.2026 · 3 (4) · 245-260

DOI: 10.62762/tis.2026.197904 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ICCK Transactions on Intelligent Systematics, online erschienen am 16.11.2026. Verfasst von Subham Divakar und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Retrieval-Augmented Generation (RAG) pipelines repeatedly make small judgments, such as whether a passage is relevant, whether the retrieved context is sufficient and whether an answer is grounded. These are usually delegated to the generating large language model (LLM), at notable latency and cost, or to score thresholds without a probabilistic interpretation. We study nano-jev, a 33.4\,M-parameter cross-encoder that treats relevance (3-way), sufficiency and groundedness (binary) as typed, closed-set classification problems and returns temperature-calibrated probabilities. Each (question, option, context) triple is scored by a single-logit head, which makes predictions invariant to option order. On held-out halves of the HotpotQA, SQuAD~2.0 and MultiNLI validation sets, nano-jev reaches mean accuracies of 0.812 (relevance), 0.843 (sufficiency) and 0.841 (groundedness) over five seeds, comparable to a 1-pass classifier trained on the same data, which is 2.5$\times$ faster. Dedicated checkers such as MiniCheck remain stronger on groundedness (0.866). nano-jev runs 55-93$\times$ faster than a prompted 4\,B-parameter LLM. On unseen datasets (MuSiQue, VitaminC), accuracy drops by 15-20 points and ECE rises from about 0.03 to about 0.17, so target-domain re-calibration is advisable. A confidence cascade that escalates uncertain decisions to the LLM improves in-distribution groundedness (0.868 vs. 0.841, $p=0.02$) with about a quarter of decisions escalated, but trades accuracy for latency out of distribution. In a small end-to-end test, nano-jev relevance filtering improves HotpotQA answer F1 by 2.1 points at about 39ms per question. Code and weights are released as an open-source package.

Zitieren

APA

Divakar, S., & Priyadarshini, R. (2026). Nano-jev: Calibrated Cross-Encoder Micro-Decisions for Retrieval-Augmented Generation with Confidence Cascading. ICCK Transactions on Intelligent Systematics, 3(4), 245-260. https://doi.org/10.62762/tis.2026.197904

Vancouver

Divakar S, Priyadarshini R. Nano-jev: Calibrated Cross-Encoder Micro-Decisions for Retrieval-Augmented Generation with Confidence Cascading. ICCK Transactions on Intelligent Systematics. 2026;3(4):245-260. doi:10.62762/tis.2026.197904

BibTeX
@article{Divakar2026,
  author = {Divakar, Subham and Priyadarshini, Rojalina},
  title = {Nano-jev: Calibrated Cross-Encoder Micro-Decisions for Retrieval-Augmented Generation with Confidence Cascading},
  journal = {ICCK Transactions on Intelligent Systematics},
  year = {2026},
  volume = {3},
  number = {4},
  pages = {245--260},
  doi = {10.62762/tis.2026.197904}
}
Kostenlos starten →