EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Decision Models as L2 Rerankers for Content-Based Recommendation: A Pre-Registered Evaluation

Purva Bangad, Harikrishnan Girikumar

Information · 12.11.2026 · 17 (11) · 1141

DOI: 10.3390/info17111141 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 12.11.2026. Verfasst von Purva Bangad und 1 weiteren Autor:innen. Die Arbeit nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In content-based recommendation, a second-stage (L2) reranker decides which retrieved items fill the first screen. Decision models, which answer a typed question about a text with a probability, are an alternative to trained cross-encoders, but whether they separate exact matches from close substitutes is unknown. We cast a decision model as a pointwise reranker that asks whether each candidate exactly matches the request. Under a pre-registered protocol, a gain must hold on both retrieved and fully labelled lists. On Amazon ESCI (1000 requests) and Wayfair WANDS (299), the commercial Jev model, used zero-shot, improves P@10 over embedding order by 0.046 to 0.054 and beats the 0.6B Qwen3-Reranker by 0.02 to 0.03 on ESCI, but not significantly on WANDS. Larger trained cross-encoders (Qwen3-Reranker-4B and 8B, bge-reranker-v2-m3) erase most of this lead: Jev is ahead only on fully labelled ESCI lists. A prompted Qwen3-8B stays behind Jev everywhere. The open decision model CLM-v0.1-8B ranks at random level when scoring a whole list but matches embedding order one product at a time. Jev costs about as much as the 4B model and 13 times bge-reranker-v2-m3. A decision model can serve as an L2 reranker but not demonstrably better than trained cross-encoders.

Zitieren

APA

Bangad, P., & Girikumar, H. (2026). Decision Models as L2 Rerankers for Content-Based Recommendation: A Pre-Registered Evaluation. Information, 17(11), 1141. https://doi.org/10.3390/info17111141

Vancouver

Bangad P, Girikumar H. Decision Models as L2 Rerankers for Content-Based Recommendation: A Pre-Registered Evaluation. Information. 2026;17(11):1141. doi:10.3390/info17111141

BibTeX
@article{Bangad2026,
  author = {Bangad, Purva and Girikumar, Harikrishnan},
  title = {Decision Models as L2 Rerankers for Content-Based Recommendation: A Pre-Registered Evaluation},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {11},
  pages = {1141},
  doi = {10.3390/info17111141}
}
Kostenlos starten →