ReSORT: LLM-Guided Policy Selection for New-ID Assignment Under Occlusion in Multi-Object Tracking
Applied Sciences · 18.11.2026 · 16 (22) · 11445
DOI: 10.3390/app162211445 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 18.11.2026. Verfasst von Yujin Roh und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objects that reappear after occlusion can receive new identities when data association fails, fragmenting trajectories. We present ReSORT, an identity recovery framework that evaluates competing links using motion history, numerical association scores, and selective language-model evidence. Camera-compensated trajectory states are propagated through five motion hypotheses to construct a persistent candidate graph. A numerical ranker scores candidate links, and a frozen Qwen3.5-4B model reviews selected ambiguous cases using image crops and scene context. Candidate-order consistency checks filter the model responses before their relative evidence enters a global one-to-one assignment. Inference does not access ground truth; the numerical ranker is trained with supervision, and the evaluated reassociation uses subsequent observations offline. On seven MOT17 development videos, the complete pipeline produces 243 identity switches, compared with 427 for native ByteTrack and 299 for the historical automatic ReSORT reference, with IDF1 of 85.96% and HOTA of 78.06%. The historical comparison includes changes beyond the final language-model component, whose contribution is assessed separately through matched ablations. Experiments across seven tracker families on MOT17 and MOT20 show tracker-dependent benefits and sensitivity to evidence weighting. The results support selective language-model verification within a constrained association system while identifying limitations in response consistency, computational cost, and development-set evaluation.
Zitieren
APA
Roh, Y., Park, I. J., Oh, S., Lee, D., & Hwang, C. (2026). ReSORT: LLM-Guided Policy Selection for New-ID Assignment Under Occlusion in Multi-Object Tracking. Applied Sciences, 16(22), 11445. https://doi.org/10.3390/app162211445
Vancouver
Roh Y, Park IJ, Oh S, Lee D, Hwang C. ReSORT: LLM-Guided Policy Selection for New-ID Assignment Under Occlusion in Multi-Object Tracking. Applied Sciences. 2026;16(22):11445. doi:10.3390/app162211445
BibTeX
@article{Roh2026,
author = {Roh, Yujin and Park, Inho Jake and Oh, Subin and Lee, Daesung and Hwang, Chigon},
title = {ReSORT: LLM-Guided Policy Selection for New-ID Assignment Under Occlusion in Multi-Object Tracking},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {22},
pages = {11445},
doi = {10.3390/app162211445}
}
EUVIMED