Multi-Modal Method for Candidate Interview Assessment Based on Computer Vision and Large Language Models
Big Data and Cognitive Computing · 01.04.2026 · 10 (4) · 106
DOI: 10.3390/bdcc10040106 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 01.04.2026. Verfasst von Kenan Kassab und 2 weiteren Autor:innen. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Russian State Research.
Abstract (Originalsprache)
Candidate interview assessment is primarily reliant on subjective human judgment, while existing AI-based methods rely on end-to-end predictions with no psychometric basis. In this paper, we propose an interpretable multi-modal framework that combines nonverbal behavior, LLM-based verbal analysis, and Big Five personality traits into three theory-based constructs: professional-cognitive competence, observed leadership behavior, and leadership disposition. The proposed method utilizes computer vision and larger language models to extract features from video interviews. Rather than targeting predictive accuracy, the proposed method prioritizes construct validity and transparent aggregation under severe label scarcity. The proposed method aggregates the constructs into a Top Potential Score that reflects the executive abilities of the candidate. Experiments on the method show its ability to significantly differentiate top candidates from others (Cliff’s delta = 0.91 for the composite Top Potential Score, permutation p = 0.0002). Leave-one-out analysis verifies robustness, while rank-based evaluation yields 100% recall of executive candidates in the top 20% of rated applications. The findings justify the use of the proposed multi-modal method as an interpretable decision-support tool for candidate interview assessment.
Förderung
- Russian State Research
Zitieren
APA
Kassab, K., Kashevnik, A., & Shoshina, I. (2026). Multi-Modal Method for Candidate Interview Assessment Based on Computer Vision and Large Language Models. Big Data and Cognitive Computing, 10(4), 106. https://doi.org/10.3390/bdcc10040106
Vancouver
Kassab K, Kashevnik A, Shoshina I. Multi-Modal Method for Candidate Interview Assessment Based on Computer Vision and Large Language Models. Big Data and Cognitive Computing. 2026;10(4):106. doi:10.3390/bdcc10040106
BibTeX
@article{Kassab2026,
author = {Kassab, Kenan and Kashevnik, Alexey and Shoshina, Irina},
title = {Multi-Modal Method for Candidate Interview Assessment Based on Computer Vision and Large Language Models},
journal = {Big Data and Cognitive Computing},
year = {2026},
volume = {10},
number = {4},
pages = {106},
doi = {10.3390/bdcc10040106}
}
EUVIMED