PatientVLM Meets DocVLM: Pre-Consultation Dialogue Between Vision-Language Models for Efficient Diagnosis
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (9) · 7485-7493
DOI: 10.1609/aaai.v40i9.37688 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von K Lokesh und 6 weiteren Autor:innen.
Abstract (Originalsprache)
Traditionally, AI research in medical diagnosis has largely centered on image analysis. While this has led to notable advancements, the absence of patient-reported symptoms continues to hinder diagnostic accuracy. To address this, we propose a Pre-Consultation Dialogue Framework (PCDF) that mimics real-world diagnostic procedures, where doctors iteratively query patients before reaching a conclusion. Specifically, we simulate diagnostic dialogues between two vision–language models (VLMs): a DocVLM, which generates follow-up questions based on the image and dialogue history, and a PatientVLM, which responds using a symptom profile derived from the ground-truth diagnosis. We additionally conducted a small-scale clinical validation of the synthetic symptoms generated by our framework, with licensed clinicians confirming their clinical relevance, symptom coverage, and overall realism. These findings indicate that the resulting DocVLM–PatientVLM interactions form coherent, multi-turn consultations paired with images and diagnoses, which we then use to fine-tune the DocVLM. This dialogue-based supervision leads to substantial gains over image-only training, highlighting the value of realistic symptom elicitation for diagnosis.
Zitieren
APA
Lokesh, K., Penamakuri, A. S., Agarwal, U., Challa, A., Gowda, S. K., Gupta, S., & Mishra, A. (2026). PatientVLM Meets DocVLM: Pre-Consultation Dialogue Between Vision-Language Models for Efficient Diagnosis. Proceedings of the AAAI Conference on Artificial Intelligence, 40(9), 7485-7493. https://doi.org/10.1609/aaai.v40i9.37688
Vancouver
Lokesh K, Penamakuri AS, Agarwal U, Challa A, Gowda SK, Gupta S, et al. PatientVLM Meets DocVLM: Pre-Consultation Dialogue Between Vision-Language Models for Efficient Diagnosis. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(9):7485-7493. doi:10.1609/aaai.v40i9.37688
BibTeX
@article{Lokesh2026,
author = {Lokesh, K and Penamakuri, Abhirama Subramanyam and Agarwal, Uday and Challa, Apoorva and Gowda, Shreya K and Gupta, Somesh and Mishra, Anand},
title = {PatientVLM Meets DocVLM: Pre-Consultation Dialogue Between Vision-Language Models for Efficient Diagnosis},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {9},
pages = {7485--7493},
doi = {10.1609/aaai.v40i9.37688}
}
EUVIMED