EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

JDCEMB: Joint Distillation and Contrastive Learning for Embeddings in Task-Oriented Dialogue Systems

A. I. Burykina, D. R. Ledneva, D. P. Kuznetsov

Doklady Mathematics · 2025-08 · 112 (1) · 319-331

DOI: 10.1134/s1064562425700243 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Doklady Mathematics, online erschienen am 02.03.2026. Verfasst von A. I. Burykina und 2 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present JDCEmb—a new framework for training universal vector representations in task-oriented dialogue tasks. Text encoders play a crucial role in such systems, and their quality determines the effectiveness of dialogue systems. Modern approaches to training dialogue encoders often rely on contrastive methods, which improve the distinguishability of representations but are sensitive to the selection of positive and negative pairs. This can lead to loss of important semantic information. Knowledge distillation-based methods, on the other hand, transfer more context but struggle to distinguish similar utterances and perform poorly with subtle semantic differences. JDCEmb combines the strengths of both approaches using a teacher–student architecture, where the student model is trained contrastively and aligned with the teacher model’s vector representations simultaneously. This combination makes it possible to maintain semantic richness while enhancing the distinctiveness of vector representations–crucial for dialogue systems. Experimental results on key dialogue tasks demonstrate the effectiveness of the approach: JDCEmb consistently reaches or surpasses state-of-the-art levels, outperforming strong current baseline models.

Zitieren

APA

Burykina, A. I., Ledneva, D. R., & Kuznetsov, D. P. (2025). JDCEMB: Joint Distillation and Contrastive Learning for Embeddings in Task-Oriented Dialogue Systems. Doklady Mathematics, 112(1), 319-331. https://doi.org/10.1134/s1064562425700243

Vancouver

Burykina AI, Ledneva DR, Kuznetsov DP. JDCEMB: Joint Distillation and Contrastive Learning for Embeddings in Task-Oriented Dialogue Systems. Doklady Mathematics. 2025;112(1):319-331. doi:10.1134/s1064562425700243

BibTeX
@article{Burykina2025,
  author = {Burykina, A. I. and Ledneva, D. R. and Kuznetsov, D. P.},
  title = {JDCEMB: Joint Distillation and Contrastive Learning for Embeddings in Task-Oriented Dialogue Systems},
  journal = {Doklady Mathematics},
  year = {2025},
  volume = {112},
  number = {1},
  pages = {319--331},
  doi = {10.1134/s1064562425700243}
}
Kostenlos starten →