EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Meta-Label-Corrected Knowledge Distillation for Partial Multi-Label Learning

Jiwei Shuai, Can Xu, Haiyan Jiang, Bin Hu

Electronics · 2026-03-16 · 15 (6) · 1233

DOI: 10.3390/electronics15061233 ↗

At a glance

Journal article in Electronics, published online on 2026-03-16. Written by Jiwei Shuai and 3 co-authors. 36 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China, Key Research and Development Program of Jiangsu Province, Fundamental Research Funds for the Central Universities.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Partial multi-label learning (PML) assigns each instance a candidate label set that contains all relevant labels but may also include irrelevant noisy ones, making reliable disambiguation essential. Although a small number of verified clean labels is often available in practice, existing PML methods rarely exploit such information to explicitly guide candidate-label correction. Meanwhile, directly applying knowledge distillation (KD) to PML is highly vulnerable to noisy supervision during representation learning, which can aggravate error accumulation under overlapping candidate labels. To address these issues, we propose a meta-guided distillation framework for PML that integrates teacher–student learning with nested meta-optimization. Specifically, the teacher is optimized with large-scale noisy data under the guidance of limited clean labels, so that it can learn calibrated probabilistic label semantics and generate corrected soft targets for student training. To make this meta-correction process scalable, a truncated meta-gradient approximation is further adopted to reduce computational overhead. The resulting corrected teacher outputs are then used to drive robust multi-label distillation for the student. Experiments on multiple benchmark multi-label image datasets demonstrate consistent improvements over seven representative PML methods across standard evaluation metrics. These results show that meta-guided calibration effectively reduces semantic ambiguity and mitigates noise-induced error propagation in partial multi-label learning.

Funding

  • National Natural Science Foundation of China
  • Key Research and Development Program of Jiangsu Province
  • Fundamental Research Funds for the Central Universities

Cite

APA

Shuai, J., Xu, C., Jiang, H., & Hu, B. (2026). Meta-Label-Corrected Knowledge Distillation for Partial Multi-Label Learning. Electronics, 15(6), 1233. https://doi.org/10.3390/electronics15061233

Vancouver

Shuai J, Xu C, Jiang H, Hu B. Meta-Label-Corrected Knowledge Distillation for Partial Multi-Label Learning. Electronics. 2026;15(6):1233. doi:10.3390/electronics15061233

BibTeX
@article{Shuai2026,
  author = {Shuai, Jiwei and Xu, Can and Jiang, Haiyan and Hu, Bin},
  title = {Meta-Label-Corrected Knowledge Distillation for Partial Multi-Label Learning},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {6},
  pages = {1233},
  doi = {10.3390/electronics15061233}
}
Start for free →