Enhancing Question Generation through Diversity-Seeking Reinforcement Learning with Bilevel Policy Decomposition
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (23) · 25083-25091
DOI: 10.1609/aaai.v39i23.34693 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Tianyu Ren und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref).
Abstract (Originalsprache)
Recent advancements in question generation (QG) have been significantly propelled by reinforcement learning (RL). Although extensive reward models have been designed to capture the attributes of ideal questions, their associated learning challenges, particularly in sample efficiency and diversity, remain underexplored. This paper introduces a bilevel policy decomposition (BPD) framework and a diversity-seeking RL (DSRL) objective to address these issues. The BPD framework utilizes two cascading policies to divide QG into two more manageable sub-tasks: answer-centric summary generation and summary-augmented QG, facilitating exploration and accelerating policy learning. Concurrently, the DSRL objective preserves the inherent diversity of QG by ensuring the bilevel policies align probabilistically with their reward models rather than merely maximizing returns. Our integrated approach, named BPD-DSRL, demonstrates superior performance over existing baselines on multiple question quality and diversity metrics across various QG benchmarks.
Zitieren
APA
Ren, T., Wang, H., & Rafferty, K. (2025). Enhancing Question Generation through Diversity-Seeking Reinforcement Learning with Bilevel Policy Decomposition. Proceedings of the AAAI Conference on Artificial Intelligence, 39(23), 25083-25091. https://doi.org/10.1609/aaai.v39i23.34693
Vancouver
Ren T, Wang H, Rafferty K. Enhancing Question Generation through Diversity-Seeking Reinforcement Learning with Bilevel Policy Decomposition. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(23):25083-25091. doi:10.1609/aaai.v39i23.34693
BibTeX
@article{Ren2025,
author = {Ren, Tianyu and Wang, Hui and Rafferty, Karen},
title = {Enhancing Question Generation through Diversity-Seeking Reinforcement Learning with Bilevel Policy Decomposition},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {23},
pages = {25083--25091},
doi = {10.1609/aaai.v39i23.34693}
}
EUVIMED