AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic
Applied Sciences · 09.04.2026 · 16 (8) · 3687
DOI: 10.3390/app16083687 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 09.04.2026. Verfasst von Qiuqi Gao und 4 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Municipal Education Commission, Beijing Union University, National Natural Science Foundation of China.
Abstract (Originalsprache)
Highway ramp merging requires autonomous vehicles to make safe and efficient decisions in dense mixed traffic, where strong vehicle interactions and rapidly changing acceptable gaps make the task particularly challenging. Existing reinforcement learning methods are often unimodal and overly conservative, while diffusion-based policies, despite their ability to generate multimodal actions, usually suffer from high inference latency and safety risks caused by unconstrained sampling. To address these issues, this paper proposes AM-DIMPO, an action-mask-guided safe diffusion-implicit policy optimization framework for ramp-merging tasks. The proposed method combines DDIM-based implicit sampling with a state-dependent continuous action mask to improve multimodal action generation efficiency while enhancing action feasibility. In addition, the mask correction signal is incorporated into policy learning to encourage the policy to generate actions closer to the safe feasible region. Experiments are conducted in a Gym-based ramp-merging simulator under both light-traffic and dense-traffic scenarios, where the proposed method is compared with classical reinforcement learning baselines, diffusion reinforcement learning baselines, and a safety-aware PPO baseline. The results show that, in dense traffic, AM-DIMPO achieves a merging success rate of 97.3%, an average speed of 16.27 m/s, and an inference latency of 68 ms; in light traffic, the success rate reaches 98.1%. Moreover, the proposed method maintains robust performance under the tested noisy-observation and reduced-visibility settings. Overall, AM-DIMPO achieves a favorable balance among empirical safety, traffic efficiency, robustness, and real-time inference performance in dense highway ramp-merging tasks.
Förderung
- Beijing Municipal Education Commission
- Beijing Union University
- National Natural Science Foundation of China
Zitieren
APA
Gao, Q., Li, J., Huang, X., Zhu, Y., & Du, Y. (2026). AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic. Applied Sciences, 16(8), 3687. https://doi.org/10.3390/app16083687
Vancouver
Gao Q, Li J, Huang X, Zhu Y, Du Y. AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic. Applied Sciences. 2026;16(8):3687. doi:10.3390/app16083687
BibTeX
@article{Gao2026,
author = {Gao, Qiuqi and Li, Jiahong and Huang, Xiaoxiang and Zhu, Yidian and Du, Yu},
title = {AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {8},
pages = {3687},
doi = {10.3390/app16083687}
}
EUVIMED