EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic

Qiuqi Gao, Jiahong Li, Xiaoxiang Huang, Yidian Zhu, Yu Du

Applied Sciences · 09.04.2026 · 16 (8) · 3687

DOI: 10.3390/app16083687 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 09.04.2026. Verfasst von Qiuqi Gao und 4 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Municipal Education Commission, Beijing Union University, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Highway ramp merging requires autonomous vehicles to make safe and efficient decisions in dense mixed traffic, where strong vehicle interactions and rapidly changing acceptable gaps make the task particularly challenging. Existing reinforcement learning methods are often unimodal and overly conservative, while diffusion-based policies, despite their ability to generate multimodal actions, usually suffer from high inference latency and safety risks caused by unconstrained sampling. To address these issues, this paper proposes AM-DIMPO, an action-mask-guided safe diffusion-implicit policy optimization framework for ramp-merging tasks. The proposed method combines DDIM-based implicit sampling with a state-dependent continuous action mask to improve multimodal action generation efficiency while enhancing action feasibility. In addition, the mask correction signal is incorporated into policy learning to encourage the policy to generate actions closer to the safe feasible region. Experiments are conducted in a Gym-based ramp-merging simulator under both light-traffic and dense-traffic scenarios, where the proposed method is compared with classical reinforcement learning baselines, diffusion reinforcement learning baselines, and a safety-aware PPO baseline. The results show that, in dense traffic, AM-DIMPO achieves a merging success rate of 97.3%, an average speed of 16.27 m/s, and an inference latency of 68 ms; in light traffic, the success rate reaches 98.1%. Moreover, the proposed method maintains robust performance under the tested noisy-observation and reduced-visibility settings. Overall, AM-DIMPO achieves a favorable balance among empirical safety, traffic efficiency, robustness, and real-time inference performance in dense highway ramp-merging tasks.

Förderung

  • Beijing Municipal Education Commission
  • Beijing Union University
  • National Natural Science Foundation of China

Zitieren

APA

Gao, Q., Li, J., Huang, X., Zhu, Y., & Du, Y. (2026). AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic. Applied Sciences, 16(8), 3687. https://doi.org/10.3390/app16083687

Vancouver

Gao Q, Li J, Huang X, Zhu Y, Du Y. AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic. Applied Sciences. 2026;16(8):3687. doi:10.3390/app16083687

BibTeX
@article{Gao2026,
  author = {Gao, Qiuqi and Li, Jiahong and Huang, Xiaoxiang and Zhu, Yidian and Du, Yu},
  title = {AM-DIMPO: Action-Masked Diffusion-Implicit Policy Optimization for On-Ramp Merging Under Dense Traffic},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {8},
  pages = {3687},
  doi = {10.3390/app16083687}
}
Kostenlos starten →