EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles

Aws Khalil iD, Jaerock Kwon iD

Sensors · 12.03.2026 · 26 (6) · 1798

DOI: 10.3390/s26061798 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 12.03.2026. Verfasst von Aws Khalil und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, University of Michigan-Dearborn, Dearborn, MI 48128, USA. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study introduces the Perception Latency Mitigation Network (PLM-Net), a modular deep learning framework designed to mitigate perception latency in vision-based imitation-learning lane-keeping systems. Perception latency, defined as the delay between visual sensing and steering actuation, can degrade lateral tracking performance and steering stability. While delay compensation has been extensively studied in classical predictive control systems, its treatment within vision-based imitation-learning architectures under constant and time-varying perception latency remains limited. Rather than reducing latency itself, PLM-Net mitigates its effect on control performance through a plug-in architecture that preserves the original control pipeline. The framework consists of a frozen Base Model (BM), representing an existing lane-keeping controller, and a Timed Action Prediction Model (TAPM), which predicts future steering actions corresponding to discrete latency conditions. Real-time mitigation is achieved by interpolating between model outputs according to the measured latency value, enabling adaptation to both constant and time-varying latency. The framework is evaluated in a closed-loop deterministic simulation environment under fixed-speed conditions to isolate the impact of perception latency. Results demonstrate significant reductions in steering error under multiple latency settings, achieving up to 62% and 78% reductions in Mean Absolute Error (MAE) for constant and time-varying latency cases, respectively. These findings demonstrate the architectural feasibility of modular latency mitigation for vision-based lateral control under controlled simulation settings. The project page including video demonstrations, code, and dataset is publicly released.

Schlagwörter

Stichwörter der Autor:innen

autonomous vehicle navigationdeep learning in robotics and automationlatency mitigationlearning from demonstrationmodel learning for control

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, University of Michigan-Dearborn, Dearborn, MI 48128, USA.

ORCID-Profile: Aws Khalil, Jaerock Kwon

Förderung

  • U.S. National Science Foundation

Zitieren

APA

Khalil, A., & Kwon, J. (2026). PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles. Sensors, 26(6), 1798. https://doi.org/10.3390/s26061798

Vancouver

Khalil A, Kwon J. PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles. Sensors. 2026;26(6):1798. doi:10.3390/s26061798

BibTeX
@article{Khalil2026,
  author = {Khalil, Aws and Kwon, Jaerock},
  title = {PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {6},
  pages = {1798},
  doi = {10.3390/s26061798}
}
Kostenlos starten →