PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles
Sensors · 12.03.2026 · 26 (6) · 1798
DOI: 10.3390/s26061798 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 12.03.2026. Verfasst von Aws Khalil und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, University of Michigan-Dearborn, Dearborn, MI 48128, USA. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. National Science Foundation.
Abstract (Originalsprache)
This study introduces the Perception Latency Mitigation Network (PLM-Net), a modular deep learning framework designed to mitigate perception latency in vision-based imitation-learning lane-keeping systems. Perception latency, defined as the delay between visual sensing and steering actuation, can degrade lateral tracking performance and steering stability. While delay compensation has been extensively studied in classical predictive control systems, its treatment within vision-based imitation-learning architectures under constant and time-varying perception latency remains limited. Rather than reducing latency itself, PLM-Net mitigates its effect on control performance through a plug-in architecture that preserves the original control pipeline. The framework consists of a frozen Base Model (BM), representing an existing lane-keeping controller, and a Timed Action Prediction Model (TAPM), which predicts future steering actions corresponding to discrete latency conditions. Real-time mitigation is achieved by interpolating between model outputs according to the measured latency value, enabling adaptation to both constant and time-varying latency. The framework is evaluated in a closed-loop deterministic simulation environment under fixed-speed conditions to isolate the impact of perception latency. Results demonstrate significant reductions in steering error under multiple latency settings, achieving up to 62% and 78% reductions in Mean Absolute Error (MAE) for constant and time-varying latency cases, respectively. These findings demonstrate the architectural feasibility of modular latency mitigation for vision-based lateral control under controlled simulation settings. The project page including video demonstrations, code, and dataset is publicly released.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical and Computer Engineering, University of Michigan-Dearborn, Dearborn, MI 48128, USA.
ORCID-Profile: Aws Khalil, Jaerock Kwon
Förderung
- U.S. National Science Foundation
Zitieren
APA
Khalil, A., & Kwon, J. (2026). PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles. Sensors, 26(6), 1798. https://doi.org/10.3390/s26061798
Vancouver
Khalil A, Kwon J. PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles. Sensors. 2026;26(6):1798. doi:10.3390/s26061798
BibTeX
@article{Khalil2026,
author = {Khalil, Aws and Kwon, Jaerock},
title = {PLM-Net: Perception Latency Mitigation Network for Vision-Based Lateral Control of Autonomous Vehicles},
journal = {Sensors},
year = {2026},
volume = {26},
number = {6},
pages = {1798},
doi = {10.3390/s26061798}
}
EUVIMED