Policy-Based Reinforcement Learning for Through Silicon Via Array Design in High-Bandwidth Memory Considering Signal Integrity
IEEE Transactions on Electromagnetic Compatibility · 2024-02 · 66 (1) · 256-269
DOI: 10.1109/temc.2023.3343700 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Electromagnetic Compatibility, 2024-02. Verfasst von Keunwoo Kim und 11 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: National R&D Program, National Research Foundation of Korea, Ministry of Science and ICT, South Korea.
Abstract (Originalsprache)
In this article, a policy-based reinforcement learning (RL) method for optimizing through silicon via (TSV) array design in high-bandwidth memory (HBM) considering signal integrity is proposed. The proposed method can provide an optimal TSV-array signal/ground pattern design to maximize the eye opening (EO), which determines the bandwidth of the high-speed TSV channel. The proposed method adopts the proximal policy optimization algorithm, which directly trains the optimal policy, providing efficient handling of large action spaces rather than value-based RL. The convolutional neural network is used as a feature extractor to extract the location information of the TSV-array. To overcome the computational cost of the reward estimation, a fast EO estimation method is developed based on the equivalent circuit modeling and peak distortion analysis. The proposed method is applied to optimize 1-byte of TSV-array in a 16-high HBM and showed an 18.2% increase in EO compared with the initial design. The optimality performance of the proposed method is compared with deep q-network and random search algorithm, and the proposed method shows 3.4% and 9.6% better optimality, respectively.
Förderung
- National R&D Program
- National Research Foundation of Korea
- Ministry of Science and ICT, South Korea
- Samsung
Zitieren
APA
Kim, K., Park, H., Kim, S., Kim, Y., Son, K., Lho, D., Son, K., Shin, T., Sim, B., Park, J., Park, S., & Kim, J. (2024). Policy-Based Reinforcement Learning for Through Silicon Via Array Design in High-Bandwidth Memory Considering Signal Integrity. IEEE Transactions on Electromagnetic Compatibility, 66(1), 256-269. https://doi.org/10.1109/temc.2023.3343700
Vancouver
Kim K, Park H, Kim S, Kim Y, Son K, Lho D, et al. Policy-Based Reinforcement Learning for Through Silicon Via Array Design in High-Bandwidth Memory Considering Signal Integrity. IEEE Transactions on Electromagnetic Compatibility. 2024;66(1):256-269. doi:10.1109/temc.2023.3343700
BibTeX
@article{Kim2024,
author = {Kim, Keunwoo and Park, Hyunwook and Kim, Seongguk and Kim, Youngwoo and Son, Kyungjune and Lho, Daehwan and Son, Keeyoung and Shin, Taein and Sim, Boogyo and Park, Joonsang and Park, Shinyoung and Kim, Joungho},
title = {Policy-Based Reinforcement Learning for Through Silicon Via Array Design in High-Bandwidth Memory Considering Signal Integrity},
journal = {IEEE Transactions on Electromagnetic Compatibility},
year = {2024},
volume = {66},
number = {1},
pages = {256--269},
doi = {10.1109/temc.2023.3343700}
}
EUVIMED