VeriGen: A Large Language Model for Verilog Code Generation
ACM Transactions on Design Automation of Electronic Systems · 31.05.2024 · 29 (3) · 1-31
DOI: 10.1145/3643681 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Design Automation of Electronic Systems, online erschienen am 22.04.2024. Verfasst von Shailja Thakur und 6 weiteren Autor:innen. Die Arbeit wurde bisher 272-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: NSF, ARO.
Abstract (Originalsprache)
In this study, we explore the capability of Large Language Models (LLMs) to automate hardware design by automatically completing partial Verilog code, a common language for designing and modeling digital systems. We fine-tune pre-existing LLMs on Verilog datasets compiled from GitHub and Verilog textbooks. We evaluate the functional correctness of the generated Verilog code using a specially designed test suite, featuring a custom problem set and testing benches. Here, our fine-tuned open-source CodeGen-16B model outperforms the commercial state-of-the-art GPT-3.5-turbo model with a 1.1% overall increase. Upon testing with a more diverse and complex problem set, we find that the fine-tuned model shows competitive performance against state-of-the-art gpt-3.5-turbo, excelling in certain scenarios. Notably, it demonstrates a 41% improvement in generating syntactically correct Verilog code across various problem categories compared to its pre-trained counterpart, highlighting the potential of smaller, in-house LLMs in hardware design automation. We release our training/evaluation scripts and LLM checkpoints as open-source contributions.
Förderung
- NSF
- ARO
Zitieren
APA
Thakur, S., Ahmad, B., Pearce, H., Tan, B., Dolan-Gavitt, B., Karri, R., & Garg, S. (2024). VeriGen: A Large Language Model for Verilog Code Generation. ACM Transactions on Design Automation of Electronic Systems, 29(3), 1-31. https://doi.org/10.1145/3643681
Vancouver
Thakur S, Ahmad B, Pearce H, Tan B, Dolan-Gavitt B, Karri R, et al. VeriGen: A Large Language Model for Verilog Code Generation. ACM Transactions on Design Automation of Electronic Systems. 2024;29(3):1-31. doi:10.1145/3643681
BibTeX
@article{Thakur2024,
author = {Thakur, Shailja and Ahmad, Baleegh and Pearce, Hammond and Tan, Benjamin and Dolan-Gavitt, Brendan and Karri, Ramesh and Garg, Siddharth},
title = {VeriGen: A Large Language Model for Verilog Code Generation},
journal = {ACM Transactions on Design Automation of Electronic Systems},
year = {2024},
volume = {29},
number = {3},
pages = {1--31},
doi = {10.1145/3643681}
}
EUVIMED