EUVIMEDEUVIMED entdecken
Crossref

On Improving the Performance of Intra- and Inter-chiplet Interconnection Networks in Multi-chiplet Systems for Accelerating FHE Encrypted Neural Network Applications

Zewei Lai, Jinhui Ye, Xiaohang Wang, Zheang Fu, Amit Kumar Singh, Yingtao Jiang, Kui Ren, Mei Yang, Sihai Qiu, Xiaodong Li, Xin Tang, Jie Song und 1 weitere

ACM Transactions on Embedded Computing Systems · 30.11.2025 · 24 (5s) · 1-25

DOI: 10.1145/3762995 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Embedded Computing Systems, online erschienen am 26.09.2025. Verfasst von Zewei Lai und 12 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 64 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, Key Technologies R&D Program of Jiangsu.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fully Homomorphic Encryption (FHE) is regarded as a promising way to protect data privacy with encrypted computation. Due to high computation overhead, hardware based FHE accelerators were proposed to speed up FHE applications. To support complicated FHE-encrypted neural network applications, multi-chiplet based FHE accelerators were further proposed for scaling up system size, whereas one of the challenges is designing efficient intra- and inter-chiplet interconnection networks to accelerate data transfer. Conventional regular topologies like mesh or Kite either lead to high inter-chiplet transmission latency or excessive power consumption as these topologies assume uniform bandwidth or radix for nodes/links, ignoring the highly irregular distribution of inter-chiplet communication volumes. On the other hand, the problem of generating customized intra- and inter-chiplet interconnection networks has high complexity and previous network-on-chip topology generation works cannot efficiently improve the performance of intra- and inter-chiplet interconnection networks. In this article, the intra- and inter-chiplet interconnection optimization problem is defined, aiming to minimize the execution time of FHE applications under cost and power constraints. To efficiently solve this problem, we propose a bilevel optimization algorithm, which decomposes the problem into three sub-problems: (1) FHE parameters selection, (2) task-to-core mapping, and (3) intra-/inter-chiplet interconnection network topology generation. These sub-problems are then solved iteratively. Experimental results demonstrate that our proposed method reduces execution time by 51.66%, 43.16%, 39.44%, 43.34%, and 27.70% compared with REED and four multi-chiplet based FHE accelerators with mesh, Kite, Butterfly, and Florets as inter-chiplet interconnection networks. Therefore, the proposed method can effectively accelerate FHE applications on large-scale multi-chiplet systems.

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China
  • Key Technologies R&D Program of Jiangsu
  • R&D programme of Zhejiang Province
  • Ant Group through CCF-Ant Research Fund

Zitieren

APA

Lai, Z., Ye, J., Wang, X., Fu, Z., Singh, A. K., Jiang, Y., Ren, K., Yang, M., Qiu, S., Li, X., Tang, X., Song, J., & Zhang, M. (2025). On Improving the Performance of Intra- and Inter-chiplet Interconnection Networks in Multi-chiplet Systems for Accelerating FHE Encrypted Neural Network Applications. ACM Transactions on Embedded Computing Systems, 24(5s), 1-25. https://doi.org/10.1145/3762995

Vancouver

Lai Z, Ye J, Wang X, Fu Z, Singh AK, Jiang Y, et al. On Improving the Performance of Intra- and Inter-chiplet Interconnection Networks in Multi-chiplet Systems for Accelerating FHE Encrypted Neural Network Applications. ACM Transactions on Embedded Computing Systems. 2025;24(5s):1-25. doi:10.1145/3762995

BibTeX
@article{Lai2025,
  author = {Lai, Zewei and Ye, Jinhui and Wang, Xiaohang and Fu, Zheang and Singh, Amit Kumar and Jiang, Yingtao and Ren, Kui and Yang, Mei and Qiu, Sihai and Li, Xiaodong and Tang, Xin and Song, Jie and Zhang, Mingzhe},
  title = {On Improving the Performance of Intra- and Inter-chiplet Interconnection Networks in Multi-chiplet Systems for Accelerating FHE Encrypted Neural Network Applications},
  journal = {ACM Transactions on Embedded Computing Systems},
  year = {2025},
  volume = {24},
  number = {5s},
  pages = {1--25},
  doi = {10.1145/3762995}
}
Kostenlos starten →