TinyML-Enabled Intelligent Question-Answer Services in IoT Edge Consumer Devices
IEEE Transactions on Consumer Electronics · 2024-11 · 70 (4) · 7322-7333
DOI: 10.1109/tce.2024.3417890 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-11. Verfasst von Xuan Wu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: Basic and Applied Basic Research Foundation of Guangdong Province.
Abstract (Originalsprache)
Presently, the prevalence of large language models has driven the rapid popularization of question-and-answer applications. However, the training and deployment of large language models involve high-resource computing, posing a challenge for many small or edge devices in the Internet of Things (IoT). Therefore, in the context of IoT edge consumer electronic devices, deploying question-and-answer models based on TinyML becomes more meaningful. In this paper, we propose a tiny deep learning-based Question-Answer scheme to realize end-to-end dialog service by Machine Reading Comprehension. In order to obtain semantic representation, we design and apply a pre-training model to generate the semantic embedding representation of questions and answers and propose a pre-training fine-tuning method based on the twin model. In addition, we also introduce a compression method based on embedded representation and design a forward compression network and a cyclic compression network based on an encoder. The experimental results show that our method is more accurate than state-of-the-art schemes.
Förderung
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Wu, X., Lin, X., Zhang, Z., Chen, C., Gadekallu, T. R., Kumari, S., & Kumar, S. (2024). TinyML-Enabled Intelligent Question-Answer Services in IoT Edge Consumer Devices. IEEE Transactions on Consumer Electronics, 70(4), 7322-7333. https://doi.org/10.1109/tce.2024.3417890
Vancouver
Wu X, Lin X, Zhang Z, Chen C, Gadekallu TR, Kumari S, et al. TinyML-Enabled Intelligent Question-Answer Services in IoT Edge Consumer Devices. IEEE Transactions on Consumer Electronics. 2024;70(4):7322-7333. doi:10.1109/tce.2024.3417890
BibTeX
@article{Wu2024,
author = {Wu, Xuan and Lin, Xuanye and Zhang, Zhen and Chen, Chien-Ming and Gadekallu, Thippa R. and Kumari, Saru and Kumar, Sachin},
title = {TinyML-Enabled Intelligent Question-Answer Services in IoT Edge Consumer Devices},
journal = {IEEE Transactions on Consumer Electronics},
year = {2024},
volume = {70},
number = {4},
pages = {7322--7333},
doi = {10.1109/tce.2024.3417890}
}
EUVIMED