Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design
Sensors · 25.03.2023 · 23 (7) · 3457
DOI: 10.3390/s23073457 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 25.03.2023. Verfasst von Hugo Wai Leung Mak und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In recent decades, the Variational AutoEncoder (VAE) model has shown good potential and capability in image generation and dimensionality reduction. The combination of VAE and various machine learning frameworks has also worked effectively in different daily life applications, however its possible use and effectiveness in modern game design has seldom been explored nor assessed. The use of its feature extractor for data clustering has also been minimally discussed in the literature neither. This study first attempts to explore different mathematical properties of the VAE model, in particular, the theoretical framework of the encoding and decoding processes, the possible achievable lower bound and loss functions of different applications; then applies the established VAE model to generate new game levels based on two well-known game settings; and to validate the effectiveness of its data clustering mechanism with the aid of the Modified National Institute of Standards and Technology (MNIST) database. Respective statistical metrics and assessments are also utilized to evaluate the performance of the proposed VAE model in aforementioned case studies. Based on the statistical and graphical results, several potential deficiencies, for example, difficulties in handling high-dimensional and vast datasets, as well as insufficient clarity of outputs are discussed; then measures of future enhancement, such as tokenization and the combination of VAE and GAN models, are also outlined. Hopefully, this can ultimately maximize the strengths and advantages of VAE for future game design tasks and relevant industrial missions.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Mathematics, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China.
- Department of Mathematics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China.
- Department of Information Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China.
- Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China.
ORCID-Profile: Hugo Wai Leung Mak, Hoover H F Yin
Zitieren
APA
Mak, H. W. L., Han, R., & Yin, H. H. F. (2023). Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design. Sensors, 23(7), 3457. https://doi.org/10.3390/s23073457
Vancouver
Mak HWL, Han R, Yin HHF. Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design. Sensors. 2023;23(7):3457. doi:10.3390/s23073457
BibTeX
@article{Mak2023,
author = {Mak, Hugo Wai Leung and Han, Runze and Yin, Hoover H F},
title = {Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design},
journal = {Sensors},
year = {2023},
volume = {23},
number = {7},
pages = {3457},
doi = {10.3390/s23073457}
}
EUVIMED