EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design

Hugo Wai Leung Mak iD, Runze Han, Hoover H F Yin iD

Sensors · 25.03.2023 · 23 (7) · 3457

DOI: 10.3390/s23073457 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 25.03.2023. Verfasst von Hugo Wai Leung Mak und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent decades, the Variational AutoEncoder (VAE) model has shown good potential and capability in image generation and dimensionality reduction. The combination of VAE and various machine learning frameworks has also worked effectively in different daily life applications, however its possible use and effectiveness in modern game design has seldom been explored nor assessed. The use of its feature extractor for data clustering has also been minimally discussed in the literature neither. This study first attempts to explore different mathematical properties of the VAE model, in particular, the theoretical framework of the encoding and decoding processes, the possible achievable lower bound and loss functions of different applications; then applies the established VAE model to generate new game levels based on two well-known game settings; and to validate the effectiveness of its data clustering mechanism with the aid of the Modified National Institute of Standards and Technology (MNIST) database. Respective statistical metrics and assessments are also utilized to evaluate the performance of the proposed VAE model in aforementioned case studies. Based on the statistical and graphical results, several potential deficiencies, for example, difficulties in handling high-dimensional and vast datasets, as well as insufficient clarity of outputs are discussed; then measures of future enhancement, such as tokenization and the combination of VAE and GAN models, are also outlined. Hopefully, this can ultimately maximize the strengths and advantages of VAE for future game design tasks and relevant industrial missions.

Schlagwörter

Stichwörter der Autor:innen

Bayesian algorithmMNIST databasedata and image analyticsdata clusteringgame designgenerator and discriminatorimage and video generationloss functionvariational autoencoder (VAE)

Autor:innen und Institutionen

  • Department of Mathematics, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China.
  • Department of Mathematics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China.
  • Department of Information Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China.
  • Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China.

ORCID-Profile: Hugo Wai Leung Mak, Hoover H F Yin

Zitieren

APA

Mak, H. W. L., Han, R., & Yin, H. H. F. (2023). Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design. Sensors, 23(7), 3457. https://doi.org/10.3390/s23073457

Vancouver

Mak HWL, Han R, Yin HHF. Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design. Sensors. 2023;23(7):3457. doi:10.3390/s23073457

BibTeX
@article{Mak2023,
  author = {Mak, Hugo Wai Leung and Han, Runze and Yin, Hoover H F},
  title = {Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {7},
  pages = {3457},
  doi = {10.3390/s23073457}
}
Kostenlos starten →