EUVIMEDEUVIMED entdecken
Crossref

Accelerating Random Forest on Memory-Constrained Devices Through Data Storage Optimization

Camélia Slimani, Chun-Feng Wu, Stéphane Rubini, Yuan-Hao Chang, Jalil Boukhobza

IEEE Transactions on Computers · 01.06.2023 · 72 (6) · 1595-1609

DOI: 10.1109/tc.2022.3215898 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, erschienen am 01.06.2023. Verfasst von Camélia Slimani und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Bretagne region, France.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Random forests is a widely used classification algorithm. It consists of a set of decision trees each of which is a classifier built on the basis of a random subset of the training data-set. In an environment where the memory work-space is low in comparison to the data-set size, when training a decision tree, a large proportion of the execution time is related to I/O operations. These are caused by data blocks transfers between the storage device and the memory work-space (in both directions). Our analysis of random forests training algorithms showed that there are two major issues : (1) Block Under-utilization: data blocks are poorly used when loaded into memory and have to be reloaded multiple times, meaning that the algorithm exhibits a poor spatial locality; (2) Data Over-read: the data-set is supposed to be fully loaded in memory whereas a large proportion of data are not effectively useful when building a decision tree. Our proposed solution is structured to address these two issues. First, we propose to reorganize the data-set in such a way to enhance spatial locality and second, to remove the assumption that the data-set is entirely loaded into memory and access data only when effectively needed. Our experiments show that this method made it possible to reduce random forest building time by 51 to 95% in comparison to a state-of-the-art method.

Förderung

  • Bretagne region, France

Zitieren

APA

Slimani, C., Wu, C., Rubini, S., Chang, Y., & Boukhobza, J. (2023). Accelerating Random Forest on Memory-Constrained Devices Through Data Storage Optimization. IEEE Transactions on Computers, 72(6), 1595-1609. https://doi.org/10.1109/tc.2022.3215898

Vancouver

Slimani C, Wu C, Rubini S, Chang Y, Boukhobza J. Accelerating Random Forest on Memory-Constrained Devices Through Data Storage Optimization. IEEE Transactions on Computers. 2023;72(6):1595-1609. doi:10.1109/tc.2022.3215898

BibTeX
@article{Slimani2023,
  author = {Slimani, Camélia and Wu, Chun-Feng and Rubini, Stéphane and Chang, Yuan-Hao and Boukhobza, Jalil},
  title = {Accelerating Random Forest on Memory-Constrained Devices Through Data Storage Optimization},
  journal = {IEEE Transactions on Computers},
  year = {2023},
  volume = {72},
  number = {6},
  pages = {1595--1609},
  doi = {10.1109/tc.2022.3215898}
}
Kostenlos starten →