Transcoding unicode characters with AVX‐512 instructions
Software: Practice and Experience · 2023-12 · 53 (12) · 2430-2462
DOI: 10.1002/spe.3261 ↗Kurz gefasst
Fachartikel in der Zeitschrift Software: Practice and Experience, online erschienen am 12.09.2023. Verfasst von Robert Clausecker und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada.
Abstract (Originalsprache)
Intel includes in its recent processors a powerful set of instructions capable of processing 512‐bit registers with a single instruction (AVX‐512). Some of these instructions have no equivalent in earlier instruction sets. We leverage these instructions to efficiently transcode strings between the most common formats: UTF‐8 and UTF‐16. With our novel algorithms, we are often twice as fast as the previous best solutions. For example, we transcode Chinese text from UTF‐8 to UTF‐16 at more than 5 GiB using fewer than 2 CPU instructions per character. To ensure reproducibility, we make our software freely available as an open‐source library. Our library is part of the popular Node.js JavaScript runtime.
Förderung
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Clausecker, R., & Lemire, D. (2023). Transcoding unicode characters with AVX‐512 instructions. Software: Practice and Experience, 53(12), 2430-2462. https://doi.org/10.1002/spe.3261
Vancouver
Clausecker R, Lemire D. Transcoding unicode characters with AVX‐512 instructions. Software: Practice and Experience. 2023;53(12):2430-2462. doi:10.1002/spe.3261
BibTeX
@article{Clausecker2023,
author = {Clausecker, Robert and Lemire, Daniel},
title = {Transcoding unicode characters with AVX‐512 instructions},
journal = {Software: Practice and Experience},
year = {2023},
volume = {53},
number = {12},
pages = {2430--2462},
doi = {10.1002/spe.3261}
}
EUVIMED