Пакет: libsimdutf-tools (8.0.0-1)

[ Источник: simdutf  ]

Fast Unicode validation and transcoding - utilities

Most modern software relies on the Unicode standard. In memory, Unicode strings are represented using either UTF-8 or UTF-16. The UTF-8 format is the de facto standard on the web (JSON, HTML, etc.) and it has been adopted as the default in many popular programming languages (Go, Zig, Rust, Swift, etc.). The UTF-16 format is standard in Java, C# and in many Windows technologies.

Not all sequences of bytes are valid Unicode strings. It is unsafe to use Unicode strings in UTF-8 and UTF-16LE without first validating them. Furthermore, we often need to convert strings from one encoding to another, by a process called transcoding. For security purposes, such transcoding should be validating: it should refuse to transcode incorrect strings.

This library provide fast Unicode functions such as

 * ASCII, UTF-8, UTF-16LE/BE and UTF-32 validation, with and without error
   identification,
 * Latin1 to UTF-8 transcoding,
 * Latin1 to UTF-16LE/BE transcoding
 * Latin1 to UTF-32 transcoding
 * UTF-8 to Latin1 transcoding, with or without validation, with and without
   error identification,
 * UTF-8 to UTF-16LE/BE transcoding, with or without validation, with and
   without error identification,
 * UTF-8 to UTF-32 transcoding, with or without validation, with and without
   error identification,
 * UTF-16LE/BE to Latin1 transcoding, with or without validation, with and
   without error identification,
 * UTF-16LE/BE to UTF-8 transcoding, with or without validation, with and
   without error identification,
 * UTF-32 to Latin1 transcoding, with or without validation, with and without
   error identification,
 * UTF-32 to UTF-8 transcoding, with or without validation, with and without
   error identification,
 * UTF-32 to UTF-16LE/BE transcoding, with or without validation, with and
   without error identification,
 * UTF-16LE/BE to UTF-32 transcoding, with or without validation, with and
   without error identification,
 * From an UTF-8 string, compute the size of the Latin1 equivalent string,
 * From an UTF-8 string, compute the size of the UTF-16 equivalent string,
 * From an UTF-8 string, compute the size of the UTF-32 equivalent string
   (equivalent to UTF-8 character counting),
 * From an UTF-16LE/BE string, compute the size of the Latin1 equivalent
   string,
 * From an UTF-16LE/BE string, compute the size of the UTF-8 equivalent
   string,
 * From an UTF-32 string, compute the size of the UTF-8 or UTF-16LE equivalent
   string,
 * From an UTF-16LE/BE string, compute the size of the UTF-32 equivalent
   string (equivalent to UTF-16 character counting),
 * UTF-8 and UTF-16LE/BE character counting,
 * UTF-16 endianness change (UTF16-LE/BE to UTF-16-BE/LE),
 * WHATWG forgiving-base64 (with or without URL encoding) to binary,
 * Binary to base64 (with or without URL encoding).

The functions are accelerated using SIMD instructions (e.g., ARM NEON, SSE, AVX, AVX-512, RISC-V Vector Extension, LoongSon, POWER, etc.). When your strings contain hundreds of characters, we can often transcode them at speeds exceeding a billion characters per second. You should expect high speeds not only with English strings (ASCII) but also Chinese, Japanese, Arabic, and so forth. We handle the full character range (including, for example, emojis).

The library compiles down to a small library of a few hundred kilobytes. Our functions are exception-free and non allocating. We have extensive tests and extensive benchmarks.

This package ships several command line tools.

Другие пакеты, относящиеся к libsimdutf-tools

• dep: libc6 (>= 2.38) [не alpha, i386, loong64, sh4]

  библиотека GNU C: динамически подключаемые библиотеки
  также виртуальный пакет, предоставляемый libc6-udeb

  dep: libc6 (>= 2.42) [i386, loong64, sh4]

• dep: libc6.1 (>= 2.38) [alpha]

  библиотека GNU C: динамически подключаемые библиотеки
  также виртуальный пакет, предоставляемый libc6.1-udeb

• dep: libgcc-s1 (>= 3.5) [armhf]

  вспомогательная библиотека GCC

  dep: libgcc-s1 (>= 4.2) [не armhf, hppa, i386, m68k]

  dep: libgcc-s1 (>= 7) [i386]

• dep: libgcc-s2 (>= 4.2.1) [m68k]

  вспомогательная библиотека GCC

• dep: libgcc-s4 (>= 4.1.1) [hppa]

  вспомогательная библиотека GCC

• dep: libsimdutf31 (>= 8.0.0)

  Fast Unicode validation and transcoding

Загрузка libsimdutf-tools

Загрузить для всех доступных архитектур

Архитектура	Размер пакета	В установленном виде	Файлы
alpha (неофициальный перенос)	492,5 Кб	3 424,0 Кб	[список файлов]
amd64	484,0 Кб	2 734,0 Кб	[список файлов]
arm64	426,2 Кб	2 838,0 Кб	[список файлов]
armhf	378,1 Кб	1 876,0 Кб	[список файлов]
hppa (неофициальный перенос)	464,5 Кб	2 841,0 Кб	[список файлов]
i386	510,8 Кб	2 776,0 Кб	[список файлов]
loong64	457,3 Кб	2 964,0 Кб	[список файлов]
m68k (неофициальный перенос)	457,8 Кб	2 596,0 Кб	[список файлов]
ppc64 (неофициальный перенос)	526,4 Кб	4 310,0 Кб	[список файлов]
ppc64el	609,9 Кб	4 630,0 Кб	[список файлов]
riscv64	474,0 Кб	2 310,0 Кб	[список файлов]
s390x	514,8 Кб	3 372,0 Кб	[список файлов]
sh4 (неофициальный перенос)	487,4 Кб	2 520,0 Кб	[список файлов]
sparc64 (неофициальный перенос)	393,2 Кб	4 126,0 Кб	[список файлов]
x32 (неофициальный перенос)	483,5 Кб	2 512,0 Кб	[список файлов]