Pacote: libjjml-java (1.1.18-3)

[ Fonte: libjjml-java  ]

Java bindings for ggml libraries such as llama.cpp

JJML provides enterprise-grade Java bindings for the llama.cpp LLM inference library.

Rather than to support all ggml and llama.cpp fatures, the main goal of this lightweight library is to be compatible with a broad range of Java versions (currently Java 11 to 25) and to provide a stable Java API for core LLM inference capabilities:

 * Simple user/assistant dialog based on standard Java functional interfaces
 * Embeddings
 * Persistence of context state, in order to "pre-compile" prompt prefixes
 * Parallel batches
 * Chat templates (limited to those embedded in llama.cpp)
 * Combination and configuration of the native samplers from the Java side
 * API for implementing samplers in pure Java

This package contains the portable Java binaries, with OSGi and JPMS metadata.

Outros pacotes relacionados a libjjml-java

• dep: libjjml-jni

  Java bindings for ggml libraries such as llama.cpp (native libs)

Download de libjjml-java

Baixe para todas as arquiteturas disponíveis

Arquitetura	Tamanho do pacote	Tamanho instalado	Arquivos
all	104.2 kB	167.0 kB	[lista de arquivos]