Paket: libjjml-java (1.1.18-3)

[ Quellcode: libjjml-java  ]

Java bindings for ggml libraries such as llama.cpp

JJML provides enterprise-grade Java bindings for the llama.cpp LLM inference library.

Rather than to support all ggml and llama.cpp fatures, the main goal of this lightweight library is to be compatible with a broad range of Java versions (currently Java 11 to 25) and to provide a stable Java API for core LLM inference capabilities:

 * Simple user/assistant dialog based on standard Java functional interfaces
 * Embeddings
 * Persistence of context state, in order to "pre-compile" prompt prefixes
 * Parallel batches
 * Chat templates (limited to those embedded in llama.cpp)
 * Combination and configuration of the native samplers from the Java side
 * API for implementing samplers in pure Java

This package contains the portable Java binaries, with OSGi and JPMS metadata.

Andere Pakete mit Bezug zu libjjml-java

• dep: libjjml-jni

  Java bindings for ggml libraries such as llama.cpp (native libs)

libjjml-java herunterladen

Download für alle verfügbaren Architekturen

Architektur	Paketgröße	Größe (installiert)	Dateien
all	104,2 kB	167,0 kB	[Liste der Dateien]