Paketti: libjjml-java (1.1.18-3)

[ Source: libjjml-java  ]

Java bindings for ggml libraries such as llama.cpp

JJML provides enterprise-grade Java bindings for the llama.cpp LLM inference library.

Rather than to support all ggml and llama.cpp fatures, the main goal of this lightweight library is to be compatible with a broad range of Java versions (currently Java 11 to 25) and to provide a stable Java API for core LLM inference capabilities:

 * Simple user/assistant dialog based on standard Java functional interfaces
 * Embeddings
 * Persistence of context state, in order to "pre-compile" prompt prefixes
 * Parallel batches
 * Chat templates (limited to those embedded in llama.cpp)
 * Combination and configuration of the native samplers from the Java side
 * API for implementing samplers in pure Java

This package contains the portable Java binaries, with OSGi and JPMS metadata.

Muut pakettiin libjjml-java liittyvät paketit

• dep: libjjml-jni

  Java bindings for ggml libraries such as llama.cpp (native libs)

Imuroi libjjml-java

Imurointi kaikille saataville arkkitehtuureille

Arkkitehtuuri	Paketin koko	Koko asennettuna	Tiedostot
all	104.2 kt	167.0 kt	[tiedostoluettelo]