[ sid ]
[ 原始碼： libjjml-java ]
套件：libjjml-java（1.1.18-3）
Java bindings for ggml libraries such as llama.cpp
JJML provides enterprise-grade Java bindings for the llama.cpp LLM inference library.
Rather than to support all ggml and llama.cpp fatures, the main goal of this lightweight library is to be compatible with a broad range of Java versions (currently Java 11 to 25) and to provide a stable Java API for core LLM inference capabilities:
* Simple user/assistant dialog based on standard Java functional interfaces * Embeddings * Persistence of context state, in order to "pre-compile" prompt prefixes * Parallel batches * Chat templates (limited to those embedded in llama.cpp) * Combination and configuration of the native samplers from the Java side * API for implementing samplers in pure Java
This package contains the portable Java binaries, with OSGi and JPMS metadata.
其他與 libjjml-java 有關的套件
|
|
|
|
-
- dep: libjjml-jni
- Java bindings for ggml libraries such as llama.cpp (native libs)