u-llm-server
ISCA llama.cpp-based inference server with slightly extended capabilities in realtime inference control.
100
Security score
0 known advisories in v1.8.1
Weekly downloads
—
Unpacked size
109.4 MB
Dependencies
9
Last publish
8 days ago
Security advisories
No known vulnerabilities affect v1.8.1.