llm-queue
MITSingle-worker priority queue for a local LLM (Ollama), exposed as an OpenAI-compatible HTTP service so multiple processes share one serialized queue against one model.
100
Security score
0 known advisories in v0.2.2
Weekly downloads
—
Unpacked size
70.7 kB
Dependencies
0
Last publish
14 days ago
Security advisories
No known vulnerabilities affect v0.2.2.