llm-threader
MITIntelligent thread pooling and scaling for local LLM requests based on CPU and GPU usage
100
Security score
0 known advisories in v1.1.0
Weekly downloads
—
Unpacked size
88.3 kB
Dependencies
3
Last publish
8 months ago
Security advisories
No known vulnerabilities affect v1.1.0.