kvat
Apache-2.0Automatic KV-Cache Optimization for HuggingFace Transformers - Find the optimal cache strategy, attention backend, and configuration for your model and hardware.
100
Security score
0 known advisories in v0.1.4
Weekly downloads
—
Unpacked size
11.8 kB
Dependencies
0
Last publish
6 months ago
Security advisories
No known vulnerabilities affect v0.1.4.