48,887 packages matching “kv-cache”
@ruvector/ruvllm
v2.6.2 · 1 month ago
Self-learning LLM runtime — TurboQuant KV-cache (6-8x compression), SONA adaptive learning, FlashAttention, speculative decoding, GGUF inference
No known vulnerabilities
kv-cache
v1.1.2 · 10 years ago
A persistent key/value cache
No known vulnerabilities
pi-cache-optimizer
v2.8.10 · 6 days ago
Improve Pi prompt/KV cache hit rates with stable prompts, OpenAI-compatible cache keys, proxy compat warnings, and footer cache stats.
No known vulnerabilities
@yadsh/dsh-kv-persist
v0.2.6 · 11 hours ago
Persistent KV-cache/session-state manager for DeepSeek Harness (llama.cpp slot snapshots)
No known vulnerabilities
@envelop/response-cache-cloudflare-kv
v6.3.1 · 1 day ago
- Supports [Cloudflare KV](https://developers.cloudflare.com/kv/) cache for `@envelop/response-cache` plugin - Suitable for graphql servers running on [Cloudflare Workers](https://workers.cloudflare.com/)
No known vulnerabilities
@nifrajs/cache
v3.3.0 · 23 days ago
Typed KV cache for nifra - TTL, stale-while-revalidate, tag invalidation, and single-flight stampede protection on a pluggable store (in-memory default; bring CF KV / Redis). Dependency-free, runs on Bun/Node/Deno/Workers.
No known vulnerabilities
dsh-scope
v0.1.0 · 1 month ago
Codex-style context visibility for DeepSeek Harness: live context-window occupancy, composition breakdown, KV-cache hit rate, and a GitHub-style 53-week usage heatmap
No known vulnerabilities
@cloudflare/kv-asset-handler
v0.5.0 · 4 months ago
Routes requests to KV assets
No known vulnerabilities
agent-cache-optimizer
v0.6.1 · 2 months ago
OpenCode plugin for LLM prompt caching, token savings, and KV cache reuse across AI agent sessions
No known vulnerabilities
mingxin-mcp-server
v1.0.0 · 1 month ago
Official Mingxin MCP server (stdio): signed AI-inference-storage benchmarks (KV cache tiering, throughput +29-40%, TTFT -26-32% on AMD MI308X), technical article search, and KV-cache tiering ROI estimation. Every figure carries a test-report citation.
No known vulnerabilities
@ohos-ports/ruvector-ruvllm
v2.6.2-beta.0 · 24 days ago
Self-learning LLM runtime — TurboQuant KV-cache (6-8x compression), SONA adaptive learning, FlashAttention, speculative decoding, GGUF inference
No known vulnerabilities
n2-soul
v9.0.9 · 5 months ago
AI agent memory & session orchestrator for MCP — persistent KV-Cache, Soul Board, immutable Ledger
No known vulnerabilities
@deepseek-ai/dsh-skill-badge
v0.0.1-rc.1 · 1 month ago
Bundled dsh badge skill provider for DeepSeek Harness
No known vulnerabilities
@deepseek-ai/dsh-attachment
v0.0.1-rc.1 · 1 month ago
Durable immutable attachment storage seam for the DeepSeek Harness
No known vulnerabilities
@deepseek-ai/dsh-storage
v0.0.1-rc.1 · 1 month ago
Storage hub (ctx.storage): named backend registry plus mounted data-form facilities for the DeepSeek Harness
No known vulnerabilities
omp-cache-optimizer
v1.2.3 · 2 months ago
Improve OMP prompt/KV cache hit rates with safer prompt churn cleanup, proxy compat warnings, and footer cache stats.
No known vulnerabilities
dsh-skill-folder
v0.3.4 · 15 days ago
Fold the DSH skill catalog prompt surface: static KV-cache-stable catalog + BM25/bge-m3 hybrid skill_search + autoRoute hints. Rendering-only fold: source.entries stay untouched, the skill tool and /name injection stay host-owned. v0.3.0 adds a semantic r
No known vulnerabilities
dsh-my-context
v0.1.5 · 14 hours ago
DSH 上下文透镜 + 成本治理插件:token 用量可视化(每次请求的上下文构成、KV 缓存命中率)+ 每轮/每会话预算控制(超限提醒/拦截)。DSH web plugin: context lens (token usage visualization, KV cache hit rate) + cost governance (per-turn / per-session budget with warn/deny).
No known vulnerabilities
@deepseek-ai/dsh-client-ui-brand-official
v0.1.0-rc.8 · 29 days ago
Official DeepSeek Harness brand occupants for the Web client's sidebar and conversation Hero slots
No known vulnerabilities
@deepseek-ai/dsh-host-plugin-inventory
v0.0.1-rc.3 · 1 month ago
Read-only Remote projection of current Cordis Loader plugin state
No known vulnerabilities