A persistent key/value cache

Self-learning LLM runtime — TurboQuant KV-cache (6-8x compression), SONA adaptive learning, FlashAttention, speculative decoding, GGUF inference

Improve Pi prompt/KV cache hit rates with stable prompts, OpenAI-compatible cache keys, proxy compat warnings, and footer cache stats.

- Supports [Cloudflare KV](https://developers.cloudflare.com/kv/) cache for `@envelop/response-cache` plugin - Suitable for graphql servers running on [Cloudflare Workers](https://workers.cloudflare.com/)

Improve OMP prompt/KV cache hit rates with safer prompt churn cleanup, proxy compat warnings, and footer cache stats.

Typed KV cache for nifra - TTL, stale-while-revalidate, tag invalidation, and single-flight stampede protection on a pluggable store (in-memory default; bring CF KV / Redis). Dependency-free, runs on Bun/Node/Deno/Workers.

OpenCode plugin for LLM prompt caching, token savings, and KV cache reuse across AI agent sessions

Routes requests to KV assets

Pi extension: silently verifies agent context awareness every turn using hidden canary tokens. KV-cache friendly.

Official Mingxin MCP server (stdio): signed AI-inference-storage benchmarks (KV cache tiering, throughput +29-40%, TTFT -26-32% on AMD MI308X), technical article search, and KV-cache tiering ROI estimation. Every figure carries a test-report citation.

AI agent memory & session orchestrator for MCP — persistent KV-Cache, Soul Board, immutable Ledger

Cloudflare KV query cache adapter for Drizzle ORM, built for Workers, D1, and Cloudflare-native TypeScript apps.

Detect your hardware and find LLMs that will actually run on it — with real VRAM/KV-cache fit math, not opaque scores.

Serverless-simple middleware for managing a KV cache layer

Cloudflare Workers KV cache adapter for Flight Framework

Self-learning LLM runtime — TurboQuant KV-cache (6-8x compression), SONA adaptive learning, FlashAttention, speculative decoding, GGUF inference

Automatic KV-Cache Optimization for HuggingFace Transformers - Find the optimal cache strategy, attention backend, and configuration for your model and hardware.

Invert the key/value of an object. Example: `{foo: 'bar'}` → `{bar: 'foo'}`

PMLL Memory MCP Server v2 — persistent memory logic loop with short-term KV cache (peek pattern), Q-promise deduplication, Context+ long-term semantic memory graph, and solution engine. Four-way benchmarked: Combined Context+ + PMLL/peek delivers 36ms (TS

Local-first MCP toolbelt: delegates summarise/classify/extract/transform tasks from any MCP client to a local oMLX inference server. Apple Silicon, MLX-accelerated, KV-cache persistent.