133,251 packages matching “llm-response-cache”
llm-response-cache
v0.1.3 · 4 months ago
Prompt-hash-keyed LLM response cache with model-aware invalidation
No known vulnerabilities
@llm-optimize/cache-redis
v0.1.3 · 26 days ago
> Redis-backed LLM response cache for `@llm-optimize/core`. Share cached responses across multiple servers, workers, or serverless functions.
No known vulnerabilities
@llm-optimize/cache-memory
v0.1.3 · 26 days ago
> In-process LLM response cache for `@llm-optimize/core`. Zero dependencies, TTL support, and configurable max size with automatic eviction.
No known vulnerabilities
@theokit/sdk-cache
v0.3.2 · 7 days ago
Semantic LLM response cache for @theokit/sdk — vector + FTS hybrid lookup, in-memory + JSON file stores, plugin integration.
No known vulnerabilities
http-cache-semantics
v4.2.0 · 1 year ago
Parses Cache-Control and other headers. Helps building correct HTTP caches and proxies
No known vulnerabilities
@nodellmcache/semantic-cache
v1.0.0 · 2 months ago
Similarity-based (semantic) LLM response cache for NodeLLMCache
No known vulnerabilities
fresh
v0.5.2 · 8 years ago
HTTP response freshness testing
No known vulnerabilities
@apollo/server-plugin-response-cache
v5.0.0 · 1 year ago
Apollo Server full query response cache
No known vulnerabilities
@graphql-yoga/plugin-response-cache
v3.23.3 · 5 days ago
No description provided.
No known vulnerabilities
@ruvector/ruvllm
v2.6.2 · 16 days ago
Self-learning LLM runtime — TurboQuant KV-cache (6-8x compression), SONA adaptive learning, FlashAttention, speculative decoding, GGUF inference
No known vulnerabilities
@envelop/response-cache
v9.1.1 · 6 months ago
- Skip the execution phase and reduce server load by caching execution results in-memory. - Customize cache entry time to live based on fields and types within the execution result. - Automatically invalidate the cache based on mutation selection sets. -
No known vulnerabilities
es-fresh
v0.0.11 · 3 years ago
fresh rewrite in TypeScript with ESM targets
No known vulnerabilities
@deepseek-ai/dsh-session-title-first-prompt-llm
v0.0.1-rc.3 · 6 days ago
First-message LLM provider plugin for DeepSeek Harness session titles
No known vulnerabilities
ocache
v0.3.0 · 15 hours ago
Composable caching primitives with TTL, SWR, and HTTP response caching
No known vulnerabilities
nocache
v4.0.0 · 3 years ago
Middleware to destroy caching
No known vulnerabilities
lru-cache
v11.5.2 · 1 month ago
A cache object that deletes the least-recently-used items.
No known vulnerabilities
serviceworker-cache-polyfill
v4.0.0 · 10 years ago
Cache polyfill for the ServiceWorker
No known vulnerabilities
@vltpkg/registry-client
v1.0.3 · 2 days ago
Fetch package artifacts and metadata from registries
No known vulnerabilities
file-entry-cache
v11.1.5 · 1 month ago
A lightweight cache for file metadata, ideal for processes that work on a specific set of files and only need to reprocess files that have changed since the last run
No known vulnerabilities
@wix-pilot/detox
v1.0.13 · 1 year ago
Detox driver for Wix Pilot usage
No known vulnerabilities