resilient-llm
MITResilientLLM is a resilient, unified LLM interface with in-built circuit breaker, token bucket rate limiting, caching, and adaptive retry with dynamic backoff support.
100
Security score
0 known advisories in v1.8.2
Weekly downloads
—
Unpacked size
280.0 kB
Dependencies
1
Last publish
20 days ago
Security advisories
No known vulnerabilities affect v1.8.2.