llm-hedge
MITExecution layer that hides LLM tail latency with hedging, speculation, prefetch, and cancellation.
100
Security score
0 known advisories in v0.2.0
Weekly downloads
—
Unpacked size
75.6 kB
Dependencies
0
Last publish
2 months ago
Security advisories
No known vulnerabilities affect v0.2.0.