@plurnk/plurnk-mimetypes-tokenizers
MITBundled LLM tokenizer vocabularies (tokenizer.json set) for @plurnk/plurnk-mimetypes' tokenizer seam — exact token counting for window math.
100
Security score
0 known advisories in v1.18.0
Weekly downloads
—
Unpacked size
74.6 MB
Dependencies
1
Last publish
2 days ago
Security advisories
No known vulnerabilities affect v1.18.0.