@tmfi/tokenizers
Apache-2.0Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.
95
Security score
0 known advisories in v0.20.0-dev0
Weekly downloads
—
Unpacked size
28.7 kB
Dependencies
0
Last publish
1 year ago
Security advisories
No known vulnerabilities affect v0.20.0-dev0.