@bluryar/tokenizers-js
基于 [HuggingFace Tokenizers](https://github.com/huggingface/tokenizers) 的JavaScript封装,使用WebAssembly实现高性能的文本标记化功能。
95
Security score
0 known advisories in v0.1.92
Weekly downloads
2
Unpacked size
2.6 MB
Dependencies
0
Last publish
1 year ago
Security advisories
No known vulnerabilities affect v0.1.92.
Downloads — last 30 days
217 total▼ 98.1% vs prior week
Jul 8Aug 6