gpt-tokenizer

MITLicense declared in the package manifest.

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

BPEencoderdecodertokenizerGPTGPT-2GPT-3GPT-3.5
100

Security score

0 known advisories in v3.4.0

0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.advisory penalty −0 · staleness penalty −0

Weekly downloads

Downloads across all versions in the last 7 days, from the official npm downloads API (api.npmjs.org).

1.1M

Unpacked size

Size of v3.4.0 on disk after npm install extracts the tarball, as reported by the npm registry.

50.6 MB

Dependencies

Direct runtime dependencies declared by v3.4.0. Transitive dependencies are not counted here — use the lockfile audit for the full tree.

0

Last publish

When v3.4.0 was published to the registry. Long gaps can indicate an unmaintained package.

8 months ago

Security advisories

Vulnerabilities affecting v3.4.0 specifically, from OSV.dev — the open database aggregating the GitHub Advisory Database (GHSA) and CVEs. Links open the full advisory.

No known vulnerabilities affect v3.4.0.

Downloads — last 30 days

Daily download counts across all versions for the last 30 days, from the npm downloads API. Weekend dips are normal for developer tooling.

4.4M total▼ 2.8% vs prior week

Jul 1Jul 30