50 packages matching “gpt2”
@lenml/tokenizer-gpt2
v3.7.2 · 1 year ago
gpt2 tokenizer for NodeJS/Browser
No known vulnerabilities
@jseeio/gpt2-tfjs
v0.0.1 · 3 years ago
GPT2 with Tensorflow.js
No known vulnerabilities
tiktoken
v1.0.22 · 1 year ago
JS/WASM bindings for tiktoken
No known vulnerabilities
@dqbd/tiktoken
v1.0.22 · 1 year ago
JS/WASM bindings for tiktoken
No known vulnerabilities
tiktoken-rs-node
v1.0.6 · 1 year ago
_(inspired by [tiktoken-node](https://github.com/ceifa/tiktoken-node))_
No known vulnerabilities
@hypertok/vocab-gpt2
v1.0.0 · 1 month ago
GPT-2 vocabulary for hypertok format version 1
No known vulnerabilities
tiktoken-node
v0.0.7 · 2 years ago
tiktoken is a fast [BPE](https://en.wikipedia.org/wiki/Byte_pair_encoding) tokeniser for use with OpenAI's models.
No known vulnerabilities
node-gpt
v0.3.5-alpha · 4 years ago
A NodeJS wrapper for GPT models.
No known vulnerabilities
toklen
v0.1.1 · 24 days ago
Count tokens with a model's real Hugging Face tokenizer
No known vulnerabilities
gpt2.o
v1.0.5 · 11 months ago
**URL**: https://lovable.dev/projects/7439de6c-0cba-4fe9-b5ee-6ce7b14dab0d
No known vulnerabilities
@chonkiejs/token
v0.0.4 · 2 months ago
HuggingFace tokenizer support for Chonkie - extends @chonkiejs/core with real tokenization
No known vulnerabilities
code-review-gpt2
v0.1.10 · 2 years ago
Your AI code reviewer. Improve code quality and catch bugs before you break production
No known vulnerabilities
browser-gpt2
v0.0.0 · 1 year ago
## Download and run local LLMs within your browser.
No known vulnerabilities
@meok-labs/csoai
v0.1.0 · 1 month ago
Council of AI — signed, deterministic AI-governance measurement CLI (npm wrapper over the canonical Python csoai).
No known vulnerabilities
hf-inferrer
v0.0.3 · 3 years ago
simple huggingface inference module
No known vulnerabilities
bytez.js
v3.0.0 · 10 months ago
- [API Documentation](#api-documentation) - [Basic Usage](#basic-usage) - [Installation](#installation) - [Authentication and Getting Your Key](#authentication-and-getting-your-key) - [List Available Models](#list-available-models) - [Initialize
No known vulnerabilities
project_void
v1.0.6 · 3 months ago
LLM entropy-aware token compression for prompts
No known vulnerabilities
kvat
v0.1.4 · 8 months ago
Automatic KV-Cache Optimization for HuggingFace Transformers - Find the optimal cache strategy, attention backend, and configuration for your model and hardware.
No known vulnerabilities
tokstream
v0.1.2 · 9 months ago
Tokenizer-based token stream simulator with CLI and WASM
No known vulnerabilities
@tokn-ai/ffbpe-presets
v0.1.0 · 1 month ago
Lazy-loaded common tokenizer presets for FFBPE
No known vulnerabilities