363,993 packages matching “CommonJS text tokenizer”
kuromoji
v0.1.2 · 8 years ago
JavaScript implementation of Japanese morphological analyzer
No known vulnerabilities
@tokenizer/range
v0.13.1 · 6 months ago
Range-request tokenizer adapter
No known vulnerabilities
glsl-token-inject-block
v1.1.0 · 10 years ago
safely inject a block of tokens into a shader
No known vulnerabilities
node-libs-browser
v2.2.1 · 7 years ago
The node core libs for in browser usage.
No known vulnerabilities
@yozora/tokenizer-math
v2.4.0 · 21 days ago
Tokenizer for processing fenced math block (formulas)
No known vulnerabilities
@tokenlens/tokenizer
v2.0.0-alpha.1 · 11 months ago
Tokenizer utilities for Tokenlens.
No known vulnerabilities
glsl-token-properties
v1.0.1 · 11 years ago
Takes an array of GLSL tokens and determines whether or not they're a property of another identifier
No known vulnerabilities
@adguard/css-tokenizer
v1.2.0 · 1 year ago
CSS / Extended CSS tokenizer
No known vulnerabilities
glsl-token-whitespace-trim
v1.0.0 · 10 years ago
Trim the whitespace within an array of GLSL tokens
No known vulnerabilities
@csstools/css-color-parser
v4.2.0 · 7 days ago
Parse CSS color values
No known vulnerabilities
@yozora/tokenizer-inline-math
v2.4.0 · 21 days ago
Tokenizer for processing inline math (formulas)
No known vulnerabilities
@isaacs/cliui
v9.0.0 · 6 months ago
easily create complex multi-column command-line-interfaces
No known vulnerabilities
@microsoft/tiktokenizer
v1.0.10 · 1 year ago
Tokenizer for OpenAI large language models.
No known vulnerabilities
code-error-fragment
v0.0.230 · 8 years ago
Shows code error fragment of input file
No known vulnerabilities
@yozora/tokenizer-admonition
v2.4.0 · 21 days ago
Tokenizer for processing admonitions
No known vulnerabilities
kuromojin
v3.0.1 · 1 year ago
Provide a high level wrapper for kuromoji.js
No known vulnerabilities
globals
v17.11.0 · 10 days ago
Global identifiers from different JavaScript environments
No known vulnerabilities
@rollup/plugin-commonjs
v29.0.3 · 2 months ago
Convert CommonJS modules to ES2015
No known vulnerabilities
svg-parser
v2.0.5 · 3 days ago
Create a JSON-friendly object from an SVG string
No known vulnerabilities
zeparser
v0.0.7 · 13 years ago
My JavaScript parser
No known vulnerabilities