Retrieve the values defined with preprocessor statements in a selection of GLSL tokens

Determine the scope depth of an array of GLSL tokens

Time zone support for date-fns v3 with the Intl API

This [remark][remark] plugin can disable any or all remark `blockTokenizers` and `inlineTokenizers`. It can not only disable the ones provided by remark core, but also any other tokenizer that has been added to the remark parser whether through plugins or

"Descope" an array of GLSL tokens such that they can be safely inlined alongside within another shader without causing any global variable conflicts.

Infer the scope of each token in an array of GLSL tokens

Lexes CommonJS modules, returning their named exports metadata

Error-tolerant ECMAScript parser

Our library `@lenml/llama2-tokenizer` has been deprecated. We are excited to introduce our new library `@lenml/tokenizers` as its replacement, offering a broader set of features and an enhanced experience.

Wix Restaurants credit-cards tokenizer

a javascript package for node and browsers that supports general processing of the Sutton SignWriting script

Universal module importer for Node.js

Isomorphic fetch() in Node, Deno and Cloudflare Workers

qwen3 tokenizer for NodeJS/Browser

Runtime for Regenerator-compiled generator and async functions.

An efficient text measurement set for the browser.

A tiny (2.8kB) and fast utility for getting a MIME type from an extension or filename

TS tokenizer for Mistral-based LLMs

A simple tool to generate bert tokens and input features

Stripe.js loading utility