A comprehensive library for mime-type mapping

Dependency-free RFC 3986 URI toolbox

Streaming parser for robots.txt files

Simple react hook to open browser file selector.

text file transformer to load text file in test files

Get an unused filename by appending a number if it exists: `file.txt` → `file (1).txt`

A tiny (2.8kB) and fast utility for getting a MIME type from an extension or filename

Generate a robots.txt for Astro

a streaming interface for archive generation

Validate urls against robots.txt rules.

Find the first file matching a given pattern in the current directory or the nearest ancestor directory.

Express middleware to serve and generate robots.txt

Download full websites with all assets, including HTML, CSS, JS, JSON, TXT, and archived snapshots from the Wayback Machine.

Generate Markdown versions of Docusaurus HTML pages and an llms.txt index file

Generate LLM-friendly llms.txt files from markdown and MDX content files

TypeScript definitions for json-parse-better-errors

A modern RFC 3986/3987 compliant, scheme extendable URI/IRI parsing/normalizing/resolving/serializing library for JavaScript.

Alphabetically sort an array of strings

Convert globs to regular expressions

A stream that emits multiple other streams one after another (streams3)