Give AI agents superpowers on the web: crawl, render, map, extract, and verify evidence through one governed Node.js crawler.

The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s

PostgreSQL database migration management tool for node.js

A triple-linked lists based DOM implementation

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.

Support using Sequelize with CockroachDB.

Analyzes license information for multiple node.js modules (package.json files) as part of your software project.

UI Components is a reusable component library. It provides the core components for the Cockroach design system.

Open-source AI agent governance for TypeScript: policy, exact one-use approvals, controlled tool execution, and verifiable receipts.

This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

Used to run a web crawler that checks for errors on specified pages.

Server-side AI crawler tracking for DataFast

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

Device detection module for Nuxt

Inspecting Node.js's Network with Chrome DevTools

The browser runtime your AI agents can use without inheriting your whole machine.

express middleware for serving prerendered javascript-rendered pages for SEO

HTTP request module customized for crawlers.