The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

A triple-linked lists based DOM implementation

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.

A heap-based implementation of priority queue in javascript with typescript support.

Vanilla JS utilities to implement overflow menus

Analyzes license information for multiple node.js modules (package.json files) as part of your software project.

https://linux.die.net/man/2/nice binding for Node.js

Server-side AI crawler tracking for DataFast

Browserbase's SDK for building browser agents

Zero dependency library to safe merge objects.

This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

Device detection module for Nuxt

The smallest and simplest JavaScript priority queue

Generic browser priority queue.

Inspecting Node.js's Network with Chrome DevTools

Robust Environment Configuration for Universal Applications.

The smallest and simplest JavaScript priority queue