The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s

A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.

A triple-linked lists based DOM implementation

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

Create xml sitemaps from the command line.

Determine if a function is a native generator function.

Turns an AST into code.

A function that returns the normally hidden `GeneratorFunction` constructor

Turn async generator functions into ES2015 generators

Helper function to remap async functions to generators

Turn async functions into ES2015 generators

Easily create XML sitemaps for your website.

Analyzes license information for multiple node.js modules (package.json files) as part of your software project.

Check if something is a generator function

<p align="center"> <img src="https://github.com/dotansimha/graphql-code-generator/blob/master/logo.png?raw=true" /> </p>

<p align="center"> <img src="https://github.com/dotansimha/graphql-code-generator/blob/master/logo.png?raw=true" /> </p>

Server-side AI crawler tracking for DataFast

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.

Generate artificial backtrace by walking arguments.callee.caller chain