33,742 packages matching “crawler-detection”
fdir
v6.5.0 · 1 year ago
The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s
No known vulnerabilities
@k0nf/crawler-detector
v1.3.0 · 7 months ago
High-speed crawler detection library using optimized local databases for IP and user-agent matching
No known vulnerabilities
uparsejs
v1.2.0 · 8 months ago
Zero-dependency User-Agent parser for Node.js with bot, AI, and crawler detection
No known vulnerabilities
@nuxtjs/device
v4.0.0 · 9 months ago
Device detection module for Nuxt
No known vulnerabilities
linkedom
v0.18.13 · 3 months ago
A triple-linked lists based DOM implementation
No known vulnerabilities
@trivajs/ua-parser
v1.2.0 · 8 months ago
Zero-dependency User-Agent parser for Node.js with bot, AI, and crawler detection
No known vulnerabilities
crawler-user-agents
v1.62.0 · 6 days ago
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
No known vulnerabilities
crawler
v2.1.1 · 3 months ago
Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.
No known vulnerabilities
@aws-sdk/middleware-recursion-detection
v3.972.48 · 12 days ago
[](https://www.npmjs.com/package/@aws-sdk/middleware-recursion-detection) [ as part of your software project.
No known vulnerabilities
@aws-crypto/ie11-detection
v4.0.0 · 3 years ago
Provides functions and types for detecting if the host environment is IE11
No known vulnerabilities
cjs-module-lexer
v2.3.0 · 10 hours ago
Lexes CommonJS modules, returning their named exports metadata
No known vulnerabilities
@vouchington/crawler-html
v0.0.1 · 27 days ago
HTML content decoding and extraction for crawlers.
No known vulnerabilities
package-manager-detector
v1.9.0 · 12 hours ago
Package manager detector
No known vulnerabilities
es6-crawler-detect
v4.0.2 · 1 year ago
This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.
No known vulnerabilities
simplecrawler
v1.1.9 · 6 years ago
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
No known vulnerabilities
@vouchington/rss-crawler
v0.1.0 · 14 days ago
Transport-injected RSS, Atom, and JSON feed crawler.
No known vulnerabilities