115 packages matching “spiders”
isbot
v5.2.1 · 21 days ago
🤖/👨🦰 Recognise bots/crawlers/spiders using the user agent string.
No known vulnerabilities
spiders
v2.0.0 · 7 years ago
A web crawler engine
No known vulnerabilities
isbot-fast
v1.2.0 · 6 years ago
JavaScript module detecting bots/crawlers/spiders via user-agent
No known vulnerabilities
crawler-user-agents
v1.56.0 · 1 month ago
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
No known vulnerabilities
@nodebb/spider-detector
v2.0.3 · 2 years ago
A tiny node module to detect spiders/crawlers quickly and comes with optional middleware for ExpressJS
No known vulnerabilities
spider-detector
v2.1.0 · 1 year ago
A tiny node module to detect spiders/crawlers quickly and comes with optional middleware for ExpressJS
No known vulnerabilities
es6-crawler-detect
v4.0.2 · 1 year ago
This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.
No known vulnerabilities
ztx
v1.0.15 · 8 years ago
node spiders
No known vulnerabilities
scrapy-spider-gen
v0.2.18 · 1 month ago
Pi extension — génère des spiders Scrapy depuis des pages HTML
No known vulnerabilities
crawler-detector
v0.0.4 · 9 years ago
This module helps detect if a user agent derives from known robots/crawlers/spiders
No known vulnerabilities
express-spider-middleware
v1.1.9 · 6 years ago
And ExpressJS middleware for detecting search engine crawlers/spiders and handling crawler-specific logic such as additional logging for requests from spiders
No known vulnerabilities
@javivelasco/isbot
v3.3.3 · 4 years ago
🤖 detect bots/crawlers/spiders via the user agent.
No known vulnerabilities
lycosa
v1.0.1 · 7 years ago
mother of spiders
No known vulnerabilities
spider-adapters
v0.0.6 · 6 years ago
🕷️ Adapter for spiders, using Cheerio to parse HTML response.
No known vulnerabilities
thesaurus-synonyms-data
v1.0.5 · 8 years ago
Words synonyms data scraped with spiders from thesaurus.com
No known vulnerabilities
wiggler
v0.0.3 · 11 years ago
Tiny library to build web spiders.
No known vulnerabilities
dictionary-definitions-data
v1.0.2 · 8 years ago
Words definitions data scraped with spiders from dictionary.com
No known vulnerabilities
thesaurus-synonyms-k-data
v1.0.0 · 8 years ago
K - Words synonyms data scraped with spiders from thesaurus.com
No known vulnerabilities
hapi-crawler
v1.0.1 · 6 years ago
Hapi Crawler plugin help you detect bots/crawlers/spiders via the useragent.
No known vulnerabilities
spiders.js
v2.8.9 · 6 years ago
Parallel and Distributed Programming in JavaScript made easy through actors
No known vulnerabilities