138,797 packages matching “ai-crawl”
@datafast/ai-crawl
v1.0.9 · 1 month ago
Server-side AI crawler tracking for DataFast
No known vulnerabilities
@nstdata-ai/crawl
v1.0.1 · 28 days ago
Node.js SDK for nstdata
No known vulnerabilities
@spreelytics/ai-crawl
v1.0.0 · 24 days ago
Track AI crawler traffic (GPTBot, ChatGPT-User, Googlebot, ClaudeBot…) on your server and send it to Spreelytics analytics.
No known vulnerabilities
json-crawl
v0.5.3 · 2 years ago
Async and sync crawler for json object
No known vulnerabilities
@genspark/cli
v1.7.0 · 1 day ago
CLI tool for Genspark Tool API - search, crawl, analyze images, generate media
No known vulnerabilities
@attribu/ai-crawl
v1.1.0 · 1 month ago
Track AI crawlers, search bots, and training scrapers on your website. Works with Next.js, Cloudflare Workers, Express, Hono, and any server runtime.
No known vulnerabilities
@mendable/n8n-nodes-firecrawl
v2.1.4 · 7 days ago
Official Firecrawl nodes for n8n - scrape, crawl, map, search, and extract data from websites. Supports AI Agent tool usage.
No known vulnerabilities
tree-crawl
v1.2.2 · 2 years ago
Agnostic tree traversal library.
No known vulnerabilities
@mendable/firecrawl-js
v4.34.1 · 2 hours ago
JavaScript SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature search over a research paper index of PubMed, bioRxiv, medRxiv and arXiv abstracts
No known vulnerabilities
@seosorted/ai-crawl
v0.2.0 · 1 month ago
One-line, server-side AI-crawler & bot traffic tracking for seosorted.ai. Zero runtime dependencies.
No known vulnerabilities
@faurya/ai-crawl
v0.1.0 · 1 month ago
Server-side AI crawler tracking for Faurya
No known vulnerabilities
firecrawl
v4.34.1 · 3 hours ago
JavaScript SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature search over a research paper index of PubMed, bioRxiv, medRxiv and arXiv abstracts
No known vulnerabilities
robots-parser
v3.0.1 · 3 years ago
A specification compliant robots.txt parser with wildcard (*) matching support.
No known vulnerabilities
@kontourai/forage
v0.5.1 · 18 days ago
Safe, replayable web crawling for review pipelines — a crawler for untrusted URLs.
No known vulnerabilities
fdir
v6.5.0 · 1 year ago
The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s
No known vulnerabilities
@tavily/n8n-nodes-tavily
v0.5.1 · 6 months ago
A community node for n8n to integrate Tavily API for web search and content extraction.
No known vulnerabilities
firecrawl-cli
v1.21.1 · 2 hours ago
Command-line interface for Firecrawl. Scrape, crawl, and extract data from any website, and search a ~43M-abstract research paper index (PubMed, bioRxiv, medRxiv, arXiv), directly from your terminal.
No known vulnerabilities
@quartz-community/crawl-links
v0.1.1 · 27 days ago
Crawl links transformer plugin for Quartz
No known vulnerabilities
@xpmetric/ai-crawl
v1.0.0 · 1 month ago
Server-side AI crawler & bot traffic tracking for XPmetric
No known vulnerabilities
x-crawl
v10.1.0 · 1 year ago
x-crawl is a flexible Node.js AI-assisted crawler library.
No known vulnerabilities