225,990 packages matching “web-crawl”
curlas
v4.5.0 · 7 years ago
nodejs web crawl tool
No known vulnerabilities
cockroach-crawler
v0.5.2 · 6 days ago
Give AI agents superpowers on the web: crawl, render, map, extract, and verify evidence through one governed Node.js crawler.
No known vulnerabilities
basemind
v0.23.1 · 5 days ago
Full AI context layer over MCP — tree-sitter code-map, document RAG (PDF/Office/HTML/email + OCR + reranker), shared agent memory, on-demand web crawl, git history + blame + per-symbol diff. 300+ languages, 10+ coding-agent harnesses, content-addressed Fj
No known vulnerabilities
basemind-opencode
v0.23.1 · 5 days ago
Full AI context layer over MCP — tree-sitter code-map, document RAG (PDF/Office/HTML/email + OCR + reranker), shared agent memory, on-demand web crawl, git history + blame + per-symbol diff. 300+ languages, 10+ coding-agent harnesses, content-addressed Fj
No known vulnerabilities
@vibeflow-tools/web-crawl
v0.3.0 · 19 days ago
MCP server for crawling web pages and converting them to clean markdown, with CLI
No known vulnerabilities
json-crawl
v0.5.3 · 2 years ago
Async and sync crawler for json object
No known vulnerabilities
hintrix
v0.1.0 · 4 months ago
Official SDK for the hintrix Web Crawl API — scrape, audit, and extract web content for AI agents
No known vulnerabilities
@tavily/n8n-nodes-tavily
v0.5.1 · 6 months ago
A community node for n8n to integrate Tavily API for web search and content extraction.
No known vulnerabilities
@mendable/n8n-nodes-firecrawl
v2.1.2 · 2 months ago
Official Firecrawl nodes for n8n - scrape, crawl, map, search, and extract data from websites. Supports AI Agent tool usage.
No known vulnerabilities
tree-crawl
v1.2.2 · 2 years ago
Agnostic tree traversal library.
No known vulnerabilities
@crawlee/types
v3.18.0 · 2 days ago
Shared types for the crawlee projects
No known vulnerabilities
@datafast/ai-crawl
v1.0.9 · 22 days ago
Server-side AI crawler tracking for DataFast
No known vulnerabilities
@genspark/cli
v1.5.1 · 9 hours ago
CLI tool for Genspark Tool API - search, crawl, analyze images, generate media
No known vulnerabilities
@kontourai/forage
v0.5.1 · 4 days ago
Safe, replayable web crawling for review pipelines — a crawler for untrusted URLs.
No known vulnerabilities
@crawlee/memory-storage
v3.18.0 · 2 days ago
A simple in-memory storage implementation of the Apify API
No known vulnerabilities
@crawlee/utils
v3.18.0 · 2 days ago
A set of shared utilities that can be used by crawlers
No known vulnerabilities
@mendable/firecrawl-js
v4.32.0 · 6 days ago
JavaScript SDK for Firecrawl API
No known vulnerabilities
@crawlee/core
v3.18.0 · 2 days ago
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
No known vulnerabilities
@crawlee/basic
v3.18.0 · 2 days ago
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
No known vulnerabilities
@crawlee/browser
v3.18.0 · 2 days ago
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
No known vulnerabilities