2,534 packages matching “Crawl”
crw-mcp
v0.36.0 · 2 days ago
MCP server for CRW web scraper — scrape, crawl, map, extract, search, and PDF-parse tools for AI agents
No known vulnerabilities
cockroach-crawler
v0.7.0 · 1 month ago
Give AI agents superpowers on the web: crawl, render, map, extract, and verify evidence through one governed Node.js crawler.
No known vulnerabilities
browserify-crawl
v0.3.8 · 8 years ago
Recursively crawl and scan directories, compiling multiple js files into an output directory
No known vulnerabilities
webpeel
v0.22.0 · 5 months ago
The web data platform for AI agents — fetch, search, crawl, extract, monitor, screenshot. 55+ domain extractors, 65-98% token savings, MCP server included. One API call.
No known vulnerabilities
sarvcrawl
v1.0.2 · 11 days ago
Node.js SDK for SarvCrawl — crawl sites, parse documents, and run keyword or hybrid semantic search over your knowledge bases
No known vulnerabilities
mcp-smart-crawler
v1.0.10 · 1 year ago
A command-line tool acting as an MCP (ModelContextProtocol) server, using Playwright to crawl web content for AI models.
No known vulnerabilities
@groundcraft/crawl
v1.1.1 · 1 month ago
Groundcraft Crawl — scrape, search, map and crawl the web through one metered API. CLI, SDK and MCP server.
No known vulnerabilities
toolnet-seo
v1.1.0 · 1 month ago
ToolNetSEO CLI and MCP server for SEO crawl, search intelligence, Google integrations and AI analysis.
No known vulnerabilities
@lukaszraczylo/cloudflare-crawl-mcp
v0.3.1 · 6 months ago
MCP server for Cloudflare Browser Rendering Crawl API
No known vulnerabilities
@renxqoo/tavily-cli
v1.0.3 · 1 month ago
Tavily AI Search / Extract / Crawl / Map / Research CLI for AI agents
No known vulnerabilities
quanticdata-mcp
v0.9.1 · 24 days ago
MCP server for the QuanticData API — scrape, search, map, crawl the web and pull residential/datacenter/mobile proxies for AI agents. Connect QuanticData to Claude, Cursor, and any MCP client.
No known vulnerabilities
@xemahq/managed-fetch
v0.4.0 · 1 month ago
Layer-1 managed outbound-fetch / polite-crawl HTTP client. A domain-agnostic wrapper any ingestion/monitor/scraper calls instead of bare `fetch`: per-host token-bucket rate limiting, exponential backoff+jitter with Retry-After, a per-host circuit breaker,
No known vulnerabilities
rag-core-engine
v0.1.4 · 24 days ago
Framework-agnostic RAG engine: crawl, chunk, embed, store, retrieve, answer — plus general-purpose LLM tasks (summarize, extract) over the same documents.
No known vulnerabilities
@arachnodex/job-link-issues
v1.0.11 · 19 days ago
Arachnodex job for reporting crawl link issues.
No known vulnerabilities
@snext/crawl
v0.1.0 · 4 years ago
Crawl with SNext
No known vulnerabilities
crawl-path
v0.0.6 · 8 years ago
```bash yarn add crawl-path
No known vulnerabilities
bing-webmaster-mcp
v0.1.1 · 17 days ago
MCP server (stdio) for Bing Webmaster Tools: query/page stats, sitemaps, URL submission + IndexNow, crawl diagnostics, keyword & link research
No known vulnerabilities
crawly-mccrawlface
v0.5.5 · 9 years ago
Crawl data from webpages and apply content extraction.
No known vulnerabilities
phantom-crawler-server
v3.0.2 · 7 years ago
Crawl websites with PhantomJS or Puppeteer
No known vulnerabilities
anchor-seo-mcp
v0.3.2 · 13 days ago
MCP server for the Anchor SEO platform — GSC Page Indexing history, Screaming Frog crawl data, and ranked technical-SEO audits for Claude and other MCP clients.
No known vulnerabilities