342,362 packages matching “text-crawler”
@algolia/netlify-plugin-crawler
v1.0.15 · 4 years ago
This plugin links your Netlify site with Algolia's Crawler. It will trigger a crawl on each successful build.
No known vulnerabilities
js-crawler
v0.3.21 · 8 years ago
Web crawler for Node.js
No known vulnerabilities
@types/x-ray-crawler
v2.0.3 · 2 years ago
TypeScript definitions for x-ray-crawler
No known vulnerabilities
mcp-smart-crawler
v1.0.10 · 1 year ago
A command-line tool acting as an MCP (ModelContextProtocol) server, using Playwright to crawl web content for AI models.
No known vulnerabilities
crawlview
v1.4.2 · 16 days ago
See what search engines and AI crawlers actually store for your pages — not what your browser shows you.
No known vulnerabilities
async-mutex
v0.5.0 · 2 years ago
A mutex for guarding async workflows
No known vulnerabilities
@kontourai/forage
v0.7.0 · 20 days ago
Safe, replayable web crawling for review pipelines — a crawler for untrusted URLs.
No known vulnerabilities
thredds-catalog-crawler
v0.0.7 · 2 years ago
A module for crawling thredds catalogs
No known vulnerabilities
@nithin554/code-crawler
v0.1.18 · 3 days ago
Static call tracing MCP server backed by a SQLite property graph of your codebase
No known vulnerabilities
cockroach-crawler
v0.7.0 · 1 month ago
Give AI agents superpowers on the web: crawl, render, map, extract, and verify evidence through one governed Node.js crawler.
No known vulnerabilities
prember-crawler
v1.0.0 · 7 years ago
A web crawler that works with prember to discover URLs in your app
No known vulnerabilities
top-crawler-agents
v1.0.40 · 1 month ago
Curated list of common web crawler and bot User-Agent strings used across the internet.
No known vulnerabilities
@detiq/crawler
v1.1.22 · 5 days ago
Crawls an app, **gets past the login** (the star of Phase 1), discovers screens, captures screenshots, and reads each page's elements into the App Brain.
No known vulnerabilities
reffy
v21.1.6 · 52 minutes ago
W3C/WHATWG spec dependencies exploration companion. Features a short set of tools to study spec references as well as WebIDL term definitions and references found in W3C specifications.
No known vulnerabilities
@vouchington/crawler-html
v0.0.1 · 8 days ago
HTML content decoding and extraction for crawlers.
No known vulnerabilities
@types/npm-license-crawler
v0.2.3 · 2 years ago
TypeScript definitions for npm-license-crawler
No known vulnerabilities
virtuallist-antd
v0.8.0-beta.1 · 3 years ago
virtualList for antd-table, 实现antd-table的虚拟列表, antd-table无限滚动, infinite scrolling for antd-table
No known vulnerabilities
ora
v9.4.1 · 2 months ago
Elegant terminal spinner
No known vulnerabilities
@vouchington/rss-crawler
v0.0.2 · 21 days ago
Transport-injected RSS, Atom, and JSON feed crawler.
No known vulnerabilities
@qualweb/crawler
v0.5.0 · 2 months ago
Webpage crawler for qualweb
No known vulnerabilities