173,965 packages matching “ai crawler”
@faurya/ai-crawl
v0.1.0 · 1 month ago
Server-side AI crawler tracking for Faurya
No known vulnerabilities
@spreelytics/ai-crawl
v1.0.0 · 21 days ago
Track AI crawler traffic (GPTBot, ChatGPT-User, Googlebot, ClaudeBot…) on your server and send it to Spreelytics analytics.
No known vulnerabilities
@true402.dev/mcp-server
v1.0.9 · 2 days ago
MCP server for the true402 machine-native marketplace — pay-per-call AI + web + Base on-chain tools over x402 (USDC on Base): LLM inference, SEO/GEO audit, web extract, link preview, robots/AI-crawler check, security headers, and on-chain DeFi trading sig
No known vulnerabilities
@obscrd/robots
v0.2.5 · 5 months ago
AI crawler blocking — generate robots.txt, meta tags, and HTTP headers for 30+ AI bots
No known vulnerabilities
@fastergeo/audit
v0.3.1 · 13 days ago
FasterGEO site audit — six-dimension page scoring (crawlability, length, structure, extractable blocks, authority, relevance) anchored to published empirical citation data, plus site-level AI-crawler checks.
No known vulnerabilities
@pixeloffice-eu/aeo-ping
v1.0.1 · 6 days ago
Zero-dependency Instant AI Crawler & IndexNow Broadcaster SDK for Next.js, Node.js, and CMS publishing hooks.
No known vulnerabilities
geo-inspector-mcp
v0.1.2 · 1 month ago
MCP server that inspects a website's AI-search readiness: AI crawler access, llms.txt, schema markup, and indexing directives
No known vulnerabilities
@agentmarkup/next
v0.5.4 · 1 month ago
Build-time llms.txt, llms-full.txt, A2A Agent Cards, JSON-LD, markdown mirrors, headers, AI crawler controls, and validation for Next.js
No known vulnerabilities
lazymac-mcp-ai-crawler-policy
v1.0.0 · 3 months ago
Cloudflare Workers MCP server wrapper: ai-crawler-policy
No known vulnerabilities
technical-seo-mcp
v1.1.0 · 9 days ago
MCP server for technical & on-page SEO audits — crawlability, HTTPS, Core Web Vitals, sitemap, robots.txt, structured data, and AI-crawler access. Reports as Markdown, JSON, or a shareable HTML file.
No known vulnerabilities
@agentmarkup/astro
v0.5.2 · 1 month ago
Build-time llms.txt, llms-full.txt, A2A Agent Cards, JSON-LD, markdown mirrors, headers, AI crawler controls, and validation for Astro
No known vulnerabilities
@xpmetric/ai-crawl
v1.0.0 · 1 month ago
Server-side AI crawler & bot traffic tracking for XPmetric
No known vulnerabilities
@foglift/tracker
v1.4.0 · 29 days ago
Track AI crawler visits and AI engine referrals to your website. See which AI engines (ChatGPT, Claude, Perplexity, Gemini, Copilot) are crawling your content AND sending you human visitors.
No known vulnerabilities
@termind/node
v1.0.1 · 10 days ago
Termind analytics for Node, Bun and edge runtimes. Server-side events, revenue and AI crawler tracking.
No known vulnerabilities
@veris.works/vibecodecheck
v1.0.3 · 1 month ago
Pre-launch site check for vibe-coded MVPs — SEO, AEO, GEO, AI crawler, security in one scan
No known vulnerabilities
@agentmarkup/vite
v0.5.2 · 1 month ago
Build-time llms.txt, llms-full.txt, A2A Agent Cards, JSON-LD, markdown mirrors, headers, AI crawler controls, and validation for Vite
No known vulnerabilities
@seosorted/ai-crawl
v0.2.0 · 1 month ago
One-line, server-side AI-crawler & bot traffic tracking for seosorted.ai. Zero runtime dependencies.
No known vulnerabilities
crawler
v2.1.1 · 2 months ago
Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.
No known vulnerabilities
@lilagents/mcp
v1.2.0 · 1 month ago
The lilAgents free-tool fleet as an MCP server: detect a site tech stack, trace redirects, snapshot DNS, audit security headers, check AI-crawler access, indexability, JSON-LD, and Ahrefs Domain Rating. Built for AI agents.
No known vulnerabilities
llms-txt-init
v1.0.0 · 25 days ago
Scaffold an llms.txt and an AI-crawler-aware robots.txt for your site in one command. Allow the AI retrieval bots you want (GPTBot, ClaudeBot, PerplexityBot, Google-Extended), block training-only scrapers.
No known vulnerabilities