Analyze HTML content visibility for AI crawlers and citations - compare static HTML vs fully rendered content

Answer Engine Optimization for the modern web. Make your site discoverable by AI crawlers and LLMs.

Serve Markdown twins to AI crawlers, make them discoverable, and measure which crawlers actually arrive.

Auto-generate robots.txt, llms.txt, and JSON-LD schema to make your Node.js or Next.js app visible and citable by AI crawlers (GPTBot, ClaudeBot, PerplexityBot) and track AI bot traffic.

Server-side middleware that captures request data from AI crawlers and human traffic, sending events to the Searchable analytics pipeline.

AI-native SEO (AEO) for Next.js — auto-inject JSON-LD, FAQ, AI summary, and SEO metadata so AI crawlers (ChatGPT, Perplexity, Google AI) can cite your pages.

x402 paywall for Next.js — AI crawlers pay per page, humans browse free

AI visibility and content intelligence CLI, with a free local OKF export of page content and the technical layer AI crawlers see.

See which AI crawlers a site's robots.txt allows or blocks, split into crawlers that affect AI answers and crawlers that affect model training.

Cloudflare Pages/Workers middleware that closes a site to human visitors during Shabbat and major Jewish holidays (Israel-observance rules), while always letting search engines and AI crawlers through.

Express middleware to track AI crawlers visiting your site

Detect and track AI crawlers, answer agents, and search bots (GPTBot, ClaudeBot, PerplexityBot, and more) hitting your site or API — server-side SDK for Convrs.

Deterministic GEO / AI-readiness auditor — score any web page for how well AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access, ingest and understand it. Audit a live URL or raw HTML; get findings with concrete fixes.

Next.js proxy/middleware to track AI crawlers visiting your site

Block AI crawlers from training on your Next.js site. Install and forget.

Detect and classify AI crawlers (GPTBot, ClaudeBot, PerplexityBot, ...) from request user agents

Tame the robots crawling and indexing your Nuxt site with ease.

Zero-dependency TypeScript engine for AI Search Optimization (GEO) — generates llms.txt, manages AI crawlers, SEO signals, caching and more

Astro integration that generates Markdown versions of every page at build time, making your site readable by LLMs and AI crawlers, and enabling HTTP content negotiation.

Track AI crawlers, search bots, and training scrapers on your website. Works with Next.js, Cloudflare Workers, Express, Hono, and any server runtime.