Scan target
Inspect public crawler controls on any website
Checks root-level governance files and HTTP headers that shape crawler behavior.
We check five public signals: robots.txt, llms.txt, llms-full.txt, a /api/search endpoint, and key HTTP headers. You get a 0-100 readiness score and a Quick Wins list. The full PDF report is $29.
Scan target
Scan report
Checks robots.txt, ai.txt, agent-policy.json, and key HTTP headers. Produces a 0–100 exposure score.