Free · ten seconds · no signup
What does your robots.txt say?Graded by identity and purpose
Among top-10,000 sites that block Anthropic’s training crawler, 71% have no rule for the bots that answer customers.
Grading reads your site’s declared robots.txt policy toward 15 major AI bots, the same set as Sitedex’s July 2026 top-10,000 study (CC BY 4.0). Declared policy only — a grade says nothing about what your edge enforces or what actually knocks. Read the research: Names don’t scale.
