SEO
Robots.txt Checker and Rating Tool
Check and rate robots.txt content for syntax, sitemap directives, blocked paths, wildcard usage, and AI crawler controls.
SEO tool
Robots.txt Checker and Rating Tool
Paste robots.txt and get a crawlability rating, syntax checks, sitemap checks, and AI crawler notes.
Strict checks for syntax, sitemap presence, broad blocking, and AI crawler policy signals.
100%Rating
2User agents
4Rules
1Sitemaps
Has at least one User-agent groupPass
Includes absolute Sitemap directivePass
Does not block the whole site for User-agent: *Pass
Uses only known directivesPass
Has explicit Allow or Disallow rulesPass
Avoids empty Disallow directivesPass
Mentions AI crawler policyPass
Wildcard or end-anchor rules detected. Review them carefully because small pattern mistakes can block important URLs.