Robots.txt
Analyzer.

Fetch and inspect a site's robots.txt, including user-agent groups, allow/disallow rules and sitemap declarations.