Free Tool

Robots.txt and Sitemap Checker

Review crawler guidance, sitemap discovery, reachable sitemap URLs, and sensitive-looking paths advertised in robots.txt. Use the full CMS audit for page sampling, exposure checks, and downloadable reports.