No robots.txt and no sitemap
Scan rule · RSC-ARC-006
- Architecture & SEO
- Severity: Low
Checks whether the target serves crawl directives and a sitemap.
Scan tier
- External scan (anonymous)
How to fix it
Generate `robots.txt` and `sitemap.xml` and submit them in Search Console.