User-agent: * Allow: / # Advertise the SAME sitemap names the WordPress control does, so that during the # A/B ramp a Googlebot IP bucketed to EITHER origin gets a URL that resolves 200. # (The challenger's native hyphen name `sitemap-index.xml` 404s on control; these # underscore names are served by the SWA rewrite in staticwebapp.config.json and # by WordPress natively.) Sitemap: https://yourroofhero.com/sitemap_index.xml Sitemap: https://yourroofhero.com/sitemaps.xml Sitemap: https://yourroofhero.com/sitemap-legacy.xml # AI answer engines — an explicit decision, not a default. # See config/site.ts aiCrawlerPolicy for the reasoning. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: Bytespider Allow: / User-agent: Applebot-Extended Allow: / User-agent: meta-externalagent Allow: /