User-Agent: * Allow: / User-Agent: GPTBot User-Agent: ClaudeBot User-Agent: Claude-Web User-Agent: PerplexityBot User-Agent: Google-Extended User-Agent: Amazonbot User-Agent: cohere-ai Allow: / Host: https://basethread.ai Sitemap: https://basethread.ai/sitemap.xml