GPTBot, ClaudeBot, PerplexityBot: Official robots.txt Guide
Official user agents, robots.txt tokens and IP ranges for GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot and Google-Extended (Oct 2026).
Howseen AI Blog14 min read
1 story
Official user agents, robots.txt tokens and IP ranges for GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot and Google-Extended (Oct 2026).
Showing 1 of 1 stories
You're all caught up.
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts