AI crawler list
IP ranges collected on 15 Nov 2026 from crawl-ia.com, which re-reads publishers’ files daily. Do not hard-code these ranges: publishers change them without notice.
Training
Blocking protects your content at no visibility cost.
| Crawler | Publisher | IP ranges | Official source |
|---|---|---|---|
| GPTBot | OpenAI | 18 ranges | JSON |
| ClaudeBot | Anthropic | 14 ranges | JSON |
| Google-Extended | none (directive or unpublished) | – | |
| GoogleOther | 272 ranges | JSON | |
| CCBot | Common Crawl | 5 ranges | JSON |
| Applebot-Extended | Apple | none (directive or unpublished) | – |
| Meta-ExternalAgent | Meta | none (directive or unpublished) | – |
| Bytespider | ByteDance | none (directive or unpublished) | – |
| cohere-ai | Cohere | none (directive or unpublished) | – |
| Diffbot | Diffbot | none (directive or unpublished) | – |
| omgili | Webz.io | none (directive or unpublished) | – |
Indexing for answers
Blocking removes you from AI answers: the heaviest choice.
| Crawler | Publisher | IP ranges | Official source |
|---|---|---|---|
| OAI-SearchBot | OpenAI | 39 ranges | JSON |
| Claude-SearchBot | Anthropic | 14 ranges | JSON |
| Googlebot | 317 ranges | JSON | |
| PerplexityBot | Perplexity | 13 ranges | JSON |
| bingbot | Microsoft | 29 ranges | JSON |
| Applebot | Apple | none (directive or unpublished) | – |
| Amazonbot | Amazon | none (directive or unpublished) | – |
| DuckAssistBot | DuckDuckGo | none (directive or unpublished) | – |
| YouBot | You.com | none (directive or unpublished) | – |
On-demand fetch
Blocking breaks reading for someone who wanted to read you.
| Crawler | Publisher | IP ranges | Official source |
|---|---|---|---|
| ChatGPT-User | OpenAI | 237 ranges | JSON |
| Claude-User | Anthropic | 14 ranges | JSON |
| Perplexity-User | Perplexity | 10 ranges | JSON |
| MistralAI-User | Mistral | none (directive or unpublished) | – |