Attrape-Robots

AI crawler list

IP ranges collected on 15 Nov 2026 from crawl-ia.com, which re-reads publishers’ files daily. Do not hard-code these ranges: publishers change them without notice.

Training

Blocking protects your content at no visibility cost.

Training
CrawlerPublisherIP rangesOfficial source
GPTBotOpenAI18 rangesJSON
ClaudeBotAnthropic14 rangesJSON
Google-ExtendedGooglenone (directive or unpublished)–
GoogleOtherGoogle272 rangesJSON
CCBotCommon Crawl5 rangesJSON
Applebot-ExtendedApplenone (directive or unpublished)–
Meta-ExternalAgentMetanone (directive or unpublished)–
BytespiderByteDancenone (directive or unpublished)–
cohere-aiCoherenone (directive or unpublished)–
DiffbotDiffbotnone (directive or unpublished)–
omgiliWebz.ionone (directive or unpublished)–

Indexing for answers

Blocking removes you from AI answers: the heaviest choice.

Indexing for answers
CrawlerPublisherIP rangesOfficial source
OAI-SearchBotOpenAI39 rangesJSON
Claude-SearchBotAnthropic14 rangesJSON
GooglebotGoogle317 rangesJSON
PerplexityBotPerplexity13 rangesJSON
bingbotMicrosoft29 rangesJSON
ApplebotApplenone (directive or unpublished)–
AmazonbotAmazonnone (directive or unpublished)–
DuckAssistBotDuckDuckGonone (directive or unpublished)–
YouBotYou.comnone (directive or unpublished)–

On-demand fetch

Blocking breaks reading for someone who wanted to read you.

On-demand fetch
CrawlerPublisherIP rangesOfficial source
ChatGPT-UserOpenAI237 rangesJSON
Claude-UserAnthropic14 rangesJSON
Perplexity-UserPerplexity10 rangesJSON
MistralAI-UserMistralnone (directive or unpublished)–

Diagnostic · FAQ