CCBot
CCBot is a Common Crawl crawler. Category: Training. Blocking protects your content at no visibility cost.
CCBot feeds the public Common Crawl archive, a starting point for many models: blocking it removes you from it.
Block CCBot
Add these lines to your robots.txt:
User-agent: CCBot
Disallow: /Block or allow AI crawlers in robots.txt
Verify the IP address
5 official ranges collected on 15 Nov 2026: publisher’s JSON file. Compare the origin IP with these ranges, never the agent name.
Verify an AI crawler’s IP address · AI crawlers behind a CDN: recover the real IP