Attrape-Robots

CCBot

CCBot is a Common Crawl crawler. Category: Training. Blocking protects your content at no visibility cost.

CCBot feeds the public Common Crawl archive, a starting point for many models: blocking it removes you from it.

Block CCBot

Add these lines to your robots.txt:

User-agent: CCBot
Disallow: /

Block or allow AI crawlers in robots.txt

Verify the IP address

5 official ranges collected on 15 Nov 2026: publisher’s JSON file. Compare the origin IP with these ranges, never the agent name.

Verify an AI crawler’s IP address · AI crawlers behind a CDN: recover the real IP

Official documentation

AI crawlers