Attrape-Robots

Bytespider

Bytespider is a ByteDance crawler. Category: Training. Blocking protects your content at no visibility cost.

Reported to respect robots.txt poorly.

Block Bytespider

Add these lines to your robots.txt:

User-agent: Bytespider
Disallow: /

Block or allow AI crawlers in robots.txt

Verify the IP address

No IP range is published in the sources we follow: an agent name alone proves nothing. Check the publisher’s documentation.

Verify an AI crawler’s IP address · AI crawlers behind a CDN: recover the real IP

AI crawlers