Attrape-Robots

See what AI bots really read on your site

Attrape-Robots shows what AI bots (OpenAI, Anthropic, Google, Perplexity…) receive when they visit a page, and helps you decide who to let in.

Three uses, three decisions

Blocking training protects your content at no visibility cost. Blocking indexing removes you from sourced answers. Blocking on-demand fetch breaks reading of your pages. Details in the crawler list.

This test emulates HTTP access with different User-Agents. It does not perfectly reproduce a real visit: source IP, CDN, WAF and anti-bot rules can change real behaviour. A user-agent name proves nothing; only the origin IP does.

Guides

Site map