Claude-User
Anthropic · User-requested fetches
What Anthropic says it does
“Claude-User supports Claude AI users. When individuals ask questions to Claude, it may access websites using a Claude-User agent.”
The facts
| Operator | Anthropic |
| robots.txt token | Claude-User |
| Appears in access logs | Yes |
| User-agent string | Not published by the operator |
| robots.txt | Honors robots.txt. Anthropic states its crawlers respect 'do not crawl' signals by honoring industry standard directives in robots.txt. Unlike OpenAI and Perplexity, it claims this for its user-triggered agent too. |
| IP list | https://claude.com/crawling/bots.json |
| Documentation | https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler, read 4 Aug 2026 |
Allow or block it in robots.txt
To block Claude-User entirely:
User-agent: Claude-User Disallow: /
To allow it everywhere:
User-agent: Claude-User Allow: /
Verify a request is really Claude-User
Match the requesting IP against the published list, shared across Anthropic's three agents.
A hit from Claude-User means a person asked Claude something and it opened this page to answer.
Observed on this property
Not observed here yet. This site logs every request from 15 named AI agents; logging began 4 Aug 2026. When Claude-User first fetches a page, this section fills in from the log.
Also run by Anthropic
- ClaudeBot | Trains AI models
- Claude-SearchBot | AI search index