Claude-User
Anthropic · User-requested fetches
What Anthropic says it does
“Claude-User supports Claude AI users. When individuals ask questions to Claude, it may access websites using a Claude-User agent.”
The facts
| Operator | Anthropic |
| robots.txt token | Claude-User |
| Appears in access logs | Yes |
| User-agent string | Not published by the operator |
| robots.txt | Honors robots.txt. Anthropic states its crawlers respect 'do not crawl' signals by honoring industry standard directives in robots.txt. Unlike OpenAI and Perplexity, it claims this for its user-triggered agent too. |
| IP list | https://claude.com/crawling/bots.json |
| Documentation | https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler, read 4 Aug 2026 |
Allow or block it in robots.txt
To block Claude-User entirely:
User-agent: Claude-User Disallow: /
To allow it everywhere:
User-agent: Claude-User Allow: /
Verify a request is really Claude-User
Match the requesting IP against the published list, shared across Anthropic's three agents.
A hit from Claude-User means a person asked Claude something and it opened this page to answer.
Observed on this property
| First seen here | 12 Aug 2026 |
| Most recent | 21 Sep 2026 |
| Requests, last 30 days | 361 |
| Requests, all time | 372 |
| robots.txt fetches | 32 |
User-agent string it sent here:
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:149.17) Gecko/20100101 Firefox/149.17; compatible; Claude-User/1.0; +https://www.anthropic.com/claude-user
Most requested paths:
/robots.txt(32)/tool/waikay/(27)/tool/amicited/(25)/(10)/fetch/(4)/tool/radarkit/(4)/app/.env(3)/.azure/accessTokens.json(3)
Also run by Anthropic
- ClaudeBot | Trains AI models
- Claude-SearchBot | AI search index