# GPTBot

OpenAI's crawler: what it does, robots.txt handling per the operator, and observed behaviour on this property.

- Operator: OpenAI
- Purpose: Trains AI models | operator's words: "crawl content that may be used in training our generative AI foundation models"
- robots.txt token: `GPTBot`
- Appears in access logs: yes
- User-agent: `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot`
- robots.txt: Honors robots.txt. OpenAI states that disallowing GPTBot signals the site's content should not be used for model training.
- IP list: https://openai.com/gptbot.json
- Verification: Match the requesting IP against the published list.
- Documentation: https://developers.openai.com/api/docs/bots (read 2026-08-04)

Block it:
```
User-agent: GPTBot
Disallow: /
```

Observed on this property (logged since 2026-08-04):
- First seen 2026-08-04, most recent 2026-08-04
- Requests: 2007 in the last 30 days, 2007 all time, of which 0 for /robots.txt
- 14x `/api/tools`
- 1x `/`
- 1x `/about/`
- 1x `/about/index.md`
- 1x `/agents.md`
- 1x `/ai-visibility-tools-under-100/`
- 1x `/ai-visibility-tools-under-100/index.md`
- 1x `/alternatives/ahrefs-brand-radar/`

---

Source: https://agentvisibilitytools.com/crawlers/gptbot/ · HTML version of this page.
Full index: https://agentvisibilitytools.com/agents.md · JSON: https://agentvisibilitytools.com/api/tools
Free to quote with attribution to The Agent Visibility Directory, https://agentvisibilitytools.com.