# Meta-ExternalFetcher

Meta's crawler: what it does, robots.txt handling per the operator, and observed behaviour on this property.

- Operator: Meta
- Purpose: User-requested fetches | operator's words: "fetches individual links at a user's request and supports product functions such as evaluating and improving agentic AI capabilities"
- robots.txt token: `meta-externalfetcher`
- Appears in access logs: yes
- User-agent: `meta-externalfetcher/1.1`
- robots.txt: May bypass robots.txt. Meta states it may bypass robots.txt because it performs fetches that were requested by the user.
- IP list: not published
- Verification: Meta publishes no IP list for it on the crawler page.
- Documentation: https://developers.facebook.com/docs/sharing/webmasters/web-crawlers (read 2026-08-04)

Block it:
```
User-agent: meta-externalfetcher
Disallow: /
```

Observed on this property (logged since 2026-08-04):
- Not observed here yet.

---

Source: https://agentvisibilitytools.com/crawlers/meta-externalfetcher/ · HTML version of this page.
Full index: https://agentvisibilitytools.com/agents.md · JSON: https://agentvisibilitytools.com/api/tools
Free to quote with attribution to The Agent Visibility Directory, https://agentvisibilitytools.com.