Meta-ExternalAgent
Meta · Trains AI models; indexing
What Meta says it does
“crawls the web for use cases such as training foundation AI models or improving products by indexing content”
The facts
| Operator | Meta |
| robots.txt token | meta-externalagent |
| Appears in access logs | Yes |
| User-agent string | meta-externalagent/1.1 |
| robots.txt | Controlled via robots.txt. Meta's crawler page documents the meta-externalagent robots.txt token and notes no bypass conditions for it, unlike its user-triggered sibling Meta-ExternalFetcher. |
| IP list | Not published |
| Documentation | https://developers.facebook.com/docs/sharing/webmasters/web-crawlers, read 4 Aug 2026 |
Allow or block it in robots.txt
To block meta-externalagent entirely:
User-agent: meta-externalagent Disallow: /
To allow it everywhere:
User-agent: meta-externalagent Allow: /
Verify a request is really Meta-ExternalAgent
Meta publishes no IP list for it on the crawler page.
Observed on this property
Not observed here yet. This site logs every request from 15 named AI agents; logging began 4 Aug 2026. When Meta-ExternalAgent first fetches a page, this section fills in from the log.
Also run by Meta
- Meta-ExternalFetcher | User-requested fetches