YouBot
You.com · AI search index
What You.com says it does
“YouBot is the web crawler that powers the You.com search engine. It automatically discovers and indexes web pages to provide real-time, accurate search results for You.com users.”
The facts
| Operator | You.com |
| robots.txt token | YouBot |
| Appears in access logs | Yes |
| User-agent string | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; YouBot/1.0; +https://docs.you.com/youbot; env:prod) Chrome/X.X.X.X Safari/537.36 |
| robots.txt | Honors robots.txt. You.com's own words: YouBot fully respects robots.txt directives, including user-agent specific rules and crawl-delay settings. |
| IP list | https://you.com/docs/youbot |
| Documentation | https://you.com/docs/youbot, read 4 Aug 2026 |
Allow or block it in robots.txt
To block YouBot entirely:
User-agent: YouBot Disallow: /
To allow it everywhere:
User-agent: YouBot Allow: /
Verify a request is really YouBot
Requests come from 68.67.112.0/24, reverse DNS resolves as youbot-*.search.you.com, and You.com signs requests via Web Bot Auth. Contact per the docs: spider@you.com.
Observed on this property
Not observed here yet. This site logs every request from 15 named AI agents; logging began 4 Aug 2026. When YouBot first fetches a page, this section fills in from the log.