YouBot
You.com · AI search index
What You.com says it does
“YouBot is the web crawler that powers the You.com search engine. It automatically discovers and indexes web pages to provide real-time, accurate search results for You.com users.”
The facts
| Operator | You.com |
| robots.txt token | YouBot |
| Appears in access logs | Yes |
| User-agent string | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; YouBot/1.0; +https://docs.you.com/youbot; env:prod) Chrome/X.X.X.X Safari/537.36 |
| robots.txt | Honors robots.txt. You.com's own words: YouBot fully respects robots.txt directives, including user-agent specific rules and crawl-delay settings. |
| IP list | https://you.com/docs/youbot |
| Documentation | https://you.com/docs/youbot, read 4 Aug 2026 |
Allow or block it in robots.txt
To block YouBot entirely:
User-agent: YouBot Disallow: /
To allow it everywhere:
User-agent: YouBot Allow: /
Verify a request is really YouBot
Requests come from 68.67.112.0/24, reverse DNS resolves as youbot-*.search.you.com, and You.com signs requests via Web Bot Auth. Contact per the docs: spider@you.com.
Observed on this property
| First seen here | 3 Sep 2026 |
| Most recent | 4 Nov 2026 |
| Requests, last 30 days | 725 |
| Requests, all time | 801 |
| robots.txt fetches | 252 |
Most requested paths:
/robots.txt(252)/tool/vizby/(6)/api/tools(5)/api/proc/self/environ(2)/compare/aiclicks-vs-rankscale/(2)/tool/am-i-on-ai/(2)/tool/grackerai/(2)/(1)